Use structured JSON logging for better searchability and analysis in cloud environments.
Read more →Month: November 2024
Deploying LLM Applications on Cloud Run: A Complete Guide
Last year, I deployed our first LLM application to Cloud Run. What should have taken hours took three days. Cold starts killed our latency. Memory limits caused crashes. Timeouts broke long-running requests. After deploying 20+ LLM applications to Cloud Run, I’ve learned what works and what doesn’t. Here’s the complete guide. Figure 1: Cloud Run […]
Read more →Tips and Tricks – Implement Circuit Breaker for Resilient Services
Prevent cascade failures by implementing circuit breaker pattern for external service calls.
Read more →Platform Engineering: Building Internal Developer Platforms That Actually Work
After spending two decades building and scaling engineering organizations, I’ve come to a conclusion that might seem counterintuitive: the biggest productivity killer in most enterprises isn’t technical debt, legacy systems, or even organizational politics. It’s cognitive load. Developers spend an unconscionable amount of time navigating infrastructure complexity instead of solving business problems. Platform engineering, done […]
Read more →