Introduction: LLM API calls are expensive and slow. A single GPT-4 request can cost cents and take seconds—multiply that by thousands of users asking similar questions, and costs spiral quickly. Semantic caching solves this by recognizing that “What’s the weather in NYC?” and “Tell me NYC weather” are essentially the same query. Instead of exact […]
Read more →Author: Nithin Mohan TK
Hello Namaste! 👋🏻
I'm an accomplished Enterprise Solution Architect & Engineering Leader with 20+ years of progressive experience architecting, building, and scaling transformative enterprise solutions.
⚜️ Solution Architect / AI & Cloud 📌 Galway, Ireland
AI Agent Architectures: From ReAct to Multi-Agent Systems – A Complete Guide
AI agents represent a paradigm shift from simple prompt-response interactions to autonomous systems capable of planning, reasoning, and taking actions. Understanding the architectural patterns that power these agents is essential for building production-grade AI applications. ℹ️ KEY INSIGHT The evolution from chatbots to agents mirrors the transition from procedural to agentic computing – where AI […]
Read more →Anthropic Claude SDK: Building AI Applications with Advanced Reasoning and 200K Context
Introduction: Anthropic’s Claude SDK provides developers with access to one of the most capable and safety-focused AI model families available. Claude models are known for their exceptional reasoning abilities, 200K token context windows, and strong performance on complex tasks. The SDK offers a clean, intuitive API for building applications with tool use, vision capabilities, and […]
Read more →Google Gemini API: Building Multimodal AI Applications with 2M Token Context
Introduction: Google’s Gemini API represents a significant leap in multimodal AI capabilities. Launched in December 2023, Gemini models are natively multimodal, trained from the ground up to understand and generate text, images, audio, and video. With context windows up to 2 million tokens and native Google Search grounding, Gemini offers unique capabilities for building sophisticated […]
Read more →Mastering AWS, EKS, Python, Kubernetes, and Terraform for Monitoring and Observability for SRE: Unveiling the Secrets of Cloud Infrastructure Optimization
As the world of software development continues to evolve, the need for robust infrastructures and efficient monitoring systems cannot be overemphasized. Whether you are an engineer, a site reliability engineer (SRE), or an IT manager, the need to harness the power of tools like Amazon Web Services (AWS), Elastic Kubernetes Service (EKS), Kubernetes, Terraform, and […]
Read more →Serverless AI Architecture: Building Scalable LLM Applications
Three years ago, I built my first serverless LLM application. It failed spectacularly. Cold starts made responses take 15 seconds. Timeouts killed long-running requests. Costs spiraled out of control. After architecting 30+ serverless AI systems, I’ve learned what works. Here’s the complete guide to building scalable serverless LLM applications. Figure 1: Serverless AI Architecture Overview […]
Read more →