Streaming LLM responses dramatically improves user experience. After implementing streaming for 20+ LLM applications, I’ve learned what works. Here’s the complete guide to implementing Server-Sent Events for LLM streaming. Figure 1: Streaming Architecture Why Streaming Matters Streaming LLM responses provides significant benefits: Perceived performance: Users see results immediately, not after 10+ seconds Better UX: Progressive […]
Read more →Author: Nithin Mohan TK
Hello Namaste! 👋🏻
I'm an accomplished Enterprise Solution Architect & Engineering Leader with 20+ years of progressive experience architecting, building, and scaling transformative enterprise solutions.
⚜️ Solution Architect / AI & Cloud 📌 Galway, Ireland
The Serverless Revolution: Why AWS Lambda Changed How We Think About Infrastructure
When AWS Lambda launched in 2014, it fundamentally changed how we think about infrastructure. No servers to provision, no capacity to plan, no patches to apply—just code that runs when events occur, billed by the millisecond. AWS Lambda Event-Driven Architecture The Mental Model Shift Traditional infrastructure starts with capacity planning: How many servers? What instance […]
Read more →AI Governance Frameworks: Implementing Responsible AI
Three years ago, our AI system made a biased hiring decision that cost us a major client and damaged our reputation. We had no governance framework, no oversight, no accountability. After implementing comprehensive AI governance across 15+ projects, I’ve learned what works. Here’s the complete guide to implementing responsible AI governance frameworks. Figure 1: Comprehensive […]
Read more →Prompt Engineering Best Practices: From Basic Techniques to Advanced Reasoning Patterns
Introduction: Prompt engineering is the art and science of communicating effectively with large language models. Unlike traditional programming where you write explicit instructions, prompt engineering requires understanding how models interpret language, what context they need, and how to structure requests for optimal results. This guide covers the fundamental techniques that separate amateur prompts from production-quality […]
Read more →Introduction to Docker and Containers: A Beginner’s Guide
Containers are a popular technology for developing and deploying applications. They provide an isolated runtime environment that runs an application and its dependencies, making it easier to package, deploy, and manage the application. Docker is a platform for managing containers that has become very popular in recent years. In this article, we’ll provide an introduction […]
Read more →EU EEHRxF: The Future of European Health Record Exchange
What is EEHRxF? EEHRxF vs IPS vs eHDSI EEHRxF Architecture EEHRxF Clinical Dataset Ireland’s EEHRxF Readiness FHIR Implementation Example Standards and References Series Conclusion Related Articles in This Series Conclusion
Read more →