Introduction: LLM APIs have strict rate limits—requests per minute, tokens per minute, and concurrent request limits. Exceeding these limits results in 429 errors that can cascade through your application. Effective rate limiting on your side prevents hitting API limits, provides fair access across users, and enables graceful degradation under load. This guide covers practical rate […]
Read more →Author: Nithin Mohan TK
Hello Namaste! 👋🏻
I'm an accomplished Enterprise Solution Architect & Engineering Leader with 20+ years of progressive experience architecting, building, and scaling transformative enterprise solutions.
⚜️ Solution Architect / AI & Cloud 📌 Galway, Ireland
LLM Security: Understanding Prompt Injection, Jailbreaking, and Attack Vectors (Part 1 of 2)
A comprehensive guide to securing LLM applications against prompt injection, jailbreaking, and data exfiltration attacks. Includes production-ready defense implementations.
Read more →Achieving DevOps Harmony: Building and Deploying .NET Applications with AWS Services
The Evolution of .NET Deployment on AWS After two decades of building enterprise applications, I’ve witnessed the transformation of deployment practices from manual FTP uploads to sophisticated CI/CD pipelines. When AWS introduced their native DevOps toolchain, it fundamentally changed how we approach .NET application delivery. The integration between CodeCommit, CodeBuild, CodePipeline, and ECR creates a […]
Read more →LLM Batch Processing: Scaling AI Workloads from Hundreds to Millions
Introduction: Processing thousands or millions of items through LLMs requires different patterns than single-request applications. Naive sequential processing is too slow, while uncontrolled parallelism hits rate limits and wastes money on retries. This guide covers production batch processing patterns: chunking strategies, parallel execution with rate limiting, progress tracking, checkpoint/resume for long jobs, cost estimation, and […]
Read more →The Future of Work: How AI and Automation Are Reshaping Careers
After two decades of architecting enterprise systems and leading digital transformation initiatives across financial services, healthcare, and technology sectors, I’ve witnessed firsthand how AI and automation are fundamentally reshaping the nature of work. This isn’t merely about replacing tasks—it’s about reimagining entire value chains, creating new categories of roles, and demanding a fundamental shift in […]
Read more →Building Production AI Applications with .NET 8 and C# 12
When .NET 8 and C# 12 were released, I was skeptical. After 15 years building enterprise applications, I’d seen framework updates come and go. But this release changed everything for AI development. Let me show you how to build production AI applications with .NET 8 and C# 12—using actual C# code, not Python wrappers. Figure […]
Read more →