Searching in

Start typing to search

Find posts, pages, and products across your site.

No results found

Try different keywords or check your spelling.

Navigate · Select · Close
Skip to content

C4: Container, Code, Cloud & Context

  • Cloud
    • AWS
    • Azure
    • Google Cloud
    • Kubernetes
    • Serverless
    • Terraform & IaC
    • DevOps
    • Cloud Engineering
    • Containers
    • Observability
  • AI
    • Generative AI
    • AI Agents
    • RAG
    • Machine Learning
    • AI/ML
    • Agentic AI
    • LLMs
    • MCP
    • Prompt Engineering
  • .NET
    • C#
    • ASP.NET
    • .NET Core
    • SQL Server
    • Visual Studio
    • .NET 11
    • .NET 10
    • ASP.NET MVC
    • Web API
  • Python
    • AI & Agents
    • Machine Learning & MLOps
    • Data Engineering
    • AWS & Serverless
  • Frontend
    • JavaScript
    • TypeScript
    • React
    • Blazor
    • HTML5
    • CSS
  • Data
    • Pipelines & Orchestration
    • Streaming & Events
    • Databases & Storage
    • Vector Search
    • Lakehouse & Analytics
    • Quality & Governance
    • Python for Data
    • Cosmos DB
  • Architecture
    • System Design
    • Design Patterns
    • Performance
    • Security
    • Testing
    • Cloud Architecture
  • Healthcare
    • FHIR
    • openEHR
    • HL7 v2
    • SMART on FHIR
  • Archive
    • Microsoft
    • IoT
    • Mobile
    • Windows Phone
    • Tutorials
    • Community
    • Windows
    • Silverlight
    • SharePoint
    • Events
    • Certification
    • Downloads
  • About
    • Contributions
    • Hire
    • Contact
    • Subscribe
    • Disclaimer
    • Privacy Policy
/
Colour scheme
C4: Container, Code, Cloud & Context
  • Cloud
    • AWS
    • Azure
    • Google Cloud
    • Kubernetes
    • Serverless
    • Terraform & IaC
    • DevOps
    • Cloud Engineering
    • Containers
    • Observability
  • AI
    • Generative AI
    • AI Agents
    • RAG
    • Machine Learning
    • AI/ML
    • Agentic AI
    • LLMs
    • MCP
    • Prompt Engineering
  • .NET
    • C#
    • ASP.NET
    • .NET Core
    • SQL Server
    • Visual Studio
    • .NET 11
    • .NET 10
    • ASP.NET MVC
    • Web API
  • Python
    • AI & Agents
    • Machine Learning & MLOps
    • Data Engineering
    • AWS & Serverless
  • Frontend
    • JavaScript
    • TypeScript
    • React
    • Blazor
    • HTML5
    • CSS
  • Data
    • Pipelines & Orchestration
    • Streaming & Events
    • Databases & Storage
    • Vector Search
    • Lakehouse & Analytics
    • Quality & Governance
    • Python for Data
    • Cosmos DB
  • Architecture
    • System Design
    • Design Patterns
    • Performance
    • Security
    • Testing
    • Cloud Architecture
  • Healthcare
    • FHIR
    • openEHR
    • HL7 v2
    • SMART on FHIR
  • Archive
    • Microsoft
    • IoT
    • Mobile
    • Windows Phone
    • Tutorials
    • Community
    • Windows
    • Silverlight
    • SharePoint
    • Events
    • Certification
    • Downloads
  • About
    • Contributions
    • Hire
    • Contact
    • Subscribe
    • Disclaimer
    • Privacy Policy

Nithin Mohan TK

~ Designing intelligent systems, one layer at a time. ~

Hello Namaste! 👋🏻 I'm an accomplished Enterprise Solution Architect & Engineering Leader with 20+ years of progressive experience architecting, building, and scaling transformative enterprise solutions. ⚜️ Solution Architect…

Topics

  • .NET
  • Microsoft
  • Visual Studio
  • Azure
  • .netframework
  • Windows
  • Architecture
  • vs2010
  • AWS
  • LLM
  • Python
  • Windows Phone
  • Generative AI
  • Community
  • Cloud Computing
  • JavaScript
  • AI/ML
  • Windows 7
  • Mobile-Development
  • C#
  • AI Agents
  • DevOps
  • Data Engineering
  • Serverless

Categories

  • All 524
  • .NET 452
  • General 392
  • Microsoft 365
  • Emerging Technologies 260
  • VisualStudio 238
  • Azure 205
  • .NET Framework 158

Posting activity

JFMAMJJASOND
20269 posts in January 20269 posts in February 202612 posts in March 202611 posts in April 20267 posts in May 20266 posts in June 20264 posts in July 20265 posts in August 20266 posts in September 20267 posts in October 202615 posts in November 2026
202511 posts in January 202515 posts in February 202512 posts in March 202512 posts in April 202510 posts in May 20258 posts in June 20257 posts in July 202519 posts in August 202510 posts in September 202514 posts in October 202516 posts in November 202512 posts in December 2025
20244 posts in January 20243 posts in February 20245 posts in March 20243 posts in April 20245 posts in May 20244 posts in June 202411 posts in July 202415 posts in August 202416 posts in September 202415 posts in October 202419 posts in November 202412 posts in December 2024
20228 posts in January 20227 posts in February 20228 posts in March 20228 posts in April 20229 posts in May 20228 posts in June 20224 posts in July 20225 posts in August 20224 posts in September 20224 posts in October 20224 posts in November 20227 posts in December 2022
20217 posts in January 20217 posts in February 20217 posts in March 20218 posts in April 20217 posts in May 20216 posts in June 20217 posts in July 20219 posts in August 20215 posts in September 20217 posts in October 20216 posts in November 20219 posts in December 2021
202010 posts in January 20207 posts in February 20207 posts in March 20207 posts in April 20207 posts in May 20207 posts in June 20207 posts in July 20207 posts in August 20207 posts in September 20207 posts in October 20207 posts in November 20207 posts in December 2020
20196 posts in January 20198 posts in February 20197 posts in March 20197 posts in April 20197 posts in May 20198 posts in June 20197 posts in July 20197 posts in August 20196 posts in September 20197 posts in October 201910 posts in November 20196 posts in December 2019
20183 posts in March 20185 posts in April 20185 posts in May 20185 posts in June 20181 post in July 20182 posts in August 20183 posts in September 20187 posts in October 20182 posts in November 20186 posts in December 2018
20175 posts in January 20171 post in February 20172 posts in March 20173 posts in April 20179 posts in May 20176 posts in June 20171 post in October 2017
20162 posts in March 20162 posts in June 20161 post in July 20162 posts in August 20162 posts in September 20162 posts in October 20162 posts in November 20162 posts in December 2016
20153 posts in January 20151 post in February 20151 post in March 20153 posts in April 201511 posts in May 20151 post in June 20151 post in July 2015
20142 posts in December 2014
20134 posts in March 20131 post in April 201312 posts in June 20132 posts in July 20131 post in August 20133 posts in September 2013
20128 posts in January 20126 posts in February 20123 posts in March 20124 posts in April 20125 posts in May 20121 post in July 20124 posts in August 20123 posts in September 201270 posts in October 20125 posts in December 2012
20113 posts in January 20116 posts in February 2011117 posts in March 20113 posts in April 201130 posts in May 20116 posts in June 20118 posts in July 20115 posts in September 20114 posts in November 20111 post in December 2011
201028 posts in January 201011 posts in February 20105 posts in March 20106 posts in April 201017 posts in May 201091 posts in June 201023 posts in July 20108 posts in August 20108 posts in September 20109 posts in October 20102 posts in November 20102 posts in December 2010
20092 posts in July 20094 posts in August 200943 posts in December 2009
20081 post in October 2008
LessMore
Category

Technology Engineering

147

Technology Engineering

LLM Evaluation: Metrics, Benchmarks, and A/B Testing

Introduction: Evaluating LLM outputs is challenging because there’s often no single “correct” answer. Traditional metrics like BLEU and ROUGE fall short for open-ended generation. This guide covers modern evaluation approaches: automated metrics…

  • LLM
  • Observability
Artificial Intelligence(AI)October 15, 20243 min read

LLM Observability: Cost Tracking and Quality Monitoring (Part 2 of 2)

Introduction: You can’t improve what you can’t measure. LLM applications are notoriously difficult to debug—prompts are opaque, responses are non-deterministic, and failures often manifest as subtle quality degradation rather than crashes. Observability…

  • LLM
  • Observability
  • Production AI
Artificial Intelligence(AI)October 13, 20244 min read

Hybrid Search Implementation: Combining Vector and Keyword Retrieval

Introduction: Hybrid search combines the best of both worlds: the semantic understanding of vector search with the precision of keyword matching. Pure vector search excels at finding conceptually similar content but can…

  • Data Engineering
  • Vector Database
Artificial Intelligence(AI)October 10, 20244 min read

GitHub Copilot Chat Transforms Developer Productivity: AI-Assisted Development Patterns for Enterprise Teams

Introduction: GitHub Copilot Chat, released in late 2023, represents a paradigm shift in AI-assisted development by bringing conversational AI directly into the IDE. Unlike the original Copilot’s inline suggestions, Copilot Chat enables…

  • .NET
.NETOctober 9, 20245 min read

LLM Fallback Strategies: Multi-Provider Failover Architecture (Part 1 of 2)

Introduction: Production LLM applications must handle failures gracefully—API outages, rate limits, timeouts, and degraded responses are inevitable. Fallback strategies ensure your application continues serving users when the primary model fails. This guide…

  • LLM
Artificial Intelligence(AI)October 5, 20245 min read

Harnessing AWS CDK for Python: Streamlining Infrastructure as Code

After two decades of managing cloud infrastructure across enterprises of all sizes, I’ve witnessed the evolution of Infrastructure as Code from simple shell scripts to sophisticated declarative frameworks. AWS Cloud Development Kit…

  • Automation
  • AWS
  • CDK
  • CloudFormation
  • +6
AmazonSeptember 29, 20244 min read

Streaming LLM Responses: SSE, WebSockets, and Real-Time Token Delivery (Part 1 of 2)

Introduction: Streaming responses dramatically improve perceived latency in LLM applications. Instead of waiting seconds for a complete response, users see tokens appear in real-time, creating a more engaging experience. Implementing streaming correctly…

  • LLM
Artificial Intelligence(AI)September 28, 20245 min read

AWS Bedrock: Building Enterprise AI Applications with Multi-Model Foundation Models

Introduction: Amazon Bedrock is AWS’s fully managed service for building generative AI applications with foundation models. Launched at AWS re:Invent 2023, Bedrock provides a unified API to access models from Anthropic, Meta,…

  • AWS Bedrock
  • Production AI
Artificial Intelligence(AI)September 27, 20244 min read

Conversation History Management: Building Memory for Multi-Turn AI Applications

Introduction: Chatbots and conversational AI need memory. Without conversation history, every message exists in isolation—the model can’t reference what was said before, follow up on previous topics, or maintain coherent multi-turn dialogues.…

  • AI/ML
  • Generative AI
AI/MLSeptember 25, 20244 min read

Embedding Search and Similarity: Building Semantic Search Systems

Introduction: Semantic search using embeddings has transformed how we find information. Unlike keyword search, embeddings capture meaning—finding documents about “machine learning” when you search for “AI training.” This guide covers building production…

  • Semantic Search
  • Vector Database
Artificial Intelligence(AI)September 22, 20243 min read

GPT-4 Turbo and the OpenAI Assistants API: Building Production Conversational AI Systems

Introduction: OpenAI’s DevDay 2023 marked a pivotal moment in AI development with the announcement of GPT-4 Turbo and the Assistants API. These releases fundamentally changed how developers build AI-powered applications, offering 128K…

  • OpenAI
  • Production AI
Artificial Intelligence(AI)September 19, 20245 min read

Batch Processing for LLMs: Maximizing Throughput with Async Execution and Rate Limiting

Introduction: Processing thousands of LLM requests efficiently requires batch processing strategies that maximize throughput while respecting rate limits and managing costs. Individual API calls are inefficient for bulk operations—batch processing enables parallel…

  • LLM
Artificial Intelligence(AI)September 19, 20244 min read

Mastering Prompt Engineering: Advanced Techniques for Production LLM Applications

Introduction: Prompt engineering has emerged as one of the most critical skills in the AI era. The difference between a mediocre AI response and an exceptional one often comes down to how…

  • LLM
  • Production AI
  • Prompt Engineering
Artificial Intelligence(AI)September 15, 20244 min read

Document Processing Pipelines: From Raw Files to Vector-Ready Chunks

Introduction: Document processing is the foundation of any RAG (Retrieval-Augmented Generation) system. Before you can search and retrieve relevant information, you need to extract text from various file formats, split it into…

  • Vector Database
Artificial Intelligence(AI)September 15, 20244 min read

LLM Caching Strategies: From Exact Match to Semantic Similarity

Introduction: LLM API calls are expensive and slow. Caching is your first line of defense against runaway costs and latency. But caching LLM responses isn’t straightforward—the same question phrased differently should return…

  • LLM
  • Semantic Search
Artificial Intelligence(AI)September 12, 20243 min read

LLM Memory and Context Management: Building Conversational AI That Remembers

Introduction: LLMs have no inherent memory—each API call is stateless. The model doesn’t remember your previous conversation, your user’s preferences, or the context you established five messages ago. Memory is something you…

  • LLM
Artificial Intelligence(AI)September 11, 20243 min read

.NET 8 and C# 12: A Deep Dive into Native AOT, Primary Constructors, and Blazor United

Introduction: .NET 8 represents a landmark release in Microsoft’s development platform evolution, bringing Native AOT to mainstream scenarios, unifying Blazor’s rendering models, and introducing C# 12’s powerful new features. Released in November…

  • .NET
.NETSeptember 9, 20245 min read

LLM Application Logging and Tracing: Building Observable AI Systems

Introduction: Production LLM applications require comprehensive logging and tracing to debug issues, monitor performance, and understand user interactions. Unlike traditional applications, LLM systems have unique logging needs: capturing prompts and responses, tracking…

  • LLM
  • Observability
Artificial Intelligence(AI)September 3, 20243 min read

AWS re:Invent 2023: Amazon Bedrock and Q Transform Enterprise AI with Foundation Models and Intelligent Assistants

Introduction: AWS re:Invent 2023 delivered transformative announcements for enterprise AI adoption, with Amazon Bedrock reaching general availability and Amazon Q emerging as AWS’s answer to AI-powered enterprise assistance. These services represent AWS’s…

  • AWS
  • AWS Bedrock
  • Production AI
Artificial Intelligence(AI)August 30, 20244 min read

Guardrails and Safety for LLMs: Building Secure AI Applications with Input Validation and Output Filtering

Introduction: Production LLM applications need guardrails to ensure safe, appropriate outputs. Without proper safeguards, models can generate harmful content, leak sensitive information, or produce responses that violate business policies. Guardrails provide defense-in-depth:…

  • LLM
Artificial Intelligence(AI)August 26, 20243 min read

Rate Limiting for LLM APIs: Token Buckets, Queues, and Adaptive Throttling

Introduction: LLM APIs have strict rate limits—requests per minute, tokens per minute, and concurrent request limits. Exceeding these limits results in 429 errors that can cascade through your application. Effective rate limiting…

  • LLM
Artificial Intelligence(AI)August 22, 20243 min read

Achieving DevOps Harmony: Building and Deploying .NET Applications with AWS Services

The Evolution of .NET Deployment on AWS After two decades of building enterprise applications, I’ve witnessed the transformation of deployment practices from manual FTP uploads to sophisticated CI/CD pipelines. When AWS introduced…

  • AWS
  • cicd
  • Cloud Computing
  • CodeBuild
  • +7
AmazonAugust 20, 20244 min read

Vector Search Algorithms: Exact Search, IVF, Product Quantization and HNSW

Every vector database and every retrieval-augmented generation (RAG) system rests on one operation: given a query vector, find the stored vectors closest to it. With a few thousand vectors that is a…

  • Vector Database
Artificial Intelligence(AI)August 20, 20248 min read

LLM Batch Processing: Scaling AI Workloads from Hundreds to Millions

Introduction: Processing thousands or millions of items through LLMs requires different patterns than single-request applications. Naive sequential processing is too slow, while uncontrolled parallelism hits rate limits and wastes money on retries.…

  • LLM
  • Production AI
Artificial Intelligence(AI)August 18, 20243 min read

Posts pagination

Newer 1 … 4 5 6 7 Older

About this blog

A developer blog exploring the intersection of code, cloud technologies, and the context that makes them meaningful. Sharing insights, tutorials, and perspectives on modern software development, cloud architecture, and the ever-evolving tech landscape.

Disclaimer

All opinions expressed on this blog are my own and do not represent the views, positions, strategies, or opinions of my employer or any other organization I am affiliated with. The content shared here is for informational and educational purposes only.

© 2026 C4: Container, Code, Cloud & Context
  • Built by Nithin Mohan TK
  • Privacy
  • RSS