Designing RESTful APIs for LLMs requires careful consideration. After building 30+ LLM APIs, I’ve learned what works. Here’s the complete guide to RESTful AI API design. Figure 1: RESTful AI API Architecture Why LLM APIs Are Different LLM APIs have unique requirements: Async operations: LLM inference can take seconds or minutes Streaming responses: Need to […]
Read more →Author: Nithin Mohan TK
Hello Namaste! 👋🏻
I'm an accomplished Enterprise Solution Architect & Engineering Leader with 20+ years of progressive experience architecting, building, and scaling transformative enterprise solutions.
⚜️ Solution Architect / AI & Cloud 📌 Galway, Ireland
Azure Application Gateway: A Solutions Architect’s Guide to Regional Load Balancing and WAF
While Azure Front Door excels at global load balancing, many enterprise scenarios require regional application delivery with deep integration into virtual network architectures. Azure Application Gateway fills this niche perfectly, providing Layer 7 load balancing with integrated Web Application Firewall capabilities within a single Azure region. Having architected countless regional application delivery solutions over my […]
Read more →Getting Started with React and ViteJS: Enterprise-Grade Frontend Scaffolding Guide
Building modern React applications shouldn’t feel like wrestling with complex toolchains. Vite has fundamentally changed how we approach frontend development, offering lightning-fast builds and an exceptional developer experience that enterprise teams are increasingly adopting. Introduction This guide walks you through setting up a production-ready React application using Vite as your build tool. We’ll cover project […]
Read more →Global Traffic Distribution with Google Cloud Load Balancing and CDN: Enterprise Edge Architecture
Introduction: Google Cloud Load Balancing and Cloud CDN provide enterprise-grade traffic distribution and content delivery for global applications. This comprehensive guide explores load balancing architectures, from HTTP(S) load balancers and TCP/UDP proxies to internal load balancing and traffic management policies. After implementing global load balancing for applications serving billions of requests daily, I’ve found Google’s […]
Read more →Quantization Methods for LLMs: GPTQ, AWQ, and BitsAndBytes
Last year, I needed to run a 13B parameter model on a 16GB GPU. Full precision required 52GB. After testing GPTQ, AWQ, and BitsAndBytes, I reduced memory to 7GB with minimal accuracy loss. After quantizing 30+ models, I’ve learned which method works best for each scenario. Here’s the complete guide to LLM quantization. Figure 1: […]
Read more →Azure Front Door: A Solutions Architect’s Guide to Global Load Balancing and CDN
In an era where milliseconds of latency can translate to millions in lost revenue, global load balancing has evolved from a nice-to-have to a critical infrastructure component. Azure Front Door represents Microsoft’s answer to the challenge of delivering applications globally with enterprise-grade security and performance. Having designed global application delivery architectures for over two decades, […]
Read more →