Introduction: Google Kubernetes Engine represents the gold standard for managed Kubernetes, built on the same infrastructure that runs Google’s own containerized workloads at massive scale. This deep dive explores GKE’s enterprise capabilities—from Autopilot mode that eliminates node management to advanced features like workload identity, binary authorization, and multi-cluster service mesh. After deploying production Kubernetes clusters […]
Read more →Author: Nithin Mohan TK
Hello Namaste! 👋🏻
I'm an accomplished Enterprise Solution Architect & Engineering Leader with 20+ years of progressive experience architecting, building, and scaling transformative enterprise solutions.
⚜️ Solution Architect / AI & Cloud 📌 Galway, Ireland
Running LLMs on Kubernetes: Production Deployment Guide
Deploying LLMs on Kubernetes requires careful planning. After deploying 25+ LLM models on Kubernetes, I’ve learned what works. Here’s the complete guide to running LLMs on Kubernetes in production. Figure 1: Kubernetes LLM Architecture Why Kubernetes for LLMs Kubernetes offers significant advantages for LLM deployment: Scalability: Auto-scale based on demand Resource management: Efficient GPU and […]
Read more →Inside Ireland’s Healthcare IT: HSE’s Digital Transformation Journey
Executive Summary Ireland’s Health Service Executive (HSE) is undertaking one of Europe’s most ambitious healthcare IT transformation programs. From rolling out the Individual Health Identifier (IHI) to deploying a national Electronic Health Record system, the HSE’s eHealth Ireland strategy is modernizing how 5 million Irish citizens access healthcare services. 🏥 HEALTHCARE INTEROPERABILITY SERIES This article […]
Read more →Types of Machine Learning Explained: Supervised, Unsupervised, and Reinforcement Learning
Deep dive into the three fundamental paradigms of machine learning. Explore supervised learning for predictions, unsupervised learning for pattern discovery, and reinforcement learning for decision optimization with practical Python examples.
Read more →The Rise of GitOps: Automating Deployment and Improving Reliability
GitOps is a relatively new approach to software delivery that has been gaining popularity in recent years. It is a set of practices for managing and deploying infrastructure and applications using Git as the single source of truth. In this blog post, we will explore the concept of GitOps, its key benefits, and some examples […]
Read more →Batch Inference Optimization: Maximizing Throughput and Minimizing Costs
Introduction: Batch inference optimization is critical for cost-effective LLM deployment at scale. Processing requests individually wastes GPU resources—the model loads weights once but processes only a single sequence. Batching multiple requests together amortizes this overhead, dramatically improving throughput and reducing per-request costs. This guide covers the techniques that make batch inference efficient: dynamic batching strategies, […]
Read more →