Introduction: Python 3.12, released in October 2023, delivers significant improvements to error messages, f-string capabilities, and type system features. This release introduces per-interpreter GIL as an experimental feature, paving the way for true parallelism in future versions. After adopting Python 3.12 in production data pipelines, I’ve found the improved error messages dramatically reduce debugging time […]
Read more →Author: Nithin Mohan TK
Hello Namaste! 👋🏻
I'm an accomplished Enterprise Solution Architect & Engineering Leader with 20+ years of progressive experience architecting, building, and scaling transformative enterprise solutions.
⚜️ Solution Architect / AI & Cloud 📌 Galway, Ireland
Introduction to Site Reliability Engineering (SRE) in Azure: Achieving Higher Reliability with AKS and Essential Tools
In the fast-paced world of technology, ensuring the reliability of services is paramount for businesses to thrive. Site Reliability Engineering (SRE) has emerged as a discipline that combines software engineering and systems administration to create scalable and highly reliable software systems. In the Azure cloud environment, Azure Kubernetes Service (AKS) plays a pivotal role in […]
Read more →AWS Bedrock: Building Enterprise AI Applications with Multi-Model Foundation Models
Introduction: Amazon Bedrock is AWS’s fully managed service for building generative AI applications with foundation models. Launched at AWS re:Invent 2023, Bedrock provides a unified API to access models from Anthropic, Meta, Mistral, Cohere, and Amazon’s own Titan family. What sets Bedrock apart is its deep integration with the AWS ecosystem, including built-in RAG with […]
Read more →Batch Processing for LLMs: Maximizing Throughput with Async Execution and Rate Limiting
Introduction: Processing thousands of LLM requests efficiently requires batch processing strategies that maximize throughput while respecting rate limits and managing costs. Individual API calls are inefficient for bulk operations—batch processing enables parallel execution, request queuing, and optimized resource utilization. This guide covers practical batch processing patterns: async concurrent execution, request queuing with backpressure, rate-limited batch […]
Read more →Mastering AWS, EKS, Python, Kubernetes, and Terraform for Monitoring and Observability for SRE: Unveiling the Secrets of Cloud Infrastructure Optimization
As the world of software development continues to evolve, the need for robust infrastructures and efficient monitoring systems cannot be overemphasized. Whether you are an engineer, a site reliability engineer (SRE), or an IT manager, the need to harness the power of tools like Amazon Web Services (AWS), Elastic Kubernetes Service (EKS), Kubernetes, Terraform, and […]
Read more →LLM Memory and Context Management: Building Conversational AI That Remembers
Introduction: LLMs have no inherent memory—each API call is stateless. The model doesn’t remember your previous conversation, your user’s preferences, or the context you established five messages ago. Memory is something you build on top. This guide covers implementing different memory strategies for LLM applications: buffer memory for recent context, summary memory for long conversations, […]
Read more →