LLM Rate Limiting: Maximizing API Throughput Without Getting Throttled

Introduction: LLM APIs have strict rate limits—requests per minute, tokens per minute, and concurrent request limits. Hit these limits and your application grinds to a halt with 429 errors. Effective rate limiting isn’t just about staying under limits; it’s about maximizing throughput while maintaining reliability. This guide covers practical rate limiting patterns: token bucket algorithms […]

Read more →

Azure Cosmos DB – Change feed support(PREVIEW)–available

Today Microsoft announced the preview of Change feed Support for Azure Cosmos DB, which allows you to build scalable solutions. By default change feed will be enabled in all the accounts. Change feed provides an output of sorted list of documents that has been changed in the order in which they are modified by client […]

Read more →

Embedding Fine-Tuning: Training Custom Embeddings for Domain-Specific Retrieval

Introduction: Off-the-shelf embedding models work well for general text, but domain-specific applications often need better performance. Fine-tuning embeddings on your data can dramatically improve retrieval quality—turning a 70% recall into 90%+ for your specific use case. The key is creating high-quality training data that teaches the model what “similar” means in your domain. This guide […]

Read more →

Introduction to NDepend : Static Code Analysis Tool

As a developer, you always have to take the pain of getting adapted to the best practices and coding guidelines to be followed as per the organizational or industrial standards.  Easy way to ensure your coding style follows certain standard is to manually analyze your code or use a static code analyzer like FxCop, StyleCop […]

Read more →

PowerShell: Check a parameter/variable value is null

While you are writing PowerShell modules, with lot with parameters and you might want to verify these parameters are not ‘null’ to validate some business cases. In normal powershell inline scripting context, $variablename -eq “$null” would work : if ($varibalename -eq $null) { Write-Host "variable is null.Please supply the values for variablename." } RECOMMENDED APPROACH: […]

Read more →

Node.js 9.x.x and npm 6.x.x – “npm audit” to identify and fix security vulnerabilities in dependencies

It has been a while I have been reading about the major changes that areintroduced in Node.js 9.x.x / NPM 6.x.x and myself faced by Node.js application going to a toss after I upgraded to Node.js 9.x.x, as I always keep Node.js up to date in my development environment. I use NVM(Node Virtual Manager) to […]

Read more →