Scalable ML Model Service Load Balancing Solution
Developed and implemented an algorithm for automatic load balancing of Python AI/ML model processes.
- Python
- Java
- multiprocessing
- MS SQL Server
Hi, I'm Aishwarya.
I'm a Solutions Engineer with 7+ years of experience creating solutions that make a difference. I specialize in software engineering, cross-team collaboration, DevOps, backend development, product strategy and stakeholder management.
Apps
Projects
Developed a multithreaded regex matching engine in C++ and exposed it as an API via JNI in a DLL to be loaded in a Java process.
- C++
- JNI
- Java
- ActiveMQ
Designed a multithreaded Java module for online reindexing of indexed data and Lucene segment version upgrades.
- ThreadPoolExecutor
- Core Java
- RESTful Web Services
- Jetty
Implemented a multi-agent AI system for regulatory compliance summaries integrating FATCA amendments to generate insights.
- Python
- ChromaDB
- GPT-4
- LangGraph
Posts
View all →Why a direct client-side fetch of my blog's RSS feed couldn't work, and how a small Cloudflare Pages Function fixed it.
Introduction - Why Memory Management Matters in C++ Unlike languages with automatic garbage collection like Java or Python, C++ gives you direct control over memory. This power all…
Introduction Last Tuesday, I spent four hours debugging what I was convinced was a race condition. My multi-threaded file processing application was crashing intermittently, and th…
Introduction Upgrading a distributed search infrastructure serving production traffic is notoriously challenging. The complexity increases exponentially when dealing with version c…