Scalable ML Model Service Load Balancing Solution
Developed and implemented an algorithm for automatic load balancing of Python AI/ML model processes.
- Python
- Java
- multiprocessing
- MS SQL Server
I'm a Solutions Engineer with 6+ years of experience creating solutions that make a difference. I specialize in software engineering, DevOps, and backend development, and I'm currently learning product strategy and stakeholder management.
Developed and implemented an algorithm for automatic load balancing of Python AI/ML model processes.
Developed a multithreaded regex matching engine in C++ and exposed it as an API via JNI in a DLL to be loaded in a Java process.
Designed a multithreaded Java module for online reindexing of indexed data and Lucene segment version upgrades.
Implemented a multi-agent AI system for regulatory compliance summaries integrating FATCA amendments to generate insights.
Why a direct client-side fetch of my blog's RSS feed couldn't work, and how a small Cloudflare Pages Function fixed it.
Introduction - Why Memory Management Matters in C++ Unlike languages with automatic garbage collection like Java or Python, C++ gives you direct control over memory. This power all…
Introduction Last Tuesday, I spent four hours debugging what I was convinced was a race condition. My multi-threaded file processing application was crashing intermittently, and th…
Introduction Upgrading a distributed search infrastructure serving production traffic is notoriously challenging. The complexity increases exponentially when dealing with version c…