Rakshit Sisodia
@rakshitsisodia
AI backend engineer focused on scalable LLM systems and production reliability.
What I'm looking for
I am an AI backend engineer specializing in building and operating scalable LLM inference APIs and distributed microservices across cloud platforms. I design systems for low-latency streaming responses, cost-constrained inference, and high-fanout asynchronous workloads.
My work has driven measurable improvements in reliability and performance — from reducing scoring inconsistency by 31% through rubric-first evaluation to improving quiz throughput 42% and cutting p95 search latency by 78%. I deliver end-to-end solutions including caching, sharding, orchestration, and CI/CD to support millions of daily users and high-concurrency workloads.
I contribute to open source projects addressing production-critical issues and build full-stack projects that combine embedding retrieval, long-running inference, and multi-cloud integrations. I seek roles where I can lead backend reliability, optimize ML inference pipelines, and scale systems for enterprise usage.
Experience
Work history, roles, and key accomplishments
AI Backend Engineer
HSV Digital
Dec 2025 - Present (1 month)
Designed, deployed, and operated production LLM inference APIs meeting strict latency and cost budgets, supporting streaming token responses and high-fanout async workloads while maintaining reliability at scale; migrated to rubric-first evaluation, reducing scoring inconsistency by 31% and enabling flexible enterprise frameworks.
Engineered Go/Python microservices powering a Vue.js frontend to improve quiz throughput 42% (2.1s → 1.2s) for 1M+ daily quizzes and implemented Elasticsearch over 10M+ records to cut p95 latency by 78% (<280ms).
Education
Degrees, certifications, and relevant coursework
National Institute of Technology Hamirpur
Bachelor of Technology, Engineering
Pursuing a Bachelor of Technology degree at the National Institute of Technology Hamirpur, expected graduation in May 2025.
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Rakshit?
You can contact Rakshit and 90k+ other talented remote workers on Himalayas.
Message RakshitFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
