ABHAY KUMAR
@abhaykumar8
AI/ML engineer building LLM-powered, RAG-grounded systems and data-driven scaling automation.
What I'm looking for
I’m an AI / Machine Learning Engineer who blends ML, LLM workflows, and backend engineering to ship production systems that make teams faster and operations calmer. At Amazon, I built an internal LLM-powered assistant grounded on service documentation to handle onboarding and operational Q&A for new joiners.
I also developed “Sable Orbit,” a Model Context Protocol (MCP) server that evaluates cluster scheduler statistics, BDB sizes, and throttling metrics to determine peak-readiness for events like Prime Day and Black Friday. This enables automated, data-driven scaling decisions across compaction, rebalancing, and repartitioning.
My work goes beyond models: I integrated LLM-powered engineering workflows for code generation, debugging, and operational diagnostics—improving engineering productivity by approximately 30%. I designed and deployed backend automation services in Python and Java to orchestrate large-scale infrastructure workflows, reducing manual operational effort by 70%.
Across multi-region production services (US, EU, Asia-Pacific), I resolved 50+ critical issues using LLM-assisted diagnostics, root cause analysis, and observability improvements, including high-severity Prime Day peak rotations for clusters sustaining 140–150M TPS. Earlier, at SAP Labs, I delivered AI-backed invoice extraction, REST microservices, event-driven processing with Kafka, and reliable persistence using PostgreSQL—validated through CI/CD with testing and regression.
Experience
Work history, roles, and key accomplishments
Built an internal RAG-style LLM assistant (SableV1LLM) for onboarding Q&A and operational support, reducing repetitive support load. Developed an MCP server and backend automation services to improve data-driven scaling and operational workflows, and resolved 50+ critical multi-region production issues.
Developer Intern, Data Scientist
Sap Labs
Aug 2024 - Jul 2025 (11 months)
Integrated AI-backed invoice extraction into SAP Concur to automatically parse invoices and reduce manual data entry. Designed Java/Spring Boot REST microservices, implemented Kafka-based event-driven services, and containerized deployments with Docker and Kubernetes via Jenkins CI/CD.
Education
Degrees, certifications, and relevant coursework
National Institute of Technology Kurukshetra
Master of Technology, Cyber Security
2023 - 2025
Grade: CGPA: 8.71
Activities and societies: Qualified GATE 2023; Research Associate and Teaching Assistant (mentoring 40+ students).
Pursued an M.Tech in Cyber Security, covering coursework such as Distributed Systems, Database Systems, Operating Systems, and Networking. Served as a Research Associate and Teaching Assistant, mentoring 40+ students.
Gautam Buddha University
Bachelor of Technology, Information Technology
2019 - 2023
Grade: CGPA: 8.36
Completed a B.Tech in Information Technology from Gautam Buddha University between 2019 and 2023.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Salary expectations
Job categories
Skills
Interested in hiring ABHAY?
You can contact ABHAY and 90k+ other talented remote workers on Himalayas.
Message ABHAYGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
