Skip to main content
ABHAY KUMARAK
Open to opportunities

ABHAY KUMAR

@abhaykumar8

AI/ML engineer building LLM-powered, RAG-grounded systems and data-driven scaling automation.

India
Message

What I'm looking for

I’m looking to build production-grade AI/ML and LLM systems—RAG, MCP-style orchestration, and reliable data pipelines—where I can automate operations, improve observability, and ship measurable impact at scale with strong engineering mentorship.

I’m an AI / Machine Learning Engineer who blends ML, LLM workflows, and backend engineering to ship production systems that make teams faster and operations calmer. At Amazon, I built an internal LLM-powered assistant grounded on service documentation to handle onboarding and operational Q&A for new joiners.

I also developed “Sable Orbit,” a Model Context Protocol (MCP) server that evaluates cluster scheduler statistics, BDB sizes, and throttling metrics to determine peak-readiness for events like Prime Day and Black Friday. This enables automated, data-driven scaling decisions across compaction, rebalancing, and repartitioning.

My work goes beyond models: I integrated LLM-powered engineering workflows for code generation, debugging, and operational diagnostics—improving engineering productivity by approximately 30%. I designed and deployed backend automation services in Python and Java to orchestrate large-scale infrastructure workflows, reducing manual operational effort by 70%.

Across multi-region production services (US, EU, Asia-Pacific), I resolved 50+ critical issues using LLM-assisted diagnostics, root cause analysis, and observability improvements, including high-severity Prime Day peak rotations for clusters sustaining 140–150M TPS. Earlier, at SAP Labs, I delivered AI-backed invoice extraction, REST microservices, event-driven processing with Kafka, and reliable persistence using PostgreSQL—validated through CI/CD with testing and regression.

Experience

Work history, roles, and key accomplishments

Amazon logoAM
Current

Software Engineer

Aug 2025 - Present (11 months)

Built an internal RAG-style LLM assistant (SableV1LLM) for onboarding Q&A and operational support, reducing repetitive support load. Developed an MCP server and backend automation services to improve data-driven scaling and operational workflows, and resolved 50+ critical multi-region production issues.

Education

Degrees, certifications, and relevant coursework

National Institute of Technology Kurukshetra logoNK

National Institute of Technology Kurukshetra

Master of Technology, Cyber Security

2023 - 2025

Grade: CGPA: 8.71

Activities and societies: Qualified GATE 2023; Research Associate and Teaching Assistant (mentoring 40+ students).

Pursued an M.Tech in Cyber Security, covering coursework such as Distributed Systems, Database Systems, Operating Systems, and Networking. Served as a Research Associate and Teaching Assistant, mentoring 40+ students.

Gautam Buddha University logoGU

Gautam Buddha University

Bachelor of Technology, Information Technology

2019 - 2023

Grade: CGPA: 8.36

Completed a B.Tech in Information Technology from Gautam Buddha University between 2019 and 2023.

Tech stack

Software and tools used professionally

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan