aayush kumar
@aayushkumar2
AI Systems Engineer building LLM infrastructure, multi-agent orchestration, and evaluation pipelines for reliable AI.
IndiaWhat I'm looking for
I’m an AI Systems Engineer focused on LLM infrastructure, multi-agent systems, and evaluation pipelines. I contribute to production-quality reliability—fixing issues that improve agent workflow stability and tool execution.
I built TraceMind, a high-performance LLM eval and observability platform with hallucination detection, A/B testing, and cost-optimized inference. I implemented a parallel LLM-as-judge eval engine (processing 100 cases in 17s), multi-key Groq rotation with auto-failover, response control hooks, and a GitHub Actions eval gate—backed by 76/76 unit tests and 44/44 e2e checks.
In open source, I contributed merged PRs to Mastra AI (YC-backed, 23k★), including fixes for structured output reliability and memory persistence across chained recall + observation steps. Previously, I delivered REST APIs and real-time notifications using Node.js/Express and built OCR data pipelines in Python with OpenCV automation.
Experience
Work history, roles, and key accomplishments
Data Pipeline Intern
IIT Jodhpur
Apr 2024 - Jun 2024 (2 months)
Developed Python preprocessing pipelines for multilingual OCR datasets, using OpenCV automation to cut manual labeling effort by 50%. Processed and validated 5,000+ training images for downstream model training.
Software Developer Intern
DRDO
May 2023 - Jul 2023 (2 months)
Built Node.js + Express REST APIs for vendor/bidding workflows (50+ active projects) with JWT auth and RBAC, plus WebSocket notifications. Optimized MongoDB queries to reduce response times to sub-second.
Education
Degrees, certifications, and relevant coursework
Jaypee Institute of Engineering and Technology (JIET)
Bachelor of Technology, Computer Science Engineering
2021 - 2025
Activities and societies: 600+ LeetCode problems; Top 10 / 100+ teams at Rackon 2.0 National Hackathon.
Completed a B.Tech in Computer Science Engineering at JIET, Jodhpur from 2021 to 2025.
Availability
Location
IndiaAuthorized to work in
Social media
Job categories
Skills
Interested in hiring aayush?
You can contact aayush and 90k+ other talented remote workers on Himalayas.
Message aayushFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
