
sourabh singh
@sourabhsingh22
I build AI agents, LLM evaluation pipelines, and Python systems for automation and prediction.
What I'm looking for
I've built AI evaluation environments at Handshake.ai, designing 20 complex CLI benchmarks that stress-test autonomous LLM agents through code generation, terminal debugging, and multi-step reasoning.
At Supernal Ventures, I architected Python and TensorFlow trading agents, asynchronous backtesting engines, and FastAPI microservices. My work reduced backtest execution latency by 45% and supported sub-50ms responses for critical trade signals.
I've also delivered LLM quality evaluation, speech-data annotation, n8n automation pipelines, and machine-learning prediction models across CrowdGen by Appen, Deccan AI Experts, Turing, and YBI Foundation.
Experience
Work history, roles, and key accomplishments
AI Evaluation and Autonomous Agent Trainer
Handshake.ai
Jul 2026 - Present (2 months)
Designed and implemented 20 complex CLI evaluation environments to stress-test autonomous LLM agents across code generation, environment exploration, and multi-step terminal debugging. Constructed rigorous multi-hop benchmark scenarios exposing model failures in state management, recursive reasoning, and automated error-recovery under constrained resources.
LLM Quality and Speech Data Specialist
CrowdGen by Appen
Jun 2026 - Jul 2026 (1 month)
Curated high-accuracy speech datasets for Automatic Speech Recognition (ASR), performing acoustic segmentation, dialect validation, and speaker-turn labeling for multi-modal model training. Executed rigorous S2/S3 LLM alignment evaluations, systematically flagging hallucination vectors, syntax errors, and safety guideline violations to optimize frontier model response quality.
Python Developer
Supernal Ventures Pvt. Ltd.
Oct 2025 - Mar 2026 (5 months)
Architected high-throughput AI trading execution agents leveraging Python and TensorFlow to automate real-time multifactor predictive modeling and quantitative strategy execution. Engineered asynchronous event-driven backtesting engines utilizing Redis caching and multithreaded queues, cutting backtest execution latency by 45%.
Freelance AI Developer
Deccan AI Experts
Feb 2025 - May 2025 (3 months)
Developed AI agents for workflow automation, data processing, and business operations. Built n8n-based AI automation pipelines integrating APIs, databases, and third-party services.
LLM S2/S3 Annotator
Turing
Nov 2024 - Dec 2024 (1 month)
Annotated and evaluated LLM outputs to improve model accuracy and alignment across diverse domains. Performed quality assessment, data labeling, and prompt-response validation.
Project Intern
Infosys Springboard
Jan 2023 - May 2023 (4 months)
Learned techniques for effective project management including budgeting, scheduling, and resource allocation. Adapted quickly to changing circumstances ensuring that all deliverables were met according to schedule.
Data Science Intern
YBI Foundation
Sep 2022 - Oct 2022 (1 month)
Developed machine-learning models for mobile phone price prediction using historical datasets. Applied Logistic Regression, Decision Trees, Random Forests, and SVM for predictive modeling.
Education
Degrees, certifications, and relevant coursework
Samrat Ashok Technological Institute
B.Tech, Artificial Intelligence and Data Science
2020 - 2024
Grade: 7.81 CGPA
Pursued a B.Tech in Artificial Intelligence and Data Science, achieving a CGPA of 7.81.
Coursera
Google Data Analytics Certification, Data Analytics
2023 - 2023
Completed the Google Data Analytics Certification.
Coursera
Machine Learning Essentials for Business and Technical Decision Makers, Machine Learning
2021 - 2021
Completed the Machine Learning Essentials for Business and Technical Decision Makers certification.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Salary expectations
Social media
Job categories
Skills
Interested in hiring sourabh?
You can contact sourabh and 90k+ other talented remote workers on Himalayas.
Message sourabhGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
