Skip to main content
sourabh singhSS
Looking for a job

sourabh singh

@sourabhsingh22

I build AI agents, LLM evaluation pipelines, and Python systems for automation and prediction.

India
Message

What I'm looking for

I'm looking to build and evaluate AI agents, LLM systems, and Python-based automation or machine-learning products, with opportunities to solve complex technical problems and improve model quality.

I've built AI evaluation environments at Handshake.ai, designing 20 complex CLI benchmarks that stress-test autonomous LLM agents through code generation, terminal debugging, and multi-step reasoning.

At Supernal Ventures, I architected Python and TensorFlow trading agents, asynchronous backtesting engines, and FastAPI microservices. My work reduced backtest execution latency by 45% and supported sub-50ms responses for critical trade signals.

I've also delivered LLM quality evaluation, speech-data annotation, n8n automation pipelines, and machine-learning prediction models across CrowdGen by Appen, Deccan AI Experts, Turing, and YBI Foundation.

Experience

Work history, roles, and key accomplishments

HA
Current

AI Evaluation and Autonomous Agent Trainer

Handshake.ai

Jul 2026 - Present (2 months)

Designed and implemented 20 complex CLI evaluation environments to stress-test autonomous LLM agents across code generation, environment exploration, and multi-step terminal debugging. Constructed rigorous multi-hop benchmark scenarios exposing model failures in state management, recursive reasoning, and automated error-recovery under constrained resources.

CA

LLM Quality and Speech Data Specialist

CrowdGen by Appen

Jun 2026 - Jul 2026 (1 month)

Curated high-accuracy speech datasets for Automatic Speech Recognition (ASR), performing acoustic segmentation, dialect validation, and speaker-turn labeling for multi-modal model training. Executed rigorous S2/S3 LLM alignment evaluations, systematically flagging hallucination vectors, syntax errors, and safety guideline violations to optimize frontier model response quality.

SL

Python Developer

Supernal Ventures Pvt. Ltd.

Oct 2025 - Mar 2026 (5 months)

Architected high-throughput AI trading execution agents leveraging Python and TensorFlow to automate real-time multifactor predictive modeling and quantitative strategy execution. Engineered asynchronous event-driven backtesting engines utilizing Redis caching and multithreaded queues, cutting backtest execution latency by 45%.

Education

Degrees, certifications, and relevant coursework

Samrat Ashok Technological Institute logoSI

Samrat Ashok Technological Institute

B.Tech, Artificial Intelligence and Data Science

2020 - 2024

Grade: 7.81 CGPA

Pursued a B.Tech in Artificial Intelligence and Data Science, achieving a CGPA of 7.81.

Coursera logoCO

Coursera

Google Data Analytics Certification, Data Analytics

2023 - 2023

Completed the Google Data Analytics Certification.

Coursera logoCO

Coursera

Machine Learning Essentials for Business and Technical Decision Makers, Machine Learning

2021 - 2021

Completed the Machine Learning Essentials for Business and Technical Decision Makers certification.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan