Sambit Barik
@sambitbarik
Senior SDET and GenAI Test Engineer delivering scalable LLM evaluation and automation to ensure production-ready AI systems.
What I'm looking for
I’m a results-driven Senior SDET / GenAI Test Engineer with 6+ years of experience delivering quality at scale for AI-driven products. I focus on LLM evaluation, RAG pipeline testing, and end-to-end automation for conversational AI, Text-to-SQL, and OCR systems.
I build robust test frameworks that reduce manual effort by up to 80%, including Playwright, Pytest, and Selenium. At Fractal Analytics, I architected an LLM-as-Judge automation framework using Postman + Claude API to evaluate response quality, cutting manual review cycles by ~60%.
I also ship repeatable validation into CI/CD pipelines so teams can make faster, safer releases. I integrated LLM evaluation metrics (Langfuse, Ragas, DeepEval) for real-time visibility into model drift and regression, and automated ETL workflow validation on Databricks with Pytest to protect zero data-loss SLAs.
My approach bridges model validation with business outcomes using domain-specific vocabularies, few-shot learning, and semantic scoring. I’m passionate about responsible AI—ensuring accuracy, fairness, and production-readiness for enterprise-scale deployments.
Experience
Work history, roles, and key accomplishments
GenAI Test Engineer
Fractal Analytics
Nov 2024 - Present (1 year 7 months)
Architected an LLM-as-Judge automation framework to evaluate conversational AI response quality and reduce manual review cycles. Built Playwright UI automation for cross-browser regression and developed automated testing/validation for Text-to-SQL and OCR pipelines, integrating LLM evaluation metrics into CI.
Software Engineer - QA
Cavisson Systems
Oct 2019 - Nov 2024 (5 years 1 month)
Delivered backend and UI test automation for the NetStorm product and integrated automated pipelines with Jenkins. Conducted performance, accessibility, and SEO audits, maintained requirement traceability, and managed end-to-end defect lifecycle in Bugzilla within Agile/Scrum and Waterfall processes.
Education
Degrees, certifications, and relevant coursework
Gandhi Engineering College
Bachelor of Technology, Computer Science
2016 - 2020
Bachelor of Technology in Computer Science from Gandhi Engineering College in Bhubaneswar, completed in 2020.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Sambit?
You can contact Sambit and 90k+ other talented remote workers on Himalayas.
Message SambitGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
