Himanshu Singh
@himanshusingh9
Senior QA & Automation Engineer specializing in ETL/data pipeline validation and AI/LLM evaluation with Playwright (Python).
What I'm looking for
I’m a Senior QA & Automation Engineer with 6+ years specializing in ETL/data pipeline validation and UI test automation using Playwright (Python), along with AI/LLM model evaluation. I’ve delivered source-to-target reconciliation, SCD Type 2 validations, and data integrity audits—often catching transformation failures and pipeline bottlenecks before production deployment.
I build reliable automation using a Playwright Page Object Model framework and integrate testing into CI/CD via Jenkins and GitHub Actions. I also apply hands-on LLM evaluation with DeepEval, RAGAS, and LangSmith for hallucination and groundedness-focused testing, partnering with data engineers and stakeholders to document findings against acceptance criteria.
Experience
Work history, roles, and key accomplishments
Spearheaded end-to-end ETL pipeline validation for large-scale data migration projects, including source-to-target reconciliation across 50+ pipelines and 10M+ row datasets. Performed SCD Type 2 validations and data integrity audits, reducing data discrepancy rate by 30%.
QA Engineer - AI/LLM Testing
Scikiq Pvt Ltd / Data & Analytics Services
Mar 2024 - Sep 2024 (6 months)
Designed and implemented test automation frameworks for LLM/ML systems to evaluate hallucination, relevancy, and groundedness metrics using DeepEval and RAGAS with LangSmith. Built UI and workflow validation suites with Playwright (Python) using a Page Object Model and integrated CI/CD with Jenkins and GitHub Actions.
QA Engineer - Web & Mobile
Smart Works Co-working Space Pvt Ltd
Jan 2022 - Jan 2024 (2 years)
Developed and maintained Playwright (Python) UI validation and regression test scripts across 15+ web applications. Designed Appium test suites for Android and iOS and integrated automated checks into CI/CD pipelines to improve release speed and reduce post-deployment defects.
Test Engineer
Tekshaper Pvt Ltd
Jan 2021 - Nov 2021 (10 months)
Conducted SQL-based backend data validation and database testing to ensure data accuracy and integrity. Managed test planning and defect reporting throughout the QA lifecycle using Jira.
Test Engineer
Soft Solution Pvt Ltd
Jul 2019 - Dec 2020 (1 year 5 months)
Automated end-to-end regression and functional tests for eCommerce workflows using Selenium and Playwright, including during high-traffic sales events. Designed and executed performance tests for scalability and stability and performed VAPT-aligned security testing for compliance and risk mitigation.
Education
Degrees, certifications, and relevant coursework
Krishna Engineering College
Bachelor of Technology, Computer Science
Earned a B.Tech in Computer Science from Krishna Engineering College, completed in May 2019.
Availability
Location
Authorized to work in
Portfolio
github.com/DecagonHimanshuJob categories
Interested in hiring Himanshu?
You can contact Himanshu and 90k+ other talented remote workers on Himalayas.
Message HimanshuGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
