ajay singh
@ajaysingh17
Senior Data Engineer building scalable streaming and lakehouse data pipelines.
IndiaWhat I'm looking for
I’m a Senior Data Engineer with 5+ years delivering large-scale data pipelines, Lakehouse architectures, and real-time streaming systems on AWS and Databricks for fintech clients including Vanguard and Qorvo. I specialize in Delta Lake and dbt, and I’ve built production-grade orchestration with automated data quality, observability, and Airflow-driven reliability.
Most recently, I architected an end-to-end Databricks Lakehouse Medallion streaming pipeline using Delta Live Tables (DLT) and Auto Loader, delivering end-to-end latency of 18–22 minutes against a 30-minute SLA. Earlier, I designed AWS Glue pipelines for DB2-to-DynamoDB/Redshift migrations at 500M+ records scale with SCD Type 2, deduplication for exactly-once delivery, and a validation/alerting framework for near-real-time data integrity.
Experience
Work history, roles, and key accomplishments
Architected an end-to-end Databricks Lakehouse Medallion streaming pipeline using Delta Live Tables and Auto Loader, hitting 18-22 min end-to-end latency against a 30-min SLA. Built AWS Glue pipelines for DB2-to-DynamoDB/Redshift migrations at 500M+ records scale with SCD Type 2, plus Airflow-orchestrated data quality and observability.
Designed AWS Glue pipelines for DB2-to-DynamoDB/Redshift migrations at 500M+ records scale with SCD Type 2 and deduplication for exactly-once delivery. Built a validation and alerting framework for near-real-time data integrity for American Express as part of the EXL-Amex engagement.
Data Engineer
OPK E Services
Mar 2021 - Apr 2022 (1 year 1 month)
Built ETL pipelines and SQL-based data workflows for business reporting and analytics. Worked with relational databases (MySQL, MS SQL Server) to design data models, automate ingestion, and support downstream data quality checks.
Data Analyst Intern
Myscoot
Sep 2020 - Mar 2021 (6 months)
Performed data analysis and transformation using SQL and Python, and built Tableau dashboards to generate actionable insights on user behavior for product strategy.
Education
Degrees, certifications, and relevant coursework
Dronacharya College of Engineering
Bachelor of Technology
2014 - 2018
Earned a Bachelor of Technology at Dronacharya College of Engineering in Gurugram from 2014 to 2018.
Availability
Location
IndiaAuthorized to work in
Portfolio
github.com/ajaysinghJob categories
Skills
Interested in hiring ajay?
You can contact ajay and 90k+ other talented remote workers on Himalayas.
Message ajayGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
