Open to opportunities

ajay singh

@ajaysingh17

Message

Senior Data Engineer building scalable streaming and lakehouse data pipelines.

India

Message

What I'm looking for

I’m looking for a role where I can build production-grade AWS/Databricks streaming + batch pipelines with strong data quality, lineage, and observability—using Delta Lake, dbt, Kafka, and Airflow to deliver reliable, low-latency outcomes at scale.

I’m a Senior Data Engineer with 5+ years delivering large-scale data pipelines, Lakehouse architectures, and real-time streaming systems on AWS and Databricks for fintech clients including Vanguard and Qorvo. I specialize in Delta Lake and dbt, and I’ve built production-grade orchestration with automated data quality, observability, and Airflow-driven reliability.

Most recently, I architected an end-to-end Databricks Lakehouse Medallion streaming pipeline using Delta Live Tables (DLT) and Auto Loader, delivering end-to-end latency of 18–22 minutes against a 30-minute SLA. Earlier, I designed AWS Glue pipelines for DB2-to-DynamoDB/Redshift migrations at 500M+ records scale with SCD Type 2, deduplication for exactly-once delivery, and a validation/alerting framework for near-real-time data integrity.

Experience

Work history, roles, and key accomplishments

Data Analyst Intern

Myscoot

Sep 2020 - Mar 2021 (6 months)

Performed data analysis and transformation using SQL and Python, and built Tableau dashboards to generate actionable insights on user behavior for product strategy.

SQL Python Data Analysis data transformation Tableau Dashboarding User Behavior Analytics Product Strategy