Prerna Gupta
@prernagupta
Data engineer specializing in production ETL pipelines, reliability, and data quality.
IndiaWhat I'm looking for
I am a Data Engineer with 2.5+ years of hands-on experience building and operating production ETL/ELT pipelines on AWS using Python, PySpark, and Apache Airflow. I focus on improving pipeline reliability, automating data-quality checks, and delivering SLA-compliant workflows across large-scale orchestration environments.
At IBM I operated 30+ production ETL pipelines handling 50+ GB daily, maintained 99%+ SLA compliance, reduced MTTR by ~40%, and cut recurring pipeline failures by 30% through systematic root-cause analysis and targeted fixes. I implemented SQL validation checks, schema-drift automation, and Delta Lake upserts to enable idempotent runs and reduce manual effort.
I bring a practical mix of cloud, orchestration, and data-quality tooling expertise—AWS (S3, Athena, Glue, Redshift), Airflow DAG design, dbt testing, Great Expectations concepts, and robust scripting in Python, SQL, and Bash—to reliably deliver timely, cost-efficient data for downstream consumers.
Experience
Work history, roles, and key accomplishments
Operated 30+ production ETL pipelines processing 50+ GB daily with 99%+ SLA compliance; reduced MTTR ~40% and recurring failures 30% through root-cause analysis and automation of data-quality checks.
Designed and built 30+ production ETL pipelines processing 10M+ records/day, improved execution efficiency and reduced operational overhead by 40%, and increased pipeline reliability to 99%+ through orchestration and validation frameworks.
Education
Degrees, certifications, and relevant coursework
Birla Institute of Technology, Mesra
Bachelor of Technology, Electronics & Communication Engineering
2019 - 2023
Grade: 8.54 / 10
Completed a B.Tech in Electronics & Communication Engineering with a minor in Computer Science and a CGPA of 8.54/10 between June 2019 and May 2023.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Social media
Job categories
Interested in hiring Prerna?
You can contact Prerna and 90k+ other talented remote workers on Himalayas.
Message PrernaFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
