Open to opportunities

David Wang

@davidwang8

Message

Senior Data Engineer specializing in scalable cloud data platforms and analytics-ready pipelines.

United States

Message

What I'm looking for

I seek roles building scalable, secure cloud data platforms that enable BI and ML; I value collaboration, automation, and strong data governance.

I am a Senior Data Engineer with 11+ years building large-scale data platforms and pipelines across e-commerce and healthcare, focused on transforming complex, high-volume data into reliable, analytics-ready insights.

At Amazon I led efforts to process 10+ TB/day into S3 and Redshift, reduced data latency by 35%, automated deployments with Terraform and CodePipeline, and implemented a Deequ-based data quality framework to improve production trust.

Previously, I designed HIPAA-compliant Azure data warehouses at Mercy and optimized Spark/EMR pipelines at Zulily, delivering ML-ready datasets, reducing processing times, and improving reporting efficiency.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Amazon

Dec 2020 - Present (5 years 6 months)

Led development of scalable AWS data pipelines processing 10+ TB/day into S3 and Redshift, reducing data latency by 35% and enabling real-time BI and ML insights with 99.99% availability.

AWS Glue Kinesis Redshift Terraform Deequ Python ETL Data Modeling CI CD

Data Engineer

Mercy

Sep 2016 - Nov 2020 (4 years 2 months)

Designed HIPAA-compliant Azure data pipelines and warehouses (Data Factory, Synapse) to integrate EHR, lab, and finance data, cutting manual report creation ~60% and improving data reliability.

Azure Data Factory Synapse Pyspark SQL HIPAA Data De Identification Data Lineage ETL

Data Engineer

Zulily

Dec 2014 - Aug 2016 (1 year 8 months)

Built and optimized Spark (EMR) batch and streaming ETL pipelines for e-commerce personalization and analytics, reducing daily processing time by 50% and improving data accuracy for BI and ML features.

Apache Spark EMR Kafka Batch Processing Data Engineering A B Testing Integration