# Michael Chen

Michael Chen is a remote worker on Himalayas, Senior Data Engineer at DoorDash, based in United States.

Source: https://himalayas.app/@michaelchen6

```text
Senior Data Engineer building real-time, low-latency data platforms on Kafka, Spark, Flink, and Snowflake.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | United States |
| Authorized to work in | United States |
| Job categories | Senior Data Engineer, Data Engineer, Data Analyst, Data Engineering, Real Time Data Engineering, Senior Data Engineering, Senior Data Engineer Positions |
| Skills | Kafka, Apache Spark, Apache Flink, Snowflake, DBT, Python, SQL, Scala, PySpark, Airflow, ELT, Streaming Pipelines, Event Driven Architecture, CDC, Incrementality, Clustering, S3, EC2, IAM, Azure Data Factory, Databricks, Docker, Kubernetes, Terraform, GitHub Actions, Delta Lake, Star Schemas, Data Validation, And Schema Evolution, Data Lineage, Audit Logging, HIPAA compliance, Factory, GitHub |
| LinkedIn | https://https://www.linkedin.com/in/michael-chen-8765612a |

## What I'm looking for

```text
I’m looking to build and optimize real-time, low-latency data platforms—partnering with product teams to improve reliability, cost, and analytics speed with strong streaming resilience and governance.
```

## About

```text
I’m a Senior Data Engineer focused on designing fault-tolerant, event-driven data systems that turn massive streams into reliable business signals. At DoorDash, I architected a real-time event platform processing 50B+ events/day.

I enabled near-real-time pipelines for order lifecycle, delivery tracking, and pricing, helping teams make operational decisions with data latency reduced from 6–12 hours to under 5 minutes. I also designed and scaled ELT workflows in Snowflake using dbt across 100+ datasets to standardize transformations and reduce ad-hoc dependencies.

I engineer streaming pipelines with DLQ, replay, and checkpointing mechanisms, reducing production data incidents by ~35% and improving recovery time. I built a self-serve data platform (API + reusable templates) adopted by 20+ engineering teams, cutting onboarding time from days to under 2 hours.

I’ve also strengthened analytics and governance foundations, including a centralized metrics layer (dbt + Snowflake) and a data validation framework to improve audit readiness. Earlier, I delivered the HealthLake Analytics Platform using Spark and Databricks under HIPAA compliance, accelerating data delivery speed by 3–4x.
```

## Experience

### Senior Data Engineer (current)

[DoorDash](https://himalayas.app/companies/doordash). Mar 2022 - Present

```text
Architected a real-time event platform using Kafka and Spark/Flink, processing 50B+ events/day and reducing end-to-end data latency from 6–12 hours to under 5 minutes. Built and scaled Snowflake (dbt) ELT pipelines and streaming infrastructure (DLQ/replay) to power order lifecycle, delivery tracking, and pricing, improving reliability and reducing incidents by ~35%.
```

Skills: Kafka, Apache-Spark, Python, SQL, Scala, Snowflake, DBT, ELT, Airflow, Event-Driven-Architecture, CDC, Streaming-Pipelines, S3, EC2, IAM, Azure-Data-Factory, Databricks, Apache-Flink, Docker, Kubernetes, Terraform, GitHub-Actions, Clustering

### Data Engineer

[Optum](https://himalayas.app/companies/optum). Aug 2018 - Mar 2022

```text
Delivered the HealthLake Analytics Platform using Spark and Databricks to support large-scale ETL for healthcare claims and clinical data under HIPAA compliance. Improved data delivery speed by ~3–4x through incremental ETL and Spark optimizations, enabling near real-time ingestion and strengthening data governance with validation, lineage, and audit logging.
```

Skills: Spark, Databricks, Delta-Lake, HIPAA, ETL, Data-Quality, Data-Validation, Data-Lineage, Audit-Logging, Contracts, Kafka, Near-Real-Time-Ingestion

### Data Analyst

[Databricks](https://himalayas.app/companies/databricks). Oct 2016 - Aug 2018

```text
Created a SparkInsight telemetry platform using PySpark and Spark SQL, implementing batch ETL pipelines for product usage analytics. Improved processing efficiency through incremental aggregation and partition optimization and reduced compute usage via Spark execution plan analysis and performance tuning.
```

Skills: PySpark, Telemetry, Incremental-Aggregation, Partitioning, Spark-Execution-Plan-Analysis, Performance-Optimization

## Education

### Databricks

Databricks Data Analyst, Data Analytics. 2016 - 2018

```text
Completed the Databricks Data Analyst program (10/2016–08/2018), creating a SparkInsight telemetry platform with PySpark and Spark SQL to build batch ETL pipelines for product usage analytics.
```

### University of Central Florida

Bachelor's degree in Computer Science, Computer Science. 2012 - 2016

```text
Earned a Bachelor's degree in Computer Science from the University of Central Florida (2012–2016).
```

## Tech stack

- Apache Spark
- GitHub
- Kubernetes
- GitHub Actions
- PySpark
- dbt
- Gmail
- Databricks
- Terraform
- Kafka
- ws
- Airflow
- SQL
- Delta Lake
- Factory

To contact Michael, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Shriju Maharjan](https://himalayas.app/@shrijumaharjan): Senior Data Engineer, Elevance Health
- [Nishan Maharjan](https://himalayas.app/@nishanmaharjan): Senior Data Engineer, Change Healthcare
- [Eric Du](https://himalayas.app/@ericdu1): Senior Data Engineer, Robinhood
- [Sheikh Umer](https://himalayas.app/@sheikhumer1): Senior Data Engineer, Chime
- [Benny Moore](https://himalayas.app/@bennymoore): Senior Data Engineer, US Technology World
- [Ken Danny](https://himalayas.app/@kendanny): Senior Data Engineer, Intellinestsystems
- [Jerry Su](https://himalayas.app/@jerrysu): Senior Data Engineer, CVS Health
- [Nauman Khan](https://himalayas.app/@naumankhan2): Senior Data Engineer, Mage
- [Kevin Chen](https://himalayas.app/@kevinchen6): Senior Data Engineer, Spotify
- [Lu Zheng](https://himalayas.app/@luzheng): Senior Data Engineer, TikTok
