Eric Du

I’m a Senior Data Engineer focused on turning messy, high-volume event data into trustworthy, fast-to-use analytics. At my core, I architect canonical datasets and production pipelines that cut time-to-insight and keep reliability high.

At Robinhood, I unified 50+ disparate event sources to deliver trading, portfolio performance, and user engagement metrics—bringing new metric build times from weeks to under 3 days. I build production-grade pipelines in Python, Spark, and Airflow with unit/integration testing and CI/CD, achieving 99.9% pipeline reliability.

I also design real-time stream processing with Kafka and Flink, ingesting 1M+ events/sec while balancing cost and latency. I’ve driven sub-second enrichment for fraud detection, improved data-platform self-service with dbt + Looker (enabling 100+ analysts), and strengthened reliability with SLOs, anomaly detection, and blameless post-mortems.

Earlier, I engineered HIPAA-compliant ELT pipelines with Snowflake and dbt, building audit-ready governance for EHR data. I scaled platforms dramatically, optimized Airflow and Snowflake performance for sub-second matching, implemented Datadog-based observability and SLAs, and used Terraform and AWS to make deployments repeatable and safe.