# Shuo Zheng

Shuo Zheng is a remote worker on Himalayas, Senior Data Engineer at Pinterest, based in United States.

Source: https://himalayas.app/@shuozheng

```text
Senior Data Engineer specializing in scalable data platforms, lakehouses, and real-time ML pipelines.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | United States |
| Authorized to work in | United States |
| Job categories | Senior Data Engineer, Data Engineer, Data Platform Engineer, Machine Learning Engineer, Data Architect, Data Engineering Manager, Senior Data Management Engineer, Senior Data Engineering Leader, Senior ETL Engineer, Lead Data Engineer Jobs, Staff Data Engineer, Senior Blockchain Data Engineer |
| Skills | Databricks, Delta Lake, DBT, Great Expectations, Apache Spark, PySpark, Apache Beam, Kafka, Python, SQL, Scala, Java, Dataflow, Pub Sub, Snowflake, Redshift, Hive, Presto, Terraform, Looker, Tableau, AWS Glue, Time Analytics, AWS Lambda, Airflow, Google Cloud Dataflow, BigQuery, Cloud Composer |

## What I'm looking for

```text
I seek a senior data engineering role building scalable data platforms and lakehouses, collaborating with ML and product teams, emphasizing data quality, cost optimization, and mentorship.
```

## About

```text
I am a Senior Data Engineer with 9+ years designing and scaling modern data platforms at top tech companies including Pinterest, DiDi, Google, and Amazon.

I build high-performance pipelines and lakehouse architectures using Databricks, dbt, Apache Spark, Kafka, and Airflow on AWS and GCP, focusing on ML-ready datasets and real-time analytics.

My work has reduced compute costs, cut latency, and accelerated ML cycles—examples include a 30% compute cost reduction, 40% latency reduction with medallion pipelines, and automated data quality across 300+ pipelines.

I mentor engineers, drive data governance and cost optimization, and partner with product and data science teams to enable reliable, self-serve analytics at scale.
```

## Experience

### Senior Data Engineer (current)

[Pinterest](https://himalayas.app/companies/pinterest). Apr 2020 - Present

```text
Led migration to a Spark platform on AWS EKS, cutting compute costs by 30% and architected a Databricks Delta Lake lakehouse that reduced latency by 40% and enabled self-serve analytics for 200+ users.
```

Skills: Databricks, Delta-Lake, Spark, Kafka, DBT, Great-Expectations, Airflow, AWS, Streaming

### Senior Data Engineer

DiDi. Mar 2018 - Apr 2020

```text
Built real-time trip analytics pipelines ingesting 100M+ events/day with Kafka and Spark, improved ETL performance 2× and reduced production incidents by 35% through automated quality checks.
```

Skills: Kafka, Spark, DBT, Hive, Presto, HDFS, S3, Airflow, Streaming

### Data Engineer

Google. Jul 2016 - Mar 2018

```text
Built unified analytics pipelines using Dataflow (Beam) and BigQuery processing billions of daily events, improving query speed by 40% and saving ~$500K annually via optimization.
```

Skills: Dataflow, Apache-Beam, BigQuery, Pub-Sub, Cloud-Composer, GCP), ETL, Partitioning, GCP

### Data Analyst

[Amazon](https://himalayas.app/companies/amazon). Feb 2015 - Jul 2016

```text
Automated reporting pipelines with Python, Lambda, and Redshift, cutting manual effort by 80% and delivering analyses that contributed to ~$2M annual savings and a 10% retention lift.
```

Skills: Dashboarding, Python, AWS-Lambda, Redshift, SQL, ETL, Reporting, Root-Cause-Analysis

## Education

### Carnegie Mellon University

Master of Science, Computer Science. 2013 - 2014

```text
Completed a Master of Science in Computer Science focused on advanced topics relevant to data engineering and large-scale systems.
```

### Beijing University of Posts and Telecommunications

Bachelor of Engineering, Computer Science. 2009 - 2013

```text
Earned a Bachelor of Engineering in Computer Science with foundational training in software and systems engineering.
```

## Tech stack

- Apache Spark
- AWS Glue
- PySpark
- dbt
- Gmail
- Databricks
- Terraform
- Java
- Kafka
- Google Cloud Dataflow
- AWS Lambda
- Airflow
- Apache Beam
- Time Analytics
- Root Cause
- SQL
- Delta Lake
- Great Expectations

To contact Shuo, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Nayla R](https://himalayas.app/@naylar): Senior Data Engineer, Sepsis Scout
- [Ketan Boro](https://himalayas.app/@ketanboro): Senior Data Engineer, Pfizer
- [James User](https://himalayas.app/@jamesuser12): Lead Data Engineer, Capital One
- [Ahsan Chaudhary](https://himalayas.app/@ahsanchaudhary): Senior Data Engineer, Cloudstream Technologies
- [Ruohan Liu](https://himalayas.app/@ruohanliu): Senior Data Engineer, Uber
- [Tarsh Patel](https://himalayas.app/@tarshpatel): Senior Data Engineer, JPMorgan Chase & Co
- [Jason A](https://himalayas.app/@jasona): Senior Data Engineer, First Team IT
- [Anthony Jasper](https://himalayas.app/@anthonyjasper): Senior Data Engineer, Discord
- [Christopher Liu](https://himalayas.app/@christopherliu): Senior Data Engineer, Discord
- [Aaron Rehman](https://himalayas.app/@aaronrehman): Senior Data Engineer, Aptask
