Looking for a job

Samuel Chen

@samuelchen2

Message

Senior data engineer building low-latency lakehouses and real-time streaming platforms.

United States

Message

What I'm looking for

I seek roles building scalable, event-driven data platforms focused on low-latency personalization, strong governance, observability, and cost-efficient operations.

I am a senior data engineer specializing in low-latency, cost-efficient lakehouses and streaming platforms that deliver real-time personalization and operational reliability. I design and implement event-driven architectures using PySpark, Snowflake/Databricks, Kafka, and Airflow on AWS and Azure, and drive governance, observability, and FinOps improvements.

My work has delivered measurable outcomes including sub-120ms SLOs for eligibility services, 35–45% warehouse cost reductions, >60% fewer reconciliation defects, and production platforms that supported large-scale public-health and retail initiatives. I focus on idempotent streaming, deterministic+probabilistic identity stitching, SCD2 ledger models, data quality SLAs (Great Expectations), lineage, and repeatable CI/CD for data workloads.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Fanatics

Jul 2022 - Present (3 years 3 months)

Architected an event-driven loyalty lakehouse (Kafka/Kinesis → PySpark/dbt → Snowflake) and implemented a p99 eligibility service (<120 ms), reducing loyalty mart costs 35–45% and cutting reconciliation defects >60%.

Pyspark Kafka Snowflake DBT Redis Great Expectations SLOs FinOps Event Driven Architecture

Data Engineer

CVS Health

Jan 2018 - Jun 2022 (4 years 5 months)

Designed PySpark/ADF Delta Lakehouse pipelines, built tokenized PII domains and row-level security, and delivered analytics latency improvements from weeks to hours enabling A/B outreach that drove ~1.6% adherence lift.

Pyspark ADFS Delta Lake CI CD Data Modeling Tableau

Data Engineer Intern

Databricks

Jul 2017 - Dec 2017 (5 months)

Delivered REST/API enhancements, PAT-based auth and stronger ACL enforcement for workspaces; added telemetry and tests that improved platform security and observability.