Scott Chen
@scottchen2
Senior data engineer specializing in scalable pipelines, data modeling, and reliability.
United StatesWhat I'm looking for
I am a Senior Data Engineer with a strong track record designing and delivering scalable end-to-end data pipelines using Spark, Python, and Snowflake, and optimizing ELT workflows with dbt to improve data freshness and reduce incidents. I have delivered HIPAA-compliant real-time healthcare pipelines, built fraud-detection processing at scale, and contributed to resilient distributed systems and payments infrastructure.
I drive technical strategy by translating complex business needs into robust data architectures, establish comprehensive data quality monitoring, and mentor junior engineers on best practices. I am experienced across cloud and DevOps tooling (AWS, GCP, Kubernetes, Terraform) and emphasize reliability, performance, and operational excellence in data platforms.
Experience
Work history, roles, and key accomplishments
SAArchitected end-to-end Spark and Python pipelines into Snowflake for internal dashboards, improving data freshness by 30% and reducing production incidents by 25% through comprehensive quality monitoring.
SABuilt and maintained real-time HIPAA-compliant healthcare data pipelines and Snowflake warehousing using SQL and Python, enabling reliable real-time reporting and reducing data issues via validation processes.
STDeveloped high-throughput Java microservices and real-time Kafka/Spark pipelines for payments and fraud detection, scaling core infrastructure to support global expansion.
Education
Degrees, certifications, and relevant coursework
SUSan Diego State University
Master of Science, Computer Science
Completed a Master's degree in Computer Science focusing on advanced computer science topics and technical skills relevant to data engineering.
Tech stack
Software and tools used professionally
Availability
Location
United StatesAuthorized to work in
Job categories
Interested in hiring Scott?
You can contact Scott and 90k+ other talented remote workers on Himalayas.
Message ScottFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
