Guoying Wang
@guoyingwang
Senior data engineer specializing in large-scale distributed ETL and analytics.
What I'm looking for
I am a senior data engineer with extensive experience building and operating large-scale batch and streaming ETL pipelines for billions of events daily, supporting multi-petabyte datasets and 1.8B+ active devices worldwide. I design Spark (Scala/Python) and Hadoop-based systems, implement privacy-preserving aggregation workflows, and optimize distributed workloads to reduce compute costs and improve availability.
I have a proven record introducing automated data quality checks, schema validation, and monitoring that cut incidents and improved recovery times, while collaborating with product, privacy, and legal teams to translate regulatory requirements into enforceable controls. I bring strong production operations experience, containerized deployment of Spark jobs, and a focus on scalable data modeling for analytics at global scale.
Experience
Work history, roles, and key accomplishments
Designed and maintained large-scale batch and streaming data pipelines processing billions of daily App Store events for 1.8B+ devices; optimized Spark workloads to reduce compute cost by 30% and maintained 99.99% pipeline availability.
Java / Scala Engineer
Jumpshot Inc.
Aug 2017 - Jul 2018 (11 months)
Engineered distributed ETL pipelines using Java, Scala, Spark and Hadoop to process billions of daily clickstream events, improving processing throughput by 25% and reducing customer-facing data issues by 40%.
Education
Degrees, certifications, and relevant coursework
Santa Clara University
Master of Science, Computer Science
2015 - 2017
Completed a Master's degree in Computer Science focusing on advanced software and data engineering concepts from 2015 to 2017.
Availability
Location
Authorized to work in
Job categories
Interested in hiring Guoying?
You can contact Guoying and 90k+ other talented remote workers on Himalayas.
Message GuoyingFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
