W User
@wuser1
Senior data engineer building low-latency, large-scale data platforms in cloud ecosystems.
What I'm looking for
I’m an Expert Senior Data Engineer with over 12 years designing and managing complex, large-scale data ecosystems. I specialize in building robust ETL/ELT pipelines, optimizing high-performance data warehouses, and implementing cloud-native infrastructure—grounded in strong proficiency in PySpark, Python, and SQL. I focus on distributed systems that deliver high availability and low latency, while keeping data reliable for operational and research-grade decision-making.
Across multiple platforms, I’ve architected end-to-end pipelines for real-time and batch workflows, including streaming ingestion and rigorous data quality monitoring. I’ve implemented automated alerting to proactively detect and remediate data drift in multi-modal sensor streams, and I’ve partnered with AI teams to enable experiment tracking, lineage management, and model evaluation with MLflow. I also optimize cost and performance through storage lifecycle policies, slot utilization strategies, and query acceleration techniques like partitioning and caching.
My engineering approach blends platform reliability with delivery velocity: I build orchestration and DevOps foundations using CI/CD, Infrastructure as Code (Terraform), Docker, and Kubernetes, and I operationalize pipelines with observability practices using SLIs/SLOs. I’ve led major migrations to AWS while maintaining zero data loss and 99.9% uptime for critical training pipelines, and I’ve introduced self-healing and robust security governance to reduce failures and protect sensitive datasets. I’m energized by cross-functional ownership—translating complex data needs into secure, scalable systems that teams can confidently rely on.
Experience
Work history, roles, and key accomplishments
Senior Data Platform Infra Eng
Ola
Feb 2025 - Present (1 year 5 months)
Architected and managed scalable cloud data warehouses for high-volume robot sensor and field operation data. Built real-time streaming ingestion, end-to-end pipelines for embodied learning workflows, and automated data quality monitoring and alerting.
Designed and operated high-performance data warehouse environments and dashboards for robot fleet monitoring and operational reporting. Implemented time synchronization and orchestrated distributed multi-node/multi-GPU training infrastructure with security governance and self-healing for pipeline reliability.
Education
Degrees, certifications, and relevant coursework
University of Science and Technology Beijing
Bachelor of Science, Applied Physics
2009 - 2013
Activities and societies: Minor in Computer Science.
Earned a Bachelor of Science in Applied Physics at the University of Science and Technology Beijing (2009–2013), with a minor in Computer Science.
Tech stack
Software and tools used professionally
Snowflake
Azure Synapse
Apache Spark
AWS Glue
AWS IAM
GitHub
GitLab
Kubernetes
Cloudflare
AWS CodePipeline
Jenkins
PySpark
Gmail
Google Analytics
Databricks
Terraform
JavaScript
Python
HTML5
Java
CSS 3
JSON
AWS Elastic Load Balancing ...
AWS CloudTrail
MLflow
Kubeflow
Kafka
Grafana
Linux
AWS Lambda
Serverless
Docker
Airflow
Root Cause
Amazon Web Services (AWS)
SQL
Delta Lake
Bash
Transform
Modal
Enhance
Availability
Location
Portfolio
github.com/DjangoYangSalary expectations
Job categories
Skills
Interested in hiring W?
You can contact W and 90k+ other talented remote workers on Himalayas.
Message WGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
