Open to opportunities

Hajio Shao

@hajioshao

Message

Senior Data Engineer specializing in ML infrastructure, scalable data pipelines, and cloud.

United States

Message

What I'm looking for

I seek senior roles building scalable ML infrastructure and data platforms at companies valuing reliability, automation, mentorship, and cross-functional collaboration.

I am a Senior Data Engineer and ML Infrastructure Engineer with over eight years building scalable data platforms and production ML systems. I design low-latency feature generation pipelines and integrate ML models into production to enable real-time personalization.

My work spans distributed processing with Apache Spark, Flink, and Kafka, orchestration using Airflow and Dagster, and cloud deployments across AWS, GCP, and Azure. I have led infrastructure efforts using Kubernetes, Docker, Terraform, and CI/CD tooling to automate model and service delivery.

I have delivered large-scale solutions including real-time indexing and serving, streaming feature generation, payment and fraud systems, and consolidated billing platforms. I emphasize reliability through monitoring, alerting, and data governance to maintain high-quality data for ML.

I mentor junior engineers, drive technical strategy, and collaborate with product teams to translate business needs into scalable architectures that support complex ML and AI use cases.

Experience

Work history, roles, and key accomplishments

ML Infrastructure Engineer

Jun 2022 - Aug 2025 (3 years 2 months)

Led development and optimization of Core ML feature infrastructure using Spark and Flink to enable low-latency feature generation across product surfaces, improving real-time personalization and pipeline reliability.

Apache Spark Apache Flink Kafka Airflow Dagster Kubernetes Presto CI CD Distributed Systems

Senior Data Engineer

DiDi

Aug 2020 - Apr 2022 (1 year 8 months)

Built data platforms for a large-scale ride-sharing and payments ecosystem, implementing KYC, anti-fraud, and bad-debt models that improved payment security and risk detection across the 99Pay product.

Data Modeling Fraud Detection Machine Learning SQL Spark Data Quality ETL Payments

Cloud Data Engineer

Classic Computers Corp

Aug 2017 - Aug 2020 (3 years)

Designed and automated cloud-based payment transaction pipelines on AWS using Kafka, Lambda, RDS, and S3, improving real-time processing, reconciliation, and scalable storage for millions of transactions.

AWS Apache Kafka AWS Lambda Terraform Airflow RDS)DynamoDB CI CD Monitoring

Full Stack Engineer

Marlabs Inc

Mar 2016 - Apr 2017 (1 year 1 month)

Developed full-stack applications and RESTful APIs using Node.js and Python, implemented cloud storage on AWS S3, and automated backend processes to support scalable data ingestion and ETL workflows.