Open to opportunities

Chun Wei Chan

@chunweichan

Message

Experienced data engineer specializing in cloud data platforms and pipeline automation.

Malaysia

Message

What I'm looking for

I seek roles building scalable cloud data platforms with automation and observability, in collaborative teams focused on impactful analytics and operational excellence.

I am an experienced Data Engineer with a strong track record designing and implementing cloud-based data solutions across AWS, GCP, and Azure. I focus on scalable ETL/ELT architectures, infrastructure-as-code, and operational reliability, having built data lakes, warehouses, and production pipelines using tools such as Airflow, dbt, Redshift, BigQuery, and Kubernetes.

My background includes leading POCs and optimizations for Apache Flink and Kafka on Kubernetes, implementing CI/CD with GitLab/ArgoCD and Terraform, and developing monitoring with Prometheus/Grafana. I collaborate effectively with global teams and vendors to deliver compliant, cost-efficient data platforms that drive actionable business insights.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Adaptavist

May 2023 - Present (2 years 4 months)

Led research, deployment and optimization of Apache Flink on Kubernetes and implemented cost-efficient cross-AZ nodepool provisioning with spot instances; maintained Airflow reliability and managed AWS deployments via GitLab, ArgoCD and Terraform.

Apache Flink Kubernetes Apache Airflow Terraform ArgoCD Gitlab CI Prometheus Grafana

Data Engineer

Keyteo Consulting

Nov 2022 - Apr 2023 (5 months)

Designed integration solutions to migrate on-premises systems to AWS and led vendor and stakeholder interactions to deliver the project within tight timelines.

Business Process Mapping Stakeholder Management Requirements Gathering & Compliance Solution Design Project Delivery

Data Engineer

Roche Malaysia

Oct 2020 - Nov 2022 (2 years 1 month)

Built and maintained AWS Data Lake and Data Warehouse across APAC using Redshift, S3, Glue and Athena; implemented CI/CD with AWS CDK and developed dbt ETL models for BI dashboards.

AWS RedShift S3 AWS Glue AWS Lambda Amazon Athena DBT AWS CDK CI CD SQL Python

Data Engineer

Accenture Malaysia

Oct 2017 - Oct 2020 (3 years)

Architected and administered enterprise data infrastructure on Google Cloud Platform including BigQuery, VPC and Cloud Composer; designed Airflow workflows and delivered cross-cloud integration projects for multiple enterprise clients.