Open to opportunities

Ivan Lee User

@ivanleeuser

Message

I build scalable data pipelines, platforms, and reliable analytics workflows.

Philippines

Message

What I'm looking for

I'm looking to build scalable, reliable data platforms and pipelines where data quality, observability, cloud engineering, and practical AI integration turn raw data into actionable insights.

At Asurion, I build batch and near-real-time data pipelines on AWS EMR and Glue, processing 100k+ daily financial transactions while reducing ETL runtime by 40%. I also built Kafka-to-Spark streaming pipelines processing 10k events per second with sub-minute latency.

Across Zendesk, Salesforce, and Cognizant, I've delivered ETL workflows, data warehouses, dimensional models, APIs, and migration solutions using Python, SQL, Spark, dbt, Airflow, AWS, Azure, and Databricks. My work has improved pipeline reliability to 99.9%, data accuracy to 99.5%, and dashboard performance by 70%.

I care deeply about data quality, observability, and infrastructure automation. I use Great Expectations, dbt tests, Terraform, and monitoring tools to turn raw data into reliable, actionable insights, and I mentor junior engineers on PySpark, Airflow, and SQL tuning.

Experience

Work history, roles, and key accomplishments

Senior Software Engineer

Asurion

Jan 2024 - Jun 2026 (2 years 5 months)

Designed and built batch and near-real-time data pipelines using PySpark on AWS EMR and AWS Glue, processing 100k+ daily financial transactions and reducing ETL runtime by 40%. Orchestrated complex workflows with Apache Airflow, implemented data quality frameworks, and integrated LLMs for data enrichment.

Python PySpark SQL AWS EMR Glue Lambda S3 Redshift Athena Kinesis Airflow Delta Lake Snowflake Great Expectations DBT Terraform Kafka Spark Structured Streaming Docker Kubernetes CI CD Cloudwatch Prometheus Grafana

Senior Software Engineer

Zendesk

Mar 2020 - Dec 2023 (3 years 9 months)

Built end-to-end ETL pipelines using Python and AWS Lambda, ingesting data from Salesforce, HubSpot, and Shopify into Amazon Redshift. Implemented incremental load patterns, data validation with dbt, and streaming with Kafka, while containerizing applications with Docker and deploying to AKS.

Python Pandas Polars AWS Lambda Amazon Redshift DBT Kafka AWS Glue Azure Data Factory Databricks Delta Live Tables Docker Kubernetes SQL PySpark

Software Engineer

Salesforce

Nov 2015 - Feb 2020 (4 years 3 months)

Built ETL pipelines using Python and SQL to consolidate e-commerce data into a PostgreSQL data warehouse, designed star schema models, and automated data refreshes. Developed REST APIs with FastAPI and optimized SQL queries to improve dashboard performance.

Python SQL PostgreSQL MySQL ETL Star Schemas fastAPI DBT Gitlab CI Elasticsearch

Software Engineer

Cognizant Technology Solutions

Jun 2011 - Oct 2015 (4 years 4 months)

Developed data migration scripts in Python and PHP, wrote stored procedures and triggers in SQL Server, and built daily batch jobs for reporting. Integrated third-party logistics APIs and created data validation routines for accuracy.