Anna Ch

I’m a Data Engineer with 5 years of experience designing and implementing data platforms at Citi, operating in a large-scale 17 PB Hadoop/Spark data lakehouse. I focus on data quality engineering, pipeline reliability, performance optimization, and backend service development that keeps production work trustworthy.

At the center of my impact is SparkEX, a proprietary Python-based Spark execution framework I’ve developed and extended. It supports 1,500+ production pipelines, and I’ve contributed new data quality modules—including a statistical anomaly detection engine using Statistical Process Control (SPC) and 3-sigma (3σ) anomaly detection to automatically halt critical feeds during upstream data loss.

I also improve stability by resolving Spark performance bottlenecks and debugging failures across metadata-driven ETL frameworks. I’ve led production operational ownership of 1,500+ pipelines—performing attribute-level impact analysis for schema migrations, standardizing UAT validation workflows, and implementing SLA-protective job scheduling logic—so pipelines don’t fail silently or drift out of compliance.