Ankur Joon

I’m a results-driven Data Engineer with 15+ years of experience across financial services, healthcare, and consulting. I specialize in building auditable, resilient, cloud-ready pipelines that connect modern platforms with strong data engineering fundamentals.

In my Data Engineer consulting role, I delivered measurable performance and cost wins—cutting turnaround time by 80%, saving 40+ hours per month, and reducing storage costs by 50%. I’m expert in Apache Spark using PySpark/Scala, with hands-on experience tuning executor cores, shuffle partitions, and memory to improve job performance by 60%.

I design data platforms using Medallion Architecture (Bronze/Silver/Gold) and Data Vault 2.0 concepts, including hubs and satellites. With Databricks (Unity Catalog and DLT methodology) and Snowflake in mind, I focus on data quality, lineage, governance, and automated orchestration—often using Airflow and Spark/Databricks workflows to increase operational efficiency.

I also bring a DevOps mindset, integrating CI/CD tooling and security controls like Kerberos and HashiCorp Vault for secure cluster policies. Whether it’s regulatory reporting, archiving pipelines, or incident reduction, I aim to leave systems faster, safer, and easier to operate.