I've built and maintained Azure ETL/ELT pipelines for Centillion Networks' retail sales and inventory data platform, processing about 200K records daily from five source systems.
I use Azure Data Factory, Databricks, PySpark, Delta Lake, and Medallion Architecture to create Bronze, Silver, and Gold datasets. My incremental loading and Delta MERGE work reduced pipeline execution time by 25%, while PySpark optimization improved processing runtime by about 25%.
Previously at Schneider Electric, I supported manufacturing data pipelines, validation, deduplication, and incremental processing. I focus on secure, governed, analytics-ready data through Azure Key Vault, dimensional modeling, and source-to-target validation.
