At Prolifics, I create Azure Data Factory pipelines that move data from sources including IBM DB2 and Azure SQL DB into Azure Data Lake Storage. I automated a data pipeline, increasing operational efficiency by 20%.
I also ingest and transform multi-source data using Azure Synapse Analytics and ADLS Gen2. In Microsoft Fabric, I designed and implemented a Bronze, Silver, and Gold medallion architecture with PySpark and Delta Lake tables.
I support production data pipelines, validate deployments, and troubleshoot live-site issues. My work also includes monitoring performance, optimizing queries, and supporting data engineering and business analyst requirements.
