At Capgemini, I built scalable Azure Data Factory pipelines that automated daily ingestion from SAP, SQL Server, Excel, and CSV sources. I developed PySpark workflows and implemented Bronze, Silver, and Gold data layers to deliver reliable, business-ready datasets.
I optimized Spark workloads and built metadata-driven pipelines to handle late-arriving files, duplicate records, and schema changes. The curated datasets powered Power BI reports for sales forecasting, capacity planning, revenue, plant performance, and customer demand.
