At Capgemini Technology Services, I designed ETL/ELT pipelines for supply chain and analytics using Azure Databricks, PySpark, and Spark SQL. I optimized Spark jobs with partitioning, caching, and query tuning, reducing execution time and reporting latency by up to 30%.
For healthcare data integration, I implemented a metadata-driven ingestion architecture in Microsoft Fabric and developed and validated Silver-to-Gold pipelines. I also built a retail analytics Lakehouse on Azure Databricks, integrating Salesforce and PostgreSQL data for KPI reporting and Genie-powered analytics.
