At EXL, I led the migration of around 150 Talend ETL jobs and 20 source datasets from Amazon Redshift to Microsoft Fabric. I also built an automated validation framework to check data consistency and reconcile data mart outputs.
I developed a PySpark data quality engine with YAML-driven validation rules and automated Power BI quality reports. I implemented data security using Azure Key Vault, RBAC, column-level security, and data masking.
For Azure workflows, I built parameterized Azure Data Factory pipelines to ingest data into ADLS Gen2, and developed Declarative Pipelines for medallion-based processing. I also configured Databricks Jobs and implemented CI/CD workflows using Azure DevOps and Databricks Asset Bundles.
On an EXL COE project, I developed a Snowflake and dbt Core analytics platform that transformed raw data into curated, ML-ready feature datasets. I also implemented customer segmentation and RFM analysis to support Customer Lifetime Value modeling.
