At AngelOne, I designed a reusable PySpark and Databricks ETL framework for ingesting and transforming data across multiple domains. I also worked on the organization-wide PII discovery and compliance program, scanning data across AWS accounts with Borneo.
On the Redshift-to-Databricks migration project, I led the migration of 50+ enterprise ETL pipelines to Databricks and Delta Lake. I developed PySpark data validation frameworks and optimized Spark performance and cluster utilization.
At AU Small Finance Bank, I developed and maintained ETL pipelines for a cloud data warehouse initiative, using Python, SQL, SparkSQL, and AWS services. I also automated workflows with Apache Airflow and supported migration and testing from UAT to production.
Earlier, at GrowServe, I developed PySpark pipelines for insurance claims and policy analytics, loading curated data into Snowflake. At EPAM systems, I worked on enterprise data migration pipelines using Hive, SQL/HQL, and Informatica workflows.

