At TresVista Analytics, I built and deployed Amazon MWAA to run more than 100 critical financial workflows daily. Automated reconciliation checks cut manual auditing by more than 30 hours a week and reduced downstream data errors by 90%.
I led the design of a multi-tenant Databricks Lakehouse on AWS, managing more than 200 production tables through Unity Catalog. PySpark pipelines processed over 1.5TB of financial market data daily, while Delta Lake optimizations cut runtimes by 40%.
I also built a configuration-driven PySpark ingestion framework and incremental processing with Delta Lake MERGE and SCD Type 2 dimensions. At Infosys, I maintained ELT pipelines into Databricks and Delta Lake and improved analytical query performance by 30%.
