At Tiger Analytics, I design and maintain PySpark ETL pipelines on Databricks, integrating data from Salesforce, Oracle, Adobe, and APIs. I implemented multiprocessing for API-based sources, speeding up a pipeline 12x.
I migrated Oracle Analytics Cloud and Informatica systems to the Databricks Lakehouse with Unity Catalog, and extended the platform with Delta Sharing and Model Serving. I also developed custom pipelines handling daily ingestion of 50M+ records.
At Tata Consultancy Services, I extracted and transformed enterprise data with PySpark and Hive, and built curated gold-layer datasets in Mem-SQL for executive dashboards. PySpark refactoring and SQL query optimization halved query runtime.
I developed interactive Tableau KPI dashboards and automated daily ingestion and Tableau server refreshes. My certifications include Databricks Certified Data Engineer Professional and Google Cloud Professional Data Engineer.
