At Tata Consultancy Services, I build and optimize data pipelines that process 30+ TB of batch data between on-premise systems and BigQuery. I use PySpark, Spark SQL, and Apache Airflow to develop distributed ETL workflows.
I improved query execution time by 35% and helped lower compute costs. I also resolved quality and pipeline failures across 15+ legacy pipelines, improving SLA adherence by 20% and reducing defects by about 30%.
On my Smart AI Doc Miner project, I implemented retrieval-augmented generation with Google Gemini 2.0 and pgvector, then deployed the application on Google Cloud Run. Iām a Google Cloud Certified Professional Data Engineer and Cloud DevOps Engineer.
