At Accenture, I develop and maintain AWS Glue ETL jobs with PySpark, moving structured and semi-structured data into Amazon S3. I also configure Glue Crawlers and the Data Catalog so datasets can be queried with Amazon Athena.
At Cognizant, I designed and built Spark pipelines on AWS EMR that processed 2 TB+ of data daily. I optimized Spark jobs to improve query performance by 50% and reduce processing costs by 25%.
I also implemented Databricks Lakehouse capabilities over an existing S3 data lake and developed Airflow-orchestrated ETL pipelines using Medallion Architecture. Earlier, as a Data Engineering Intern at Cognizant, I assisted with PySpark and Hive pipelines and worked with AWS EMR and Amazon S3.

