At Cognizant Technology Solutions, I migrated legacy Java Spring Batch jobs to Spark ETL, reducing runtimes by approximately 75%. I developed and maintained 76–80 PySpark pipelines on AWS EMR, independently owning end-to-end development of 12–13 pipelines.
For the Capital One project, I developed ingestion and ETL pipelines with Azure Data Factory and Databricks, and implemented bronze, silver, and gold data architectures using Delta Lake and Unity Catalog. I also introduced Databricks Asset Bundles and Azure DevOps CI/CD pipelines for deployments.
At RenaultNissan Technology & Business Center, I developed and maintained PySpark pipelines on Amazon EMR for vehicle parts and operational data. I also worked on performance tuning, production support, and event-driven integrations using AWS Lambda, SNS, and SQS.
