At Cognizant, I designed, developed, and maintained data pipelines for enterprise ingestion, transformation, migration, reporting, and analytics. I used Python, SQL, and PySpark to support these workflows.
I built cloud pipelines with AWS S3, Lambda, Glue, Athena, and Redshift, including a project that created curated Parquet datasets for analytical use. I also implemented schema validation, duplicate detection, reconciliation, and CRC checks.
I supported batch cycles of up to 48 hours with 100% SLA compliance, and handled production incidents through monitoring and root-cause analysis. In a separate project, I built an event-driven pipeline with Apache Kafka and PySpark Structured Streaming.
