At Cognizant Technology Solutions, I developed PySpark ETL pipelines for Precision Pricing using CDE, Kubernetes, and Apache Iceberg. I implemented insurance pricing rules and data transformations, with validation across 15+ metadata sources.
On Precision Pricing – Auto, I built and optimized pipelines for multi-million-record datasets, improving performance by 35%. I also developed Hive SQL transformations and Hadoop/HDFS workflows that improved query efficiency by 40%.
In cross-team data platform work, I developed PySpark Structured Streaming workflows in Databricks, read source files from Azure ADLS, and applied transformations and validation. I hold Databricks Data Engineer Professional and Associate certifications, along with Microsoft Azure Fundamentals certification.
