Open to opportunities

Pawan Chauhan

@pawanchauhan1

Message

Data Engineer with 4.7 years building scalable batch and real-time platforms for analytics and BI.

India

Message

What I'm looking for

I’m looking for a role where I can build and govern scalable batch and real-time data platforms, modernize legacy pipelines, and drive reliable analytics for product and business teams.

I’m a Data Engineer with 4.7 years of experience building scalable batch and real-time data platforms for analytics and business intelligence. I focus on production-grade pipelines that modernize legacy systems, improve reliability, and enable near real-time decision making.

In my current role as a Senior Data Engineer at Publicis Sapient, I build governed data warehouse solutions using Unity Catalog, create high-throughput PySpark jobs on Azure Databricks, and lead re-architecture of legacy Java Spring Boot ingestion into scalable Databricks and PySpark services. I also automate deployments with Terraform and GitHub Actions for CI/CD and environment parity, integrating Azure Data Factory when orchestration is required.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Publicis Sapient

Apr 2025 - Present (1 year 1 month)

Built batch and streaming data pipelines for campaign interaction analytics, ingesting from Kafka and Azure Event Hub to enable near real-time reporting for marketing and product teams. Re-architected a legacy Java Spring Boot ingestion service into a governed Azure Databricks + PySpark solution, and automated deployments with Terraform and GitHub Actions.

Apache Spark Pyspark Azure Databricks Kafka Azure Event Hubs Delta Lake Azure Data Factory Unity Catalog Terraform CI CD

Software Engineer (Data)

Sopra Steria India

Aug 2021 - Mar 2025 (3 years 7 months)

Designed and optimized end-to-end ETL pipelines on Azure Databricks for analytics and reporting, processing data from APIs, files, and databases. Improved Spark performance through partitioning and tuning, implemented Delta Lake for data quality and auditability, and built production workflows with monitoring and alerting.

Azure Databricks Pyspark Apache Spark Delta Lake ETL ELT Azure Data Factory Data Warehousing Monitoring And Alerting CI CD

Education

Degrees, certifications, and relevant coursework

Noida Institute of Engineering and Technology (NIET)

Bachelor of Technology (B.Tech.), Computer Science & Engineering

2017 - 2021

Activities and societies: CodeChef 3★ (Div 2); TechGig Code Gladiators 2020 Finalist; Pinnacle & Falcon awards for leading high impact data engineering initiatives at Sopra Steria.

Earned a B.Tech. in Computer Science & Engineering at NIET, Greater Noida from 2017 to 2021. Completed coursework in computer science fundamentals and engineering principles.