Skip to main content
Piyush UpadhyayPU
Looking for a job

Piyush Upadhyay

@piyushupadhyay1

Data Engineer at Adecco building insurance claims integrations; previously modernized BMW sales data pipelines on Azure and Databricks.

India
Message

At Adecco, I design and build ETL and data integration workflows on Adeptia for an enterprise insurance claims data integration and reporting platform. I ingest, transform, validate, and standardize claims data from multiple Third-Party Administrators into a canonical model.

At Cognizant Technology Solutions, I migrated BMW’s legacy Informatica workflows to Azure-native pipelines using Azure Data Factory and Databricks. I built PySpark jobs processing CRM and sales datasets exceeding 50M records, tuning them for about 35% faster execution.

I designed bronze, silver, and gold lakehouse layers on ADLS Gen2 with Delta tables for European sales reporting. I also implemented incremental loading and data quality checks, and supported 99.9% pipeline reliability through Azure DevOps CI/CD, monitoring, and incident root-cause analysis.

Earlier at Cognizant Technology Solutions, I developed and optimized more than 100 Informatica PowerCenter mappings and workflows for BMW’s Next Best Offer/Action Platform. I also optimized SQL and ETL processing, automated Excel reporting and Unix shell cache cleanup, and earned the Databricks Certified Data Engineer Associate certification.

Experience

Work history, roles, and key accomplishments

AD
Current

Data Integration / ETL Engineer

Adecco

Aug 2026 - Present (2 months)

Designed and built ETL/data integration workflows on Adeptia to ingest, transform, validate, and standardize claims data from multiple Third-Party Administrators (TPAs) into a canonical model for downstream reporting. Performed source-to-target mapping and implemented data validation and transformation rules.

Cognizant Technology Solutions logoCS

Azure Data Engineer

Aug 2023 - Aug 2026 (3 years)

Migrated legacy Informatica workflows to Azure-native pipelines (ADF, Databricks), improving scalability and reducing operational overhead. Built scalable PySpark jobs in Databricks to cleanse, transform, and enrich CRM and sales datasets exceeding 50M records, and designed bronze/silver/gold lakehouse layers on ADLS Gen2 with Delta tables.

Cognizant Technology Solutions logoCS

Informatica ETL Developer

Sep 2021 - Aug 2023 (1 year 11 months)

Developed and optimized 100+ Informatica PowerCenter mappings and workflows integrating Amazon Redshift, Oracle, and PostgreSQL for CRM, sales, and analytics data. Optimized SQL and ETL processing to cut report generation time by ~30% and automated Excel reporting and Unix shell cache cleanup.

Education

Degrees, certifications, and relevant coursework

KIIT University logoKU

KIIT University

Bachelor of Technology, Computer Science

2017 - 2021

Pursued a Bachelor of Technology in Computer Science from KIIT University, Bhubaneswar, from 2017 to 2021.

Databricks logoDA

Databricks

Databricks Certified Data Engineer Associate, Data Engineering

Earned the Databricks Certified Data Engineer Associate certification.

Interested in hiring Piyush?

You can contact Piyush and 90k+ other talented remote workers on Himalayas.

Message Piyush

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan