Looking for a job

shivam yadav

@shivamyadav16

Message

Data Engineer at Synapxe modernising Oracle workloads on Databricks Delta Lake with parallel ETL pipelines.

Singapore

Message

At Synapxe, I’m migrating legacy Oracle workloads to Databricks Delta Lake and Medallion Architecture. I also developed parallel PySpark pipelines using master-worker distribution logic to improve ETL throughput.

At Accolite (Morgan Stanley), I designed Informatica IDMC pipelines and migrated PowerCenter workflows. I built automated Python workflows that reduced ETL processing time by 60%, and supported a DB2-to-Snowflake migration that maintained 99.9% data accuracy.

At Chubb, I built Snowflake data marts and Databricks Customer 360 pipelines for insurance data. Earlier, at Wipro, I implemented and tuned Informatica ETL pipelines, achieving 25–30% performance efficiency gains. I hold Microsoft Azure Data Engineer Associate and Azure Data Fundamentals certifications.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Synapxe

Jan 2026 - Present (9 months)

Led large-scale on-prem to cloud migration, transitioning legacy Oracle DB workloads to Databricks Delta Lake and Medallion Architecture. Architected data governance using Unity Catalog with Row-Level Access Control and developed parallel PySpark pipelines to boost ETL throughput.

Databricks PySpark S3 Lambda Unity Catalog RLAC Delta Lake Medallion Architecture Materialized Views ETL

Data Engineer

Accolite

Jul 2025 - Jan 2026 (6 months)

Designed and deployed end-to-end ETL pipelines in Informatica IDMC, including mappings, workflows, and Secure Agent configuration. Spearheaded migration of legacy PowerCenter workflows to IDMC and reduced ETL processing time by 60% with automated Python workflows.

Informatica Intelligent Data Management Cloud (IDMC)PowerCenter Python Snowflake DB2 Git CI CD ETL

Data Engineer

Chubb

Mar 2022 - Jul 2025 (3 years 4 months)

Reduced data processing time by 40% by orchestrating high-performance ETL pipelines using Informatica IDMC and PowerCenter. Designed data marts on Snowflake and built scalable Customer 360 data pipelines on Databricks.

Informatica Intelligent Data Management Cloud (IDMC)PowerCenter Snowflake Databricks Python Azure Active Directory Github CI CD SQL ETL

Data Specialist

Wipro

Oct 2020 - Mar 2022 (1 year 5 months)

Implemented ETL pipelines using Informatica PowerCenter 10.1 and IICS, applying filtering, joining, routing, and aggregation transformations. Achieved 25–30% performance efficiency gains through systematic tuning of mappings and sessions.

Informatica PowerCenter IICS SQL Server DB2 UNIX Shell Scripting SQL ETL