Open to opportunities

Sagnik Mukherjee

@sagnikmukherjee

Message

Experienced Data Engineer specializing in scalable ETL pipelines and cloud data platforms.

India

Message

What I'm looking for

I'm seeking data engineering roles to build scalable, cost-effective ETL platforms on Azure/OCI/Databricks, improve data freshness and observability, collaborate cross-functionally, and mentor junior engineers.

I am an experienced Data Engineer with three years building scalable batch data platforms across Azure, OCI, and Databricks, primarily in supply chain and e-commerce. I have improved data freshness by up to 95% and reduced compute costs by 34% through optimized PySpark pipelines and architecture decisions.

At Oracle I led cross-functional initiatives standardizing ingestion across 12+ sources, implemented ADLS Gen2 RBAC for self-service analytics, and mentored teams to deliver faster, traceable reporting that cut RCA and QA escalations significantly. I seek roles where I can architect cost-effective, observable ETL platforms, collaborate with stakeholders, and mentor junior engineers.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer 2

Current

Oracle

Sep 2024 - Present (1 year 9 months)

Led design and delivery of a batch data platform using Azure Data Factory to improve data freshness by 95% and directed a team of 3 to optimize PySpark pipelines on Azure Databricks, achieving 40% faster dashboard refreshes; unified ingestion across 12+ sources, reducing QA escalations by 70% and cutting access requests by 30%.

Azure Data Factory Pyspark Databricks RBAC Power BI Data Ingestion Monitoring

Data Engineer 1

Oracle

Aug 2022 - Sep 2024 (2 years 1 month)

Developed robust PySpark ETL pipelines on OCI Data Flow processing 50TB full loads and 30GB daily incrementals, reduced compute cost by 34% via Spark optimizations, and implemented centralized monitoring and alerting that cut RCA time by 60%.

Pyspark OCI Data Flow Oracle Data Integrator Spark Optimization Monitoring

Education

Degrees, certifications, and relevant coursework

Heritage Institute of Technology

Bachelor of Technology, Applied Electronics and Instrumentation Engineering

2018 - 2022

Grade: 8.96/10

Completed Bachelor of Technology in Applied Electronics and Instrumentation Engineering at Heritage Institute of Technology, Kolkata (Jul 2018–Jul 2022) with a CGPA of 8.96/10.