Open to opportunities

Sankara Narayanan Subramanian

@sankaranarayanans

Message

Azure Data Engineer building scalable data pipelines and end-to-end cloud solutions.

India

Message

What I'm looking for

I am seeking a role building scalable Azure-based data platforms where I can apply PySpark/ADF/Databricks expertise, contribute to CI/CD, and grow technically in a collaborative team.

I am an Azure Data Engineer with hands-on experience designing data ingestion pipelines, developing data models, and delivering end-to-end data solutions on Microsoft Azure. I have implemented ADF pipelines, optimized Databricks (PySpark) transformations, and integrated on-prem sources into Azure Data Lake.

In my recent roles I contributed to performance improvements—boosting processing performance by 30%—and supported CI/CD efforts that enabled successful production deployments. I have experience with ETL tools such as Datastage and Ab-Initio and have taken ownership of multiple applications and ETL processes.

I hold an MCA and a Microsoft Certified Fabric Data Engineer Associate certification, and I am seeking opportunities to further sharpen my programming, analytical, and cloud data engineering skills while delivering scalable, secure data platforms.

Experience

Work history, roles, and key accomplishments

Current

Lead Engineer

Current

HCL Tech

Sep 2024 - Present (1 year 1 month)

Designed and implemented Azure Data Factory ingestion pipelines from on-prem SQL and APIs into ADLS Gen2 and built Databricks (PySpark) transformations that improved processing performance by 30%, enabling successful CI/CD production deployments.

Azure Data Factory Databricks Pyspark Azure ADLS Gen2 Azure SQL CI CD Data Ingestion Performance Tuning

Software Engineer

Mphasis

Aug 2021 - Sep 2024 (3 years 1 month)

Designed and implemented data warehouse solutions using IBM Datastage and Ab Initio and owned ETL for 3+ applications processing diverse input files to deliver reliable data pipelines.