Surya Ramya kanakam

I’m an Azure Data Engineer with 4+ years of experience building high-performance Lakehouse data platforms on Azure Databricks and Delta Lake. I specialize in designing scalable data pipelines with incremental processing, SCD Type 2 implementations using MERGE, and production-grade performance tuning.

In my role at Infosys Ltd, I’ve delivered enterprise regulatory workloads (100–200 GB per cycle) with a strong focus on reliability and execution efficiency. For Basel III regulatory reporting, I built Bronze–Silver–Gold Lakehouse pipelines, implemented incremental ingestion and historical tracking, and reduced execution time by 30% through partitioning and file compaction.

I also drive end-to-end data engineering across modernization and consolidation initiatives. I consolidated multi-source banking data into an ADLS-backed Lakehouse with PySpark and Delta tables, and I migrated on-prem Hadoop data to Azure using AzCopy and ADF—automating workflows and reducing manual effort by 60%. I’m motivated by building governed, maintainable systems that keep data accurate through validation and reconciliation.