HimalayasHimalayas logo
Surya Ramya kanakamSK
Open to opportunities

Surya Ramya kanakam

@suryaramyakanakam

Azure Data Engineer building high-performance Lakehouse platforms with Databricks, Delta Lake, and reliable regulatory pipelines.

India
Message

What I'm looking for

I’m looking for a role where I can build production-grade Lakehouse pipelines for real-world/regulatory data—owning incremental ingestion, SCD logic, performance tuning, monitoring, and data quality so systems stay reliable and governable.

I’m an Azure Data Engineer with 4+ years of experience building high-performance Lakehouse data platforms on Azure Databricks and Delta Lake. I specialize in designing scalable data pipelines with incremental processing, SCD Type 2 implementations using MERGE, and production-grade performance tuning.

In my role at Infosys Ltd, I’ve delivered enterprise regulatory workloads (100–200 GB per cycle) with a strong focus on reliability and execution efficiency. For Basel III regulatory reporting, I built Bronze–Silver–Gold Lakehouse pipelines, implemented incremental ingestion and historical tracking, and reduced execution time by 30% through partitioning and file compaction.

I also drive end-to-end data engineering across modernization and consolidation initiatives. I consolidated multi-source banking data into an ADLS-backed Lakehouse with PySpark and Delta tables, and I migrated on-prem Hadoop data to Azure using AzCopy and ADF—automating workflows and reducing manual effort by 60%. I’m motivated by building governed, maintainable systems that keep data accurate through validation and reconciliation.

Experience

Work history, roles, and key accomplishments

IL
Current

Azure Data Engineer

Jan 2022 - Present (4 years 4 months)

Built Azure Databricks/ADF data pipelines for regulatory reporting, processing 100–200 GB per cycle using a Delta Lake Bronze–Silver–Gold lakehouse architecture. Implemented incremental ingestion with SCD Type 2 (MERGE), optimized Spark with partitioning/file compaction to reduce execution time by 30%, and automated workflows to cut manual effort by 60%.

Education

Degrees, certifications, and relevant coursework

Chaitanya Bharati Institute of Technology logoCT

Chaitanya Bharati Institute of Technology

Bachelor of Engineering, Electrical and Electronics Engineering

Bachelor of Engineering in Electrical and Electronics Engineering from Chaitanya Bharati Institute of Technology, Hyderabad.

Tech stack

Software and tools used professionally

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan