Open to opportunities

Adithya Nelanoothula

@adithyanelanoothula

Message

Cloud Data Engineer with 3 years building scalable Azure ETL pipelines for healthcare data.

India

Message

What I'm looking for

I’m looking for a cloud-first data engineering role where I can build reliable, scalable ETL pipelines with strong governance, optimize Delta Lake performance, and own incremental data processing end to end.

I’m a Cloud Data Engineer with 3 years of experience building scalable, production-grade ETL pipelines using Azure Data Factory, Azure Databricks, PySpark, and SQL. I develop end-to-end data pipelines for healthcare BI reporting and data science, processing 45–50 GB/day and delivering reliable data through Medallion Architecture with Parquet and Delta formats.

I focus on performance, resilience, and governance: I improved pipeline performance by 40% using Spark optimizations (partitioning, caching) and Delta Lake features such as OPTIMIZE, VACUUM, and Time Travel—while reducing storage costs. I also decommissioned ∼130 Airflow DAGs to Azure Data Factory and Azure Databricks, designed incremental processing using watermarking, implemented data validation and data quality checks, and used Unity Catalog for centralized data governance and fine-grained access control.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Tata Consultancy Services

Jun 2023 - Present (3 years)

Developed and maintained end-to-end ETL pipelines in Azure Data Factory and Azure Databricks processing 45–50 GB/day of healthcare data for BI and data science use cases. Improved pipeline performance by 40% using Spark and Delta Lake optimizations, and decommissioned ~130 on-prem Airflow DAGs to increase scalability and resilience.