Tarun Mallepogu
@tarunmallepogu
I’m an Azure Data Engineer building scalable lakehouse pipelines that automate governed, high-throughput data platforms.
IndiaWhat I'm looking for
I’m a Data Engineer with 4.3 years of experience designing and implementing enterprise data solutions on the Microsoft Azure platform. I specialize in building scalable data pipelines using Azure Data Factory, Azure Databricks, and Spark SQL, while developing unified lakehouse architectures and optimizing Delta Lake storage for large-scale migrations.
I architect, build, and automate enterprise-scale cloud data platforms and distributed ETL/ELT pipelines, with strong focus on data governance and reliability. In my recent role, I delivered a multi-tier Delta Lakehouse on ADLS Gen2, improved processing times by 42%, and reduced cloud compute waste by $52,000 annually; I also implemented automated data validation checks with Great Expectations to reach 99.9% ingestion reliability.
Experience
Work history, roles, and key accomplishments
Azure Data Engineer
Indium Software
Jun 2023 - Present (3 years)
Architected and deployed a multi-tier Delta Lakehouse on ADLS Gen2, orchestrating the migration of 15+ legacy on-premise transactional sources. Built ADF-to-Databricks pipelines for 5+ TB daily logs, optimized PySpark with autoscaling to cut processing time by 42% and eliminate $52,000 annual cloud compute waste.
Data Engineer
Fractal Analytics
Apr 2022 - May 2023 (1 year 1 month)
Migrated a 400 GB on-premise MS SQL Server data warehouse to Azure Synapse Dedicated SQL Pool, improving analytical query performance by 3x. Developed Synapse SQL (including stored procedures), built SHIR-secured integrations and event-driven pipelines with Event Hubs and Databricks Structured Streaming, reducing dashboard load times by 35% and cutting downstream pipeline failures by 25%.
Education
Degrees, certifications, and relevant coursework
University of Mumbai
Bachelor of Science, Computer Science
Earned a Bachelor of Science in Computer Science from the University of Mumbai in 2022.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Skills
Interested in hiring Tarun?
You can contact Tarun and 90k+ other talented remote workers on Himalayas.
Message TarunFind your dream job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
