Prabha Ramureddi

I’m an Azure Data Engineer with 5+ years of experience designing, developing, and optimizing enterprise-scale data platforms and ETL/ELT solutions. I specialize in Azure Data Factory, Azure Databricks, PySpark, Spark SQL, and SQL Server, building reliable pipelines that teams can depend on.

In my current role, I designed metadata-driven Azure Data Factory pipelines integrating data from 70+ business source systems within a Medallion Architecture framework. I also developed and maintained Databricks and PySpark workflows processing 1+ TB across ingestion, transformation, and reporting layers.

I take end-to-end ownership: I’ve been the primary data engineer for business-critical source systems, handling development, deployment, monitoring, and production support. I resolved 100+ production pipeline issues through root-cause analysis and preventive measures, improving operational stability by 20%.

I’m also focused on data correctness and maintainability—implementing SCD Type 1 & Type 2 logic, building data validation, and supporting governance practices. I’ve mentored junior engineers, and I leverage tools like Microsoft Copilot to diagnose PySpark errors faster, reducing debugging effort by 30% while delivering scalable cloud-based data solutions.