Dhanya Vangalapudi

I’m a results-driven Data Engineer with 3.6+ years of experience designing scalable data architectures and optimizing ETL workflows. I focus on reliability, data quality, and end-to-end delivery that helps stakeholders trust what they see.

At Insight Global, I implemented reconciliation logic between datasets to improve reporting accuracy and worked with business stakeholders to troubleshoot metric deviations and ensure consistent definitions. I also designed and optimized end-to-end pipelines for high-volume retail and services data, improving data freshness and reliability across enterprise dashboards.

Previously at NewsCorp, I developed and deployed DataFusion pipelines for seamless ingestion and improved processing efficiency by 30%. I created and optimized code for multiple Airflow DAGs (reducing debugging time by 60%), built custom Airflow operators to overcome file composition limits and cut processing time by 40%, and automated Dataform workflow execution to reduce DAG complexity by 50%.

I’m passionate about using cloud-native tools to modernize data workflows—at Searce, I migrated SQL Server and Snowflake to BigQuery, reducing migration costs by 30%, improving performance by 25%, and moving ~5TB within a tight 2-week timeline with zero data loss. I bring a hands-on approach to automation, monitoring, and continuous improvement, supported by Google Professional certifications in Data Engineering, Cloud Database Engineering, and Machine Learning.