Pradeep Yarlagadda
@pradeepyarlagadda
Senior data engineering leader specializing in scalable cloud data platforms and governance.
What I'm looking for
I am a results-oriented senior data engineering leader with 15+ years of experience architecting and delivering enterprise-scale data solutions across technology and life sciences domains.
I have led global engineering teams to design and scale high-volume ETL/real-time pipelines, optimizing Spark jobs and cloud-native architectures to improve reliability, reduce costs, and deliver measurable business value.
My work includes instituting automated data governance, metadata and lineage tracking, and monitoring frameworks that reduced data defects by 35% and improved incident response and audit readiness.
I mentor engineers, drive cross-functional collaboration with analytics and product teams, and consistently enable data-driven decisions through scalable, compliant platforms.
Experience
Work history, roles, and key accomplishments
Senior Data Engineering Manager
Meta
Nov 2024 - Present (11 months)
Lead a global data engineering team of 15+ engineers to design and scale ad-data pipelines processing 500M+ daily events with <1% failure rate, instituted automated data governance and reduced data defects by 35%.
Data Engineering Manager
Meta
Feb 2021 - Oct 2024 (3 years 8 months)
Managed distributed teams building cloud-native Spark and Airflow pipelines supporting billions of ad impressions, improved query throughput by 40% and cut cloud compute costs by 20%.
Senior Data Engineer
Meta
Jul 2018 - Jan 2021 (2 years 6 months)
Designed distributed ETL systems processing billions of ad impression records daily, migrated workloads to AWS/GCP and improved observability to reduce incident response times by 30%.
Led data engineering for enterprise warehouses supporting clinical trials, migrated clinical datasets to cloud increasing storage efficiency by 35% and reduced FDA submission timelines by 15%.
Developed enterprise ETL frameworks in SQL and Spark improving pipeline efficiency by 30% and automated monitoring to reduce data errors by 40%.
Business Intelligence Consultant
Novo Nordisk
Jun 2009 - Mar 2010 (9 months)
Implemented ETL solutions to automate pharmaceutical operations reporting, enabling near real-time insights and improving analytics responsiveness.
Summer Intern
Cyient
Jun 2008 - Aug 2008 (2 months)
Supported ETL development, data validation and dashboard creation for enterprise datasets, ensuring accurate reporting and smooth handover to engineering teams.
Education
Degrees, certifications, and relevant coursework
Arizona State University
Master of Science, Electrical & Computer Engineering
2007 - 2009
Completed a Master of Science in Electrical and Computer Engineering focusing on advanced topics relevant to data engineering and systems.
International Institute of Information Technology, Hyderabad
Bachelor of Technology, Electronics & Communications
2003 - 2007
Completed a Bachelor of Technology in Electronics and Communications with coursework supporting foundational engineering and signal processing skills.
Availability
Location
Authorized to work in
Job categories
Interested in hiring Pradeep?
You can contact Pradeep and 90k+ other talented remote workers on Himalayas.
Message PradeepFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
