apurva patil
@apurvapatil1
Senior Data Engineer specializing in GCP data pipelines, real-time streaming, and cloud migrations for enterprise teams.
What I'm looking for
I’m a Senior Data Engineer with 9+ years designing, building, and optimizing large-scale data pipelines and cloud-native solutions on GCP. I’m hands-on across BigQuery, Dataproc, Dataflow, Pub/Sub, Dataform, and Vertex AI, with deep strength in data modeling, data warehousing, and ETL/ELT pipelines.
I bring a strong customer-facing approach from 5+ years engaging European and US clients—gathering requirements, defining KPIs, and aligning data solutions to business objectives. I’ve led production-grade data platforms for global enterprises including Deutsche Telekom, AT&T, and McDonald’s.
In migration and architecture work, I’ve led end-to-end projects moving on-premise workloads to GCP, including a DBLC project migration from on-premise CDSW to GCP (Dataproc + Airflow) within 1 month. I also independently migrated to Dataform for improved structure and maintainability across hybrid deployment phases.
I focus heavily on security, performance, and measurable outcomes—proactively identifying and remediating PII risks during migrations to reduce exposure by 90%, and reducing pipeline runtime by 67% (from 1.5 hrs to 30 mins) through query optimization and incremental load strategies. I’m also certified as Google Professional Data Engineer (Dec 2024) and Google Gen AI Leader (Nov 2025).
Experience
Work history, roles, and key accomplishments
Led end-to-end migration of a DBLC project from on-premises CDSW to GCP (Dataproc + Airflow) within 1 month with zero production disruption and remediated PII risks, reducing data exposure by 90%. Designed and operated real-time streaming pipelines (Pub/Sub → Dataflow → BigQuery) processing millions of events/day and reduced pipeline runtime by 67% (1.5 hrs to 30 mins) via query optimization and i
Technical Lead
Merkle / Ugam
May 2019 - Feb 2022 (2 years 9 months)
Partnered with US clients (AT&T and Eileen Fisher) to gather data requirements, define platform scope, and design analytics solutions for campaign activation. Built BigQuery data models for a single customer view and implemented data flows using Palantir Foundry (PySpark + SQL) to move data from Google Cloud Storage into staging and Vertica for downstream consumption.
Developed and deployed Talend ETL jobs for GDAP, loading data from Teradata, Oracle, SQL Server, HDFS, and flat files into cloud-based data warehouses. Performed root-cause analysis for production issues by reviewing complex SQL queries, UNIX scripts, and ETL job behavior.
Education
Degrees, certifications, and relevant coursework
Pimpri Chinchwad College of Engineering, Nigdi
Bachelor of Engineering, Computer Engineering
2012 - 2016
Grade: 64.50%
Bachelor of Engineering in Computer Engineering at Pimpri Chinchwad College of Engineering (2012–2016), scored 64.50%.
Amrita Junior College, Nigdi
HSC (Higher Secondary Certificate)
2011 - 2012
Grade: 78.33%
HSC at Amrita Junior College, Nigdi (2011–2012), scored 78.33%.
Amrita Vidyalayam, Nigdi
SSC (Secondary School Certificate)
2009 - 2010
Grade: 92.73%
SSC at Amrita Vidyalayam, Nigdi (2009–2010), scored 92.73%.
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring apurva?
You can contact apurva and 90k+ other talented remote workers on Himalayas.
Message apurvaFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
