Skip to main content
Prasanth KumarPK
Open to opportunities

Prasanth Kumar

@prasanthkumar2

Senior data engineer building distributed GCP/Databricks platforms for faster, cheaper, correct pipelines at TB scale.

India
Message

What I'm looking for

I’m looking for a team where I can design and migrate distributed data platforms on GCP/Databricks—building incremental, idempotent pipelines with strong orchestration and auditability that reduce latency and cost without breaking correctness.

I’ve spent 7+ years designing distributed data platforms on GCP and Databricks for teams at UPS, Ford, Mondelez, Loblaws, and Micron. I focus on the trade-offs that actually matter—streaming vs. batch, cost vs. latency, and correctness vs. throughput—especially for entity resolution, deduplication, and distributed skew handling at TB scale.

At UPS, I architected multi-source marketing ingestion into BigQuery, unifying Google Ads and Meta Ads behind a single incremental framework that handles quotas, auth, backfill limits, and schema drift. I also built a chain-of-custody dispute resolution system that correlates customer disputes with delivery scan events and proof-of-delivery imagery, using Databricks PySpark/Spark SQL plus Python services on GCP for idempotent re-runs and full auditability.

Before that, I led migrations into BigQuery for Mondelez, collapsing data-availability latency from hours to minutes using a hybrid of parallel batch ingestion and Pub/Sub-driven streaming. I’ve also migrated large Teradata and on-prem Spark workloads into BigQuery/Dataproc, reworking joins, window functions, and orchestrations in Cloud Composer to cut processing time, runtime, and cost while keeping pipelines safely re-runnable through replays and schema drift.

Experience

Work history, roles, and key accomplishments

Emids logoEM

Senior Data Engineer

Emids

Mar 2023 - May 2023 (2 months)

Built Cloud Functions-based event-driven ingestion components and developed BigQuery SQL transformations for analytical datasets.

Education

Degrees, certifications, and relevant coursework

UT

Usha Rama College of Engineering & Technology

Bachelor of Technology, Electronics & Communication Engineering

2015 - 2019

Bachelor of Technology in Electronics & Communication Engineering from Usha Rama College of Engineering & Technology, Vijayawada, from 2015 to 2019.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan