# Prasanth Kumar

Prasanth Kumar is a remote worker on Himalayas, Senior Data Engineer at UPS, based in India.

Source: https://himalayas.app/@prasanthkumar2

```text
Senior data engineer building distributed GCP/Databricks platforms for faster, cheaper, correct pipelines at TB scale.
```

| Detail | Value |
| --- | --- |
| Availability | Open to opportunities |
| Location | India |
| Authorized to work in | Zimbabwe |
| Job categories | Senior Data Engineering, Data Engineer, Big Data Engineer, Streaming Data Engineer, Machine Learning Engineer, Data Engineering, Distributed Systems Engineer, Cloud Data Engineer, Data Platform Architect, Senior Data Engineer Jobs, Senior Data Engineer Positions, Senior Data Engineering Manager, Data Platform Engineer |
| Skills | Google Cloud Dataproc, Pub Sub, Event Driven Architecture, Exact Once Semantics, At Least Once Delivery Semantics, Incremental Idempotent Loads, Partitioning, Clustering, Isolation Forest, Python, SQL, PySpark, Apache Spark, Databricks, Apache Beam, Dataflow, BigQuery, Window Functions, Cloud SQL, Cloud Spanner, Google Cloud Storage, GCS, Airflow, Cloud Composer, DAG Design, Data Structures, Query Optimization, System Design, Watermarking, And Schema Evolution, Entity Resolution, Deduplication, Incremental Workloads, Cost Optimization, MySQL, fastAPI, Mapped, GitHub, Redis, PostgreSQL, Google Ads, Supabase, Beam |

## What I'm looking for

```text
I’m looking for a team where I can design and migrate distributed data platforms on GCP/Databricks—building incremental, idempotent pipelines with strong orchestration and auditability that reduce latency and cost without breaking correctness.
```

## About

```text
I’ve spent 7+ years designing distributed data platforms on GCP and Databricks for teams at UPS, Ford, Mondelez, Loblaws, and Micron. I focus on the trade-offs that actually matter—streaming vs. batch, cost vs. latency, and correctness vs. throughput—especially for entity resolution, deduplication, and distributed skew handling at TB scale.

At UPS, I architected multi-source marketing ingestion into BigQuery, unifying Google Ads and Meta Ads behind a single incremental framework that handles quotas, auth, backfill limits, and schema drift. I also built a chain-of-custody dispute resolution system that correlates customer disputes with delivery scan events and proof-of-delivery imagery, using Databricks PySpark/Spark SQL plus Python services on GCP for idempotent re-runs and full auditability.

Before that, I led migrations into BigQuery for Mondelez, collapsing data-availability latency from hours to minutes using a hybrid of parallel batch ingestion and Pub/Sub-driven streaming. I’ve also migrated large Teradata and on-prem Spark workloads into BigQuery/Dataproc, reworking joins, window functions, and orchestrations in Cloud Composer to cut processing time, runtime, and cost while keeping pipelines safely re-runnable through replays and schema drift.
```

## Experience

### Senior Data Engineer (current)

[UPS](https://himalayas.app/companies/ups-com). Apr 2026 - Present

```text
Architected multi-source marketing ingestion into BigQuery and designed a zero-touch delivery-dispute system on Databricks and GCP.
```

Skills: Python, PySpark, Databricks, BigQuery, GCP, Pub-Sub, Dataflow

### Senior Data Engineer

[Publicis Sapient](https://himalayas.app/companies/publicis-sapient). Mar 2025 - Mar 2026

```text
Led migration of 100+ enterprise tables to BigQuery for Mondelez and designed Databricks pipelines for Loblaws, implementing idempotent incremental loads and ID-resolution frameworks.
```

Skills: Python, SQL, PySpark, BigQuery, Azure-Databricks, Cloud-Composer, GCS, Pub-Sub, Dataflow, Apache-Beam

### Senior Data Engineer

[HCLTech](https://himalayas.app/companies/hcltech). Sep 2024 - Feb 2025

```text
Migrated 100+ Teradata tables to BigQuery using PySpark on Dataproc and built Cloud Composer DAGs for orchestration.
```

Skills: Python, SQL, PySpark, BigQuery, Cloud-Composer, Teradata

### Senior Data Engineer

[Ford Motor Company](https://himalayas.app/companies/ford). May 2023 - Aug 2024

```text
Re-architected Alteryx workflow into optimized BigQuery SQL, reducing processing time from 24 hours to ~20 minutes, and migrated on-prem Spark workloads to Dataproc.
```

Skills: Python, SQL, BigQuery, Cloud-SQL, Cloud-Composer, Cloud-Functions, PySpark, Oracle, SQL-Server, GCS

### Senior Data Engineer

Emids. Mar 2023 - May 2023

```text
Built Cloud Functions-based event-driven ingestion components and developed BigQuery SQL transformations for analytical datasets.
```

Skills: Python, SQL, BigQuery, Cloud-Functions, Oracle, GCP

### Data Engineer

[Micron Technology](https://himalayas.app/companies/micron-technology). Sep 2022 - Mar 2023

```text
Reduced Dataproc compute cost by ~50% through cluster tuning and built automated BigQuery ETL pipelines with anomaly detection using Isolation Forest.
```

Skills: Python, SQL, BigQuery, PySpark, Cloud-Functions, GCP, Isolation-Forest

### Data Engineer

[Tata Consultancy Services](https://himalayas.app/companies/tata-consultancy-services). Jul 2019 - Sep 2022

```text
Built reusable batch-ingestion frameworks loading PostgreSQL, MySQL, and Oracle data into BigQuery and Cloud SQL, and implemented near-real-time pipelines using Pub/Sub.
```

Skills: Python, SQL, BigQuery, Cloud-SQL, Pub-Sub, Cloud-Functions, Cloud-Spanner, Oracle, MySQL, PostgreSQL, GCS

## Education

### Usha Rama College of Engineering & Technology

Bachelor of Technology, Electronics & Communication Engineering. 2015 - 2019

```text
Bachelor of Technology in Electronics & Communication Engineering from Usha Rama College of Engineering & Technology, Vijayawada, from 2015 to 2019.
```

## Tech stack

- Apache Spark
- GitHub
- PySpark
- MySQL
- PostgreSQL
- Databricks
- Redis
- FastAPI
- Airflow
- Apache Beam
- Mapped
- SQL
- Google Ads
- Supabase
- Beam

To contact Prasanth, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Bhaskar Ch](https://himalayas.app/@bhaskarch): Senior Data Engineer, BlackBuck Insight
- [Piyush Mujavadiya](https://himalayas.app/@piyushmujavadiya): Lead Data Engineer, Apnatime Tech
- [Bhavya Budda](https://himalayas.app/@bhavyabudda): Senior Data Engineer, Amazon
- [Mohamed KARIM](https://himalayas.app/@mohamedkarim): Senior GCP Data Engineer, Servier
- [Misbah Yaseen](https://himalayas.app/@misbahyaseen): Snr. Data Engineer, PRYPCO
- [lahari Peddakotla](https://himalayas.app/@laharipeddakotla): Data Engineer, Versant Health
- [Apoorv Tyagi](https://himalayas.app/@apoorvtyagi): Data Engineer II, Amazon
- [Uzair Ahmad](https://himalayas.app/@uzairahmad4): Data Engineer, Infillion
- [Arunesh Tiwari](https://himalayas.app/@aruneshtiwari): Data Engineer, Bobble.ai
- [Prudhvi Bollepalli](https://himalayas.app/@prudhvibollepalli): Senior Data Engineer, TD Bank
