# Prathesh S

Prathesh S is a remote worker on Himalayas, Data Engineering Associate at Accenture, based in India.

Source: https://himalayas.app/@pratheshs

```text
Data Engineer at Accenture who rebuilt 8 ETL pipelines, tripling throughput and cutting nightly batch runtime to 90 minutes.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Salary expectations | 900k+ INR |
| Job categories | Data Engineer, Azure Data Engineer |
| Skills | ETL ELT Design, Azure Databricks, Azure Data Factory, PySpark, Apache Spark, Delta Lake, SQL, Data Modeling, Medallion Architecture, Incremental Loading, Change Data Capture, Delta MERGE (Upsert), Spark Optimization, Adaptive Query Execution (AQE), SQL Query Optimization |

## About

```text
At Accenture, I rebuilt 8 legacy ETL pipelines using PySpark and Hive/HDFS, tripling data throughput and cutting nightly batch runtime from 5 hours to 90 minutes.

For an enterprise pricing platform, I deployed Azure Data Factory pipelines that ingested 500M+ pricing records daily into ADLS Gen2. I also redesigned the Delta Lake medallion architecture, improving downstream query performance by 42% and reducing storage costs by 28%.

I built a PySpark ETL framework on Azure Databricks that processed 2TB+ per daily batch at 99.95% uptime. By tuning Spark workloads, I reduced processing time from 3 hours to 45 minutes.

In my Customer & Transaction Data Modernization project, I developed incremental loading and CDC pipelines with Delta Lake MERGE operations, reducing pipeline runtime by approximately 60%. I’m an immediate joiner.
```

## Experience

### Data Engineering Associate

[Accenture](https://himalayas.app/companies/accenture). Jul 2023 - Aug 2026

```text
Rebuilt legacy ETL pipelines on PySpark and Hive/HDFS, tripling data throughput and cutting nightly batch runtime from 5 hours to 90 minutes. Architected and deployed 15+ Azure Data Factory pipelines ingesting 500M+ pricing records daily, reducing data latency from 6 hours to under 45 minutes.
```

Skills: PySpark, Hive, HDFS, Azure-Data-Factory, ADLS-Gen2, Delta-Lake, Azure-Databricks, SQL, Azure-Event-Hub, Kafka, Medallion-Architecture, AQE, Z-Ordering, CI-CD

## Education

### DG Vaishnav College

Bachelor of Commerce, Corporate Secretaryship. 2020 - 2023. Grade: CGPA: 7.5

```text
Pursued a Bachelor of Commerce degree with a focus on Corporate Secretaryship, achieving a CGPA of 7.5.
```

### Databricks

Build Data Pipelines with Apache Spark Declarative Pipelines, Data Engineering

```text
Completed the Build Data Pipelines with Apache Spark Declarative Pipelines certification.
```

### Databricks

Deploying and Monitoring Agent Applications, Data Engineering

```text
Completed the Deploying and Monitoring Agent Applications certification.
```

### Databricks

Databricks Azure Databricks Platform Architect, Data Engineering

```text
Completed the Databricks Azure Databricks Platform Architect certification.
```

## Tech stack

- Azure Synapse
- Apache Spark
- Amazon S3
- PySpark
- Azure DevOps
- Python
- MLflow
- Apache NiFi
- Git
- SQL
- Delta Lake
- Microsoft Fabric
- Apache Kafka
- Model Context Protocol
- Microsoft 365 Copilot
- Azure Data Factory
- Azure Databricks

To contact Prathesh, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [ESWAR REDDY User](https://himalayas.app/@eswarreddyuser): Data Engineer, Capgemini
- [Sarang Deshmukh](https://himalayas.app/@sarangdeshmukh): Data Engineer, Tech Mahindra
- [Sameer Kumar](https://himalayas.app/@sameerkumar10): Software Engineer II, MAQ Software
- [praveena ballagudumula](https://himalayas.app/@praveenaballagudumul): Azure Data Engineer, Pace IT Solutions
- [Jyothsna User](https://himalayas.app/@jyothsnauser1): Azure Data Engineer, Accenture
- [Prasad Yaadv](https://himalayas.app/@prasadyaadv): Packaged App Development Senior Analyst, Accenture Solutions Ltd.
- [Saransh Jain](https://himalayas.app/@saranshjain3): Associate Consultant Data Engineer, Capgemini Technology Services
- [Hrushikesh Bhanji](https://himalayas.app/@hrushikeshbhanji): Senior Analyst – Data Engineer, Accenture Solutions Pvt. Ltd.
- [Sneha Peddamile](https://himalayas.app/@snehapeddamile): Data Engineering, Management & Governance Analyst, Accenture
- [Debarati Roy](https://himalayas.app/@debaratiroy): Data Eng, Mgmt. & Governance Analyst, Accenture
