Skip to main content
PS
Looking for a job

Prathesh S

@pratheshs

Data Engineer at Accenture who rebuilt 8 ETL pipelines, tripling throughput and cutting nightly batch runtime to 90 minutes.

India
Message

At Accenture, I rebuilt 8 legacy ETL pipelines using PySpark and Hive/HDFS, tripling data throughput and cutting nightly batch runtime from 5 hours to 90 minutes.

For an enterprise pricing platform, I deployed Azure Data Factory pipelines that ingested 500M+ pricing records daily into ADLS Gen2. I also redesigned the Delta Lake medallion architecture, improving downstream query performance by 42% and reducing storage costs by 28%.

I built a PySpark ETL framework on Azure Databricks that processed 2TB+ per daily batch at 99.95% uptime. By tuning Spark workloads, I reduced processing time from 3 hours to 45 minutes.

In my Customer & Transaction Data Modernization project, I developed incremental loading and CDC pipelines with Delta Lake MERGE operations, reducing pipeline runtime by approximately 60%. I’m an immediate joiner.

Experience

Work history, roles, and key accomplishments

Education

Degrees, certifications, and relevant coursework

DC

DG Vaishnav College

Bachelor of Commerce, Corporate Secretaryship

2020 - 2023

Grade: CGPA: 7.5

Pursued a Bachelor of Commerce degree with a focus on Corporate Secretaryship, achieving a CGPA of 7.5.

Databricks logoDA

Databricks

Build Data Pipelines with Apache Spark Declarative Pipelines, Data Engineering

Completed the Build Data Pipelines with Apache Spark Declarative Pipelines certification.

Databricks logoDA

Databricks

Deploying and Monitoring Agent Applications, Data Engineering

Completed the Deploying and Monitoring Agent Applications certification.

Databricks logoDA

Databricks

Databricks Azure Databricks Platform Architect, Data Engineering

Completed the Databricks Azure Databricks Platform Architect certification.

Availability

Looking for a job

Location

India

Authorized to work in

Salary expectations

900k+ INR

Interested in hiring Prathesh?

You can contact Prathesh and 600K+ other talented remote workers on Himalayas.

Message Prathesh

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan