Open to opportunities

Pathaneni Gangothri

@pathanenigangothri

Message

Data Engineer building scalable Azure/AWS data pipelines with PySpark, SQL, and lakehouse reliability.

India

Message

What I'm looking for

I’m looking for a cloud-based data engineering role where I can build reliable lakehouse ETL/ELT pipelines with PySpark and SQL, improve performance, and apply strong data quality/governance. I enjoy collaborating with stakeholders to deliver production-grade outcomes.

I’m a Data Engineer with 3.5+ years of experience designing, building, and optimizing scalable data pipelines and ETL/ELT workflows using PySpark, SQL, and Azure Databricks. I focus on high-volume batch processing and near real-time pipelines, with performance tuning and reliability as non-negotiables.

At Accenture, I processed 10M+ records daily, improved Spark job performance by 25%, and migrated 40+ ADF pipelines to Databricks—reducing execution time by 30%. I build and support lakehouse architectures with ADLS and Databricks, deliver production-grade SQL transformations, and ensure data quality through validation, governance, and monitoring across the full pipeline lifecycle.

Experience

Work history, roles, and key accomplishments

Current

Data Engineering Analyst

Current

Accenture

Dec 2022 - Present (3 years 6 months)

Processed 10M+ records daily using PySpark pipelines in Databricks and improved Spark job performance by 25% through partitioning and caching. Migrated 40+ ADF pipelines to Databricks, reducing execution time by 30%, and built lakehouse-based ETL/ELT workflows with robust orchestration, logging, and data quality validation.

Pyspark SQL Azure Databricks ETL Performance Tuning Data Quality

Education

Degrees, certifications, and relevant coursework

Birla Institute of Technology and Science, Hyderabad

Master of Science, Data Science and Artificial Intelligence

2025 -

Currently pursuing an MSc in Data Science and Artificial Intelligence at BITS Hyderabad (Aug 2025–Aug 2027) alongside full-time work.

Bhavans Vivekananda College

Bachelor's degree, Mathematics, Statistics, Computer Science

2019 - 2022

Grade: CGPA 9.78

Completed a Bachelor's degree with focus in Mathematics, Statistics, and Computer Science at Bhavans Vivekananda College (Jun 2019–Jul 2022), achieving CGPA 9.78.