MW

Looking for a job

Manoj Wagh

@manojwagh

Azure Data Engineer at Infosys building ETL pipelines that process 4–5 TB daily.

At Infosys Private Ltd, I design and develop end-to-end ETL pipelines using Azure Data Factory, Azure Databricks, PySpark, Azure Data Lake Gen2, and Azure Synapse Analytics, processing 4–5 TB of data daily across multiple projects.

I improved pipeline performance by 30% through incremental loads and partitioning, and automated workflows to reduce manual intervention by 40%. I also use Delta Lake features and Azure DevOps CI/CD to support reliable data ingestion and deployments.

Experience

Work history, roles, and key accomplishments

IL

Current

Azure Data Engineer

Current

Infosys Private Ltd

Sep 2022 - Present (4 years 2 months)

Designed and developed 15+ end-to-end ETL pipelines using Azure Data Factory, Databricks (PySpark), Azure Data Lake Gen2, and Azure Synapse Analytics, processing 4–5 TB of data daily. Implemented incremental data loads, partitioning strategies, and workflow orchestration to improve pipeline performance and reduce processing time by 30%.

Python SQL PySpark Spark SQL Azure Data Factory Azure Databricks Azure Synapse Azure DevOps Azure Data Lake Gen2 Blob Storage Azure SQL Storage Apache Hive Spark MapReduce Hadoop Delta Lake CI CD

Education

Degrees, certifications, and relevant coursework

DU

Dr. Babasaheb Ambedkar Marathwada University

Bachelor of Engineering, Engineering

2015 - 2018

Bachelor of Engineering degree from Dr. Babasaheb Ambedkar Marathwada University from 2015 to 2018.

Tech stack

Software and tools used professionally

Apache Spark

Apache Hive

Microsoft Azure

PySpark

Hadoop

Azure DevOps

Python

Git

SQL

Azure Blob Storage

Delta Lake

Availability

Looking for a job

Location

India

Authorized to work in

Salary expectations

560k+ INR

Social media

Job categories

Skills

Data Engineering ETL Development Data Pipeline Development Data Ingestion Data Processing Data Validation Data Cleaning Data Reconciliation Incremental Loading Workflow Orchestration CI CD Python SQL PySpark Spark SQL

Interested in hiring Manoj?

You can contact Manoj and 90k+ other talented remote workers on Himalayas.

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!