AP

Looking for a job

Ankit Pandey

@ankitpandey15

Data Engineer at Infosys Limited who migrated AWS Glue workloads to Azure Databricks and built metadata-driven pipelines.

At Infosys Limited, I migrated AWS Glue/PySpark workloads to Azure Databricks Notebooks and Workflows, preserving transformation logic against migration specifications. I also built metadata-driven pipelines that could be onboarded through configuration.

At TATA Consultancy Services Limited, I built ETL pipelines with Azure Data Factory and migrated workflows to Azure Databricks and ADLS Gen2. I improved pipeline performance by 30% through SQL query optimization, partitioning, and caching, and earned the Microsoft Certified: Azure Data Engineer Associate certification.

Experience

Work history, roles, and key accomplishments

IL

Senior Associate Consultant - Data Engineer

Infosys Limited

Jul 2025 - Oct 2026 (1 year 3 months)

Migrated AWS Glue/PySpark workloads to Azure Databricks and built metadata-driven pipelines. Delivered end-to-end pipelines from DEV through CI/CD to SIT and PROD.

Python PySpark SQL AWS Glue S3 Azure Databricks Databricks Workflows Delta Lake CI CD Claude AI

TL

System Engineer - Data Engineer

TATA Consultancy Services Limited

Dec 2021 - Jul 2025 (3 years 7 months)

Built and automated ETL pipelines using Azure Data Factory and migrated workflows to Azure Databricks. Developed curated Silver-layer Delta tables and improved pipeline performance by 30%.

Python PySpark SQL Azure Data Factory ADLS Gen2 Azure Databricks Delta Lake REST APIs GitHub Azure Key Vault

Education

Degrees, certifications, and relevant coursework

GU

Graphic Era Deemed to be University

Bachelor of Technology, Mechanical Engineering

2016 - 2020

Grade: 8.86/10

Bachelor of Technology in Mechanical Engineering from Graphic Era Deemed to be University, Dehradun, with a CGPA of 8.86/10.

AS

A.B.M Senior Secondary School

Senior Secondary (12th), General Studies

Grade: 80%

Completed Senior Secondary (12th) from A.B.M Senior Secondary School, Haldwani, with 80%.

AS

A.B.M Senior Secondary School

Secondary (10th), General Studies

Grade: 8.2/10

Completed Secondary (10th) from A.B.M Senior Secondary School, Haldwani, with a CGPA of 8.2/10.

IL

Infosys Limited

Infosys Certified: Databricks Analyst, Data Analytics

Earned the Infosys Certified: Databricks Analyst certification.

MI

Microsoft

Microsoft Certified: Azure Data Engineer Associate, Data Engineering

Earned the Microsoft Certified: Azure Data Engineer Associate certification.

Tech stack

Software and tools used professionally

Apache Spark

AWS Glue

Amazon S3

GitHub

PySpark

Databricks

Python

SQL

Delta Lake

Unity Catalog

REST APIs

Availability

Looking for a job

Location

India

Authorized to work in

Salary expectations

70k+ INR

Social media

Job categories

Skills

Data Engineering ETL Pipelines Cloud Migration Lakehouse Architecture

Data Pipeline Optimization

Data Validation CI CD Python PySpark SQL Databricks Azure Databricks Apache Spark Delta Lake AWS Glue

Interested in hiring Ankit?

You can contact Ankit and 600K+ other talented remote workers on Himalayas.

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!