Looking for a job

abhishek kumar

@abhishekkumar132

Azure Data Engineer at Tech Mahindra building Databricks ingestion frameworks and migrating Teradata warehouses to a Lakehouse.

India

Message

At Tech Mahindra, I developed and maintained a production-grade, YML-driven near-real-time ingestion framework on Azure Databricks. I also migrated Teradata Data Warehouse tables to a Databricks Lakehouse and built curated Silver and Gold Delta tables.

At Infosys, I built ELT pipelines with Azure Data Factory and created document extraction pipelines using Python, PySpark, and Azure Databricks. I integrated Azure Cognitive Services and Document Intelligence for PII masking and tabular data extraction, and hold the Databricks Certified Data Engineer Professional certification.

Experience

Work history, roles, and key accomplishments

Current

Software Engineer - Azure Data Engineer

Current

Tech Mahindra

Jan 2025 - Present (1 year 9 months)

Developed and maintained production-grade ingestion frameworks on Azure Databricks, automated Liquid Clustering, and migrated Teradata to Lakehouse. Upgraded Databricks runtime and monitored Airflow DAGs.

Azure Databricks PySpark Python SQL Delta Lake Auto Loader Spark Structured Streaming Databricks Asset Bundles CI CD Airflow DBT Liquid Clustering

Azure Data Engineer

Infosys

Sep 2021 - Jan 2025 (3 years 4 months)

Designed extraction pipelines for PDFs and REST APIs, built ELT pipelines in Azure Data Factory, and integrated Azure Cognitive Services for PII masking. Optimized PySpark workflows and applied Agile delivery with Azure DevOps.