Looking for a job

Himanshu Shekhar

@himanshushekhar3

Data Engineer at Tech Mahindra building Azure pipelines that migrated 500K+ OSS/BSS records with zero data loss.

At Tech Mahindra Limited, I designed and maintained 20+ Azure Data Factory pipelines to migrate 500K+ OSS/BSS records with zero data loss. I also developed PySpark workflows on Azure Databricks using Delta Lake and Medallion Architecture.

I engineered an incremental load framework and a four-layer data quality framework that reduced data errors by 60%. I also implemented CI/CD pipelines with Azure DevOps and Git.

For an internal Tech Mahindra hackathon, I developed a customer churn prediction pipeline that achieved 85% prediction accuracy and built Power BI dashboards to show churn trends. Earlier, at XenonStack, I supported cloud data workflows and developed Python and SQL scripts for processing, validation, and ETL tasks.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Tech Mahindra

Sep 2023 - Present (3 years)

Migrated 500K+ OSS/BSS records with zero data loss by designing and maintaining 20+ Azure Data Factory pipelines for automated ETL into ADLS Gen2. Developed PySpark transformation workflows on Azure Databricks using Delta Lake and Medallion Architecture, and implemented CI/CD pipelines with Azure DevOps.

Azure Data Factory ADLS Gen2 Azure Databricks PySpark Delta Lake Medallion Architecture ETL Data Migration Data Quality CI CD Azure DevOps Git azure monitor Log Analytics

PlatformOps Eng. (Data Focused)

XenonStack

Jan 2023 - Aug 2023 (7 months)

Worked with AWS services including S3, EC2, and Lambda to support cloud-based application and data processing workflows. Developed Python and SQL scripts for data processing, database operations, validation, and ETL tasks, and used Excel for data analysis and reporting.