Open to opportunities

Jay Prakash Singh

@jayprakashsingh

Message

Experienced Data Engineer specializing in ETL and cloud solutions.

India

Message

What I'm looking for

I am looking for a role that offers opportunities for growth, collaboration, and innovative data solutions.

I am a dedicated Data Engineer with over 3.4 years of experience in Azure Data Engineering and 4.5 years in ETL development and testing. My expertise lies in designing, building, and managing large-scale ETL pipelines and cloud data solutions, primarily using Azure Data Factory and Informatica Power Center. I am passionate about optimizing data workflows and ensuring data quality, which has allowed me to implement best practices for data governance and cloud migration.

Throughout my career, I have successfully developed and implemented end-to-end data pipelines for various domains, including healthcare and power management. My key achievements include migrating 7 TB of data to Azure with zero critical downtime and improving ETL performance by 20% post-migration. I thrive in collaborative environments, working closely with data engineers and analysts to deliver tailored solutions that meet business needs.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

HCL Tech

Jan 2025 - Present (6 months)

Developed and implemented end-to-end data pipelines using Azure Data Factory and Azure Databricks to extract, transform, and load data. Wrote complex SQL queries to retrieve and manipulate data from databases, and utilized Python for scripting and automation tasks related to data processing and analysis.

Azure Data Factory Databricks SQL Python Data Pipelines Data Quality Troubleshooting

Data Engineer

Harman Connected Services

Dec 2022 - Jan 2025 (2 years 1 month)

Developed and maintained scalable ETL/ELT pipelines using Azure Data Factory and Databricks for enterprise data solutions. Ingested, transformed, and loaded structured and semi-structured data from multiple sources into Azure Data Lake and Azure SQL Database.

Azure Data Factory Databricks ETL Data Lake Azure SQL Database SQL Data Migration Performance Tuning

Azure Data Engineer (Associate Role)

Harman Connected Services

Mar 2022 - Nov 2022 (8 months)

Supported ETL development activities by building ADF pipelines and validating datasets in Azure SQL Database. Automated data validation and monitoring scripts using Python, improving pipeline reliability and ensuring accurate data transformation.

Azure Data Factory Azure SQL Database Python Data Validation Data Quality ETL Processes Data Governance Technical Documentation

ETL Developer

KECIL

Sep 2017 - Feb 2022 (4 years 5 months)

Assisted in the development and support of ETL processes for data warehousing initiatives, including writing complex SQL queries and stored procedures for data extraction, validation, and reporting. Involved in writing and executing test cases, running ETL jobs, and logging defects in QC.

ETL Processes Data Warehousing SQL Data Validation

Education

Degrees, certifications, and relevant coursework

Annamalai University

Bachelor of Engineering, Electrical and Electronics Engineering

Grade: 8.44 CGPA

Completed a Bachelor of Engineering in Electrical and Electronics, focusing on core engineering principles. Achieved a CGPA of 8.44, demonstrating strong academic performance in the field.

BSEB

Intermediate, Science (PCM)

Grade: 60%

Completed Intermediate education with a focus on Physics, Chemistry, and Mathematics (PCM). Achieved 60% marks, building a foundational understanding in science and mathematics.