Arpit Garg
@arpitgarg
Data Engineer with 5+ years building scalable Azure ETL/ELT pipelines and cloud analytics.
IndiaWhat I'm looking for
I’m a Data Engineer with 5+ years of experience designing and building scalable data platforms, ETL/ELT pipelines, and cloud-based analytics solutions. I specialize in Azure Data Factory, Azure Databricks, PySpark, SQL, and Azure Data Lake Storage Gen2, focusing on high-performance processing and reliable production delivery.
At NTT DATA, I designed and implemented 30+ Azure Data Factory pipelines to ingest data into ADLS Gen2 and built PySpark transformation jobs in Azure Databricks processing 20M+ records per day, reducing execution time by 35%. I’ve also supported 50+ ingestion pipelines across business domains through incremental loading, performance optimization, and robust monitoring/logging, while earlier roles strengthened my end-to-end ETL/ELT, data modeling, migrations to Azure SQL, and business-ready reporting with Power BI/Tableau.
Experience
Work history, roles, and key accomplishments
Data Engineer (LOTUS)
NTT DATA
Sep 2023 - Present (2 years 10 months)
Designed and implemented Azure Data Factory (ADF) pipelines to ingest data into Azure Data Lake Storage Gen2 (ADLS Gen2) and built PySpark transformations in Azure Databricks. Optimized large-scale processing (20M+ records/day) and implemented monitoring, logging, and error-handling for reliable production pipelines.
Data Engineer (New Quote Engine)
DataNoir Labs
Apr 2023 - Sep 2023 (5 months)
Built end-to-end ETL/ELT pipelines with Azure Data Factory (ADF) to automate data ingestion and transformation workflows. Developed scalable PySpark solutions in Azure Databricks and designed fact/dimension models to support BI reporting.
Data Engineer (SolutionAMS)
Metyis
Jan 2023 - Apr 2023 (3 months)
Designed and implemented scalable data architecture and built Azure Data Lake Storage Gen2 (ADLS Gen2) ingestion pipelines using ADF. Migrated on-premises databases to Azure SQL Database via automated ADF workflows and developed SQL automation processes for data consistency and synchronization.
Data Engineer (Customer 360)
Metyis
Jul 2022 - Dec 2022 (5 months)
Developed end-to-end ETL pipelines and data models to create a unified customer view for analytics and reporting. Processed and transformed large-scale datasets with Azure Databricks and PySpark and improved database performance via SQL query tuning and indexing.
Data Engineer (Market Pulse)
Optimus Information
Dec 2021 - May 2022 (5 months)
Processed 900,000+ records for trend analysis and delivered data-driven reports and executive dashboards. Built Power BI dashboards with drill-through/drill-down and performed data cleansing and transformations using SQL and Power Query to maintain data accuracy.
Education
Degrees, certifications, and relevant coursework
Chandigarh University
Master of Computer Applications (AI & ML), Artificial Intelligence and Machine Learning
2026 -
Pursuing a Master of Computer Applications with a focus on AI & ML from Chandigarh University. Program runs from January 2026 to December 2027.
Dr. B.R. Ambedkar University, Agra
Bachelor of Science, Computer Science
2018 - 2021
Activities and societies: Solved 1,000+ DSA problems on platforms like LeetCode and HackerRank; secured AIR 33 in a ZS Associates coding competition on InterviewBit; awarded a bronze medal in Week of Code 36 on HackerRank.
Earned a Bachelor of Science in Computer Science from Dr. B.R. Ambedkar University, Agra, from May 2018 to May 2021.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Skills
Interested in hiring Arpit?
You can contact Arpit and 90k+ other talented remote workers on Himalayas.
Message ArpitGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
