Himanshu Gupta

I am an Azure-certified Lead Data Engineer with over 9 years of experience in designing and implementing scalable data solutions across cloud platforms, including Azure and GCP. My expertise lies in ETL development using Informatica and Azure Data Factory, real-time data processing, and building secure, high-performance data pipelines. I have a proven track record of leading cross-functional teams in Agile environments, delivering end-to-end data solutions that align with business objectives.

In my current role at A.P. Moller Maersk, I lead a Master Data Management project focused on Customer Master Data, where I designed and implemented Data Quality metrics. My efforts have enabled actionable insights through dashboards and automated alerts for data anomalies. I have developed scalable solutions for data lakes and warehouse systems, collaborating with stakeholders to gather requirements and deliver data integration pipelines from diverse sources. My commitment to best practices in data security and governance has established robust data quality standards and lineage tracking.

Throughout my career, I have achieved significant milestones, such as reducing pipeline SLA from 3 days to 4 hours through ETL automation and saving ~$5000/month via Spark job optimization. I am passionate about mentoring junior engineers and continuously improving data integration best practices, ensuring high data transparency and quality in all projects I undertake.