HarsimranJeet Singh

I’m an Azure Data Engineer with 3.5 years of hands-on experience building scalable ETL/ELT pipelines, data lakehouse solutions, and real-time streaming platforms on Microsoft Azure. I focus on production-grade reliability through data quality validation, incremental load strategies, and end-to-end monitoring.

In my current role at SDK Infotech Pvt. Ltd., I built an end-to-end Azure data lakehouse to unify SAP, Salesforce CRM, and SQL Server data. I designed 40+ parameterized Azure Data Factory pipelines, implemented SAP delta-load extraction with watermark-based incremental logic, and delivered a measurable 96% improvement in pipeline runtime (22 hours to under 50 minutes).

I also improved analytics performance and responsiveness by applying Azure Synapse optimization techniques (40–45% query performance improvement) and delivering real-time customer event streaming at 1M+ events/day with end-to-end latency under 30 seconds. My work includes Medallion Architecture (Bronze/Silver/Gold) with Delta Lake, CI/CD with Azure DevOps, and Power BI reporting used by 80+ business users.