Open to opportunities

MS Iqbal

@msiqbal

Message

Principal Data Engineer and Multi‑Cloud Solutions Architect specializing in governance and scalable Lakehouse systems.

United States

Message

What I'm looking for

I seek senior engineering or architecture roles building secure, compliant multi‑cloud data platforms with strong governance, real‑time capabilities, and opportunities to mentor teams.

I am a Principal Data Engineer and Multi‑Cloud Solutions Architect with 8+ years building enterprise, regulated data ecosystems across Azure, AWS, and GCP. I specialize in Data Lakehouse architectures (Databricks, Snowflake, Synapse), real‑time streaming (Kafka, Kinesis), and rigorous data governance.

I have driven measurable results including a 50% cost reduction through Spark performance tuning and a 40% reduction in data latency for critical reporting platforms. I design and implement secure, compliant solutions—integrating Microsoft Purview, Collibra, and Apache Atlas—to meet HIPAA, GDPR and other regulatory requirements.

I bring hands‑on expertise across cloud platforms, ETL/streaming tools, and data modeling, and I mentor teams while delivering productionized, observable pipelines and cost‑optimized architectures that enable trusted analytics and operational efficiency.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Confiz

Aug 2024 - Present (1 year 4 months)

Architected enterprise ELT pipelines and Lakehouse solutions on Azure Synapse and Databricks, reducing data latency by 40% and cutting Azure compute costs 50% through Spark tuning. Led real-time ingestion with Kafka and enforced GDPR/HIPAA-compliant data governance via Microsoft Purview.

Azure Synapse Databricks Spark Kafka Azure Data Factory Microsoft Purview Delta Lake Data Governance

Data Analytics Specialist

CureMD

Nov 2022 - Jun 2024 (1 year 7 months)

Engineered dimensional data models and automated ingestion pipelines for financial analytics, improving complex query response times by 35% and delivering executive Tableau dashboards for investment decision-making. Implemented metadata-driven governance for audit readiness.

Dimensional Models Python SQL Tableau Metadata Management Performance Tuning REST APIs

Data Solutions Architect

Zennify

Feb 2019 - Oct 2022 (3 years 8 months)

Designed scalable Data Lake and hybrid cloud warehousing solutions using Hadoop, Spark, AWS Redshift and Azure Synapse for >50TB datasets, reduced operational errors 30% via automated NiFi/Airflow workflows, and implemented Data Quality-as-Code with Great Expectations.

Hadoop Apache Spark AWS RedShift Azure Synapse Apache NiFi Airflow Great Expectations Data Lake

Associate Data Engineer

Tkxel

Aug 2016 - Dec 2018 (2 years 4 months)

Supported ETL development with Talend and Python, aided migration of on-prem SQL Server to AWS Redshift to improve scalability, and implemented data validation and CI/CD scripting to raise dataset reliability.