Fayaz shaik

I’m an Azure Data Engineer with 4 years of experience building end-to-end ETL/ELT pipelines on Azure Databricks, Azure Data Factory, and Delta Lake. I focus on scalable architectures, incremental processing, and strong data quality—so pipelines stay reliable as data grows.

At Infosys, I designed and developed scalable ETL pipelines that process daily records, and I built ingestion pipelines from Azure Data Lake Storage Gen2 and Azure SQL Database, reducing data latency by 35%. I implemented Medallion Architecture (Bronze, Silver, Gold) for structured transformations across 10+ data sources, and used Delta Lake for ACID-compliant processing and improved query performance.

I’m hands-on with Lakehouse architecture and declarative approaches, including Databricks Streaming Tables, Materialized Views, and Declarative Pipelines (SDP). I’ve also implemented incremental data loading to reduce pipeline run time, and integrated Azure Key Vault for secure credential management across pipeline services.

Beyond core engineering, I’ve supported automation—developing Python scripts to streamline 5+ manual workflows—and led a migration effort involving 100M+ records. I hold Microsoft certifications (AZ-900, DP-900, DP-700) and I bring a practical, quality-first mindset to every pipeline I build.