Nainesh Sami

I’m an experienced Azure Data Engineer with 2.6 years of building and maintaining scalable ETL/ELT solutions on Microsoft Azure across Healthcare and Banking data domains. I translate business needs into reliable, production-grade pipelines that power analytics and reporting.

In my recent role, I implemented end-to-end data pipelines using Azure Data Factory and Azure Databricks to ingest multiple sources into Azure Data Lake Storage Gen2. I built and maintained a Medallion Architecture (Bronze, Silver, Gold) with Delta Lake to deliver high-performance, high-quality datasets for analytics and reporting.

I optimize pipelines with incremental loading using watermarking, Change Data Capture (CDC), and Delta Lake MERGE operations to reduce cost and improve processing time. I also tune Spark jobs with partitioning, caching, broadcast joins, and file size adjustments, while leveraging columnar formats like Parquet/Delta and proper partitioning strategies for better storage and query performance.

I strengthen data reliability through data quality frameworks with validation rules, schema enforcement, and anomaly detection. I implement monitoring, logging, and alerting using Azure Monitor, Log Analytics, and Databricks job monitoring, and I align security with Azure Key Vault and enterprise CI/CD practices via Azure DevOps. I’m actively seeking a challenging data engineering role to build robust, cloud-native data solutions in a product-driven environment.