I'm building scalable ETL pipelines and analytics-ready datasets at Shauryatechnosoft Pvt Ltd, transforming relational data for reporting and business requirements.
I've designed reusable, parameterized SQL workflows, developed stored procedures, and strengthened downstream reliability through data validation, quality, and consistency checks. I store transformed Silver and Gold layer datasets in ADLS Gen2 using Delta Lake partitioning and schema enforcement.
In a retail sales analytics project, I built a metadata-driven, watermark-based incremental loading framework in Azure Data Factory and processed data through Bronze, Silver, and Gold layers with Azure Databricks and PySpark. I also monitor pipeline outcomes and troubleshoot failed data loads.
