shrey bhatt

I’m a Data Engineer with 3+ years of experience independently owning data pipelines end-to-end, with a focus on reliable performance and secure access for reporting. I’ve implemented Object-Level Security for supply chain reporting and designed pipelines that keep downstream teams unblocked.

At Accenture, I architected a production Azure Databricks pipeline (sole engineer) processing up to 5M rows daily and built 20+ production SQL views powering 35+ supply chain business reports. I optimize join strategies and filter pushdowns to reduce cloud compute costs and improved dashboard refresh times by up to 70%.

I also led migration of business-critical supply chain reporting views from SAP HANA to Azure by redesigning view logic for platform-specific edge cases, and built an SAP BODS ETL pipeline moving 100K+ records daily from SQL Server to SAP HANA. I’ve supported production stability through on-call rotation and resolved SLA breaches ranging from same-day to multi-day resolutions.

Beyond production work, I built a real-time streaming platform portfolio project using Kafka, Spark Structured Streaming, and Delta Lake. I designed a medallion Delta Lake pipeline with checkpointing and idempotent writes, achieving sub-2-minute end-to-end latency and powering dashboards with Star Schema modeling and SCD Type 2 dimensions.