Shreyas Giri

I’m a motivated, experienced Data Engineer with over 2+ years of experience designing and implementing efficient data pipelines that help companies meet and exceed projected expectations.

At IBM as a Senior Data Engineer, I’ve migrated and optimized data from Azure SQL Database to Delta Lake using Databricks (Spark, PySpark), automating ingestion and denormalizing for performance. I enhanced data ingestion with scalable, file-based pipelines in ADF using dynamic metadata.

I focus heavily on data governance, performance, and delivery velocity—improving Databricks performance and cost-efficiency, implementing governance/security with Unity Catalog and Purview, and establishing Azure Databricks CI/CD pipelines with Azure DevOps.

Previously at Accenture as a Data Engineer, I engineered a highly available (99.8% uptime) pipeline using ADF to ingest and process streaming and transactional data. I built a scalable Azure architecture integrating Databricks (Spark SQL, Spark Streaming), ADF, SQL Data Warehouse, Event Hubs, and Stream Analytics for real-time insights, and delivered business intelligence through interactive Tableau dashboards backed by Azure SQL Data Warehouse.