Open to opportunities

Ayush Shrivastava

@ayushshrivastava2

Message

Senior Data Engineer building scalable ETL pipelines and cloud data platforms for analytics.

India

Message

What I'm looking for

I’m looking for advanced data engineering assignments where I can design metadata-driven Azure/Databricks ETL pipelines, improve reliability and performance, and deliver analytics-ready datasets with strong data quality and automation.

I’m a Data Engineer with over 4 years of experience building scalable ETL pipelines and cloud-based data solutions. I focus on data transformation, data modeling, and data quality to deliver analytics-ready datasets.

In my current role at Tiger Analytics, I develop reliable, production-grade pipelines using Databricks, Azure Data Factory, Python, SQL, Spark, and PySpark. I’ve built metadata-driven ADF pipelines with automated scheduling (ADF Triggers) to reduce failure rates and orchestrated workflows using Databricks Workflows and Asset Bundles.

I also strengthen performance and monitoring—optimizing Spark jobs (repartitioning and broadcast joins) to reduce processing time by 20%, and stabilizing execution through Delta/Table optimization. With a Databricks Data Engineer Associate certification, I help ensure data integrity and on-time delivery across multiple projects.

Experience

Work history, roles, and key accomplishments

Current

Senior Software Engineer

Current

Tiger Analytics

Jan 2022 - Present (4 years 5 months)

Built metadata-driven Azure Data Factory and Databricks pipelines with automated scheduling and monitoring to reduce pipeline failure rates and improve reliability. Optimized Spark workloads (repartitioning and broadcast joins), reducing Spark processing time by 20% and supporting analytics-ready KPI datasets.