Open to opportunities

Ayush Patil

@ayushpatil

Message

I build scalable data pipelines that accelerate analytics and platform migrations.

India

Message

What I'm looking for

I'm looking to build scalable, reliable data platforms and analytics pipelines using Azure, Microsoft Fabric, PySpark, and SQL, while contributing to modernization, migration, data quality, and efficient BI-ready data models.

At Accordion India, I build cross-platform data pipelines that move and transform Snowflake data into Microsoft Fabric Lakehouse for reliable reporting-layer consolidation.

I've architected incremental loading during a DRB-to-Pantheon migration, reducing refresh time from six hours to 2.5 hours. I also optimized PySpark workflows from 60 minutes to 20 minutes while building scalable pipelines for structured and semi-structured data.

My work includes modernizing legacy PHP transformations into PySpark and SQL, with schema validation, data cleansing, incremental handling, and standardized validation checks across datasets.

I've also built Bronze-Silver-Gold ETL platforms using Azure Data Factory, Databricks, PySpark, and GitHub REST APIs, including watermark-based ingestion, SCD Type 1 updates, and analytics-ready fact and dimension models.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Accordion India

Aug 2025 - Present (1 year)

Architected an incremental data loading pipeline during a DRB-to-Pantheon platform migration, reducing data refresh time from 6 hours to 2.5 hours (58% reduction). Developed end-to-end cross-platform data pipelines to ingest and transform datasets from Snowflake into Microsoft Fabric Lakehouse, enabling reliable data consolidation across reporting layers.