Looking for a job

Tapan Panchal

@tapanpanchal

Message

I build governed Azure and Databricks data pipelines for production systems and AI solutions.

Canada

Message

What I'm looking for

I'm looking to build production-grade data platforms and AI-ready pipelines, partnering with architects and stakeholders to turn evolving requirements into reliable, governed infrastructure.

At Cavallo Technologies, I build and operate Databricks and Azure Data Factory pipelines integrating relational systems, APIs, and ADLS Gen2 through CDC-based incremental loads processing 1M+ records daily. I also shipped an internal LLM-powered tool that validates structured outputs before downstream use.

Previously at Tata Consultancy Services, I migrated a regulated banking warehouse to Databricks ELT, reducing batch refreshes from six hours to under two. I build reliable, governed data platforms with Python, SQL, PySpark, Airflow, Unity Catalog, automated validation, and CI/CD.

Experience

Work history, roles, and key accomplishments

Data Engineer

Cavallo Technologies Inc

Sep 2025 - Apr 2026 (7 months)

Designed and operated production data pipelines on Databricks and Azure Data Factory, integrating multiple source systems and APIs. Built an internal AI-powered tool and implemented data quality frameworks, reducing production incidents and batch runtimes.

Databricks Azure Data Factory Python SQL PySpark Unity Catalog Delta Lake CI CD GitHub Actions Docker React LLM

Data Engineer

Tata Consultancy Services

Aug 2021 - Jul 2024 (2 years 11 months)

Delivered professional-services engagements for a regulated banking client, migrating an on-premises SQL Server warehouse to Databricks ELT pipelines. Built ingestion from REST and Webhook APIs, orchestrated workflows in Apache Airflow, and implemented monitoring and alerting.