Looking for a job

Kaustubh Bhat

@kaustubhbhat

Message

Lead Data Engineer at HP Inc. who migrated 100+ tables from AWS Redshift to Databricks Unity Catalog.

India

Message

At HP Inc., I led a six-member India Data Engineering team and coordinated delivery across teams and stakeholder groups.

I designed and developed an automated finance data reconciliation solution that transformed a complex process from weeks to hours, reducing manual effort and turnaround time.

I led the migration of 100+ tables and ETL workloads from AWS Redshift to Databricks Unity Catalog (Delta Lake), supporting platform modernization and downstream continuity.

Previously, at Deloitte India, I migrated incremental and historical data to Azure Synapse, reducing load times by up to 50%. At Mu Sigma, I optimized ETL workflows and helped reduce bug resolution time by 60% through a unified monitoring platform.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

HP Inc.

Aug 2022 - Present (4 years 2 months)

Led a 6-member data engineering team, driving scrums and delivery while coordinating dependencies across multiple teams. Designed an automated finance data reconciliation solution and led migration of 100+ tables from AWS Redshift to Databricks.

AWS Redshift Databricks Unity Catalog Delta Lake ETL Data Pipelines Data Modeling Power BI SAP Web Intelligence Agile Scrum Stakeholder Management Mentorship

Consultant

Deloitte India

Aug 2021 - Jul 2022 (11 months)

Migrated 100% of incremental and historical data from on-prem SQL servers to Azure Synapse using ADF pipelines, Databricks, and SQL stored procedures. Implemented archival, purging, logging, and auditing processes, reducing storage costs by 20%.

Azure Synapse Azure Data Factory Databricks SQL ETL Data Migration Data Warehouse Data Quality

Decision Scientist

Mu Sigma

Jun 2018 - Jul 2021 (3 years 1 month)

Led a 4-member offshore team to optimize ETL design and improve pipeline efficiency. Migrated on-prem data to Azure Data Warehouse using Azure Data Factory, integrating 5+ sources including SQL, Oracle, Teradata, and file systems.