Skip to main content
Div ChaudharyDC
Looking for a job

Div Chaudhary

@divchaudhary

Data Engineer II at Thorogood Associates who built a multi-agent Databricks system and cut workflow migration time by 50%.

India
Message

At Thorogood Associates, I architected a multi-agent system using Agent Bricks to route natural-language questions across Databricks Genie spaces. I also developed an AI-assisted framework that converts Alteryx workflows into Databricks-compatible PySpark, reducing migration turnaround time by 50%.

For an enterprise forecasting engine, I collaborated on a metadata-driven ETL and orchestration framework in Databricks that cut cycle runtime from 3–4 man-days to 4 hours across 14 international markets. I also engineered configuration-based onboarding across 40M+ rows and 45+ financial KPIs.

I built PySpark ingestion pipelines that standardize irregular date headers, and a multithreaded data-quality engine that validates files and quarantines corrupt loads. My Azure Data Factory and Databricks pipelines used Medallion architecture and SCD Type 2 logic to track changes across 10M+ records and reduce reporting turnaround time by 30%.

I also delivered Power BI dashboards integrated with PowerApps, SQL stored procedures, and semantic models, reducing manual Excel work by 80%. My work spans data engineering and applied AI, supported by Databricks certifications in Generative AI Engineering and Data Engineering.

Experience

Work history, roles, and key accomplishments

TA
Current

Data Engineer II (Data and AI Consultant II)

Thorogood Associates

Apr 2026 - Present (7 months)

Stepped into a senior technical role, supporting project estimation and planning, contributing to technical direction, and reviewing implementations. Architected a multi-agent system using Agent Bricks and developed an AI-assisted framework to convert Alteryx workflows into Databricks-compatible PySpark code, reducing migration turnaround time by 50%.

TA

Data Engineer III (Data and AI Consultant III)

Thorogood Associates

Jul 2024 - Mar 2026 (1 year 8 months)

Built an enterprise metadata-driven ETL and orchestration framework in Databricks for a global FMCG enterprise's P&L and Working Capital forecasting engine, cutting cycle runtime from 3-4 man-days to 4 hours across 14 international markets. Engineered a zero-code onboarding mechanism using configuration tables and optimized storage with dynamic pivoting and unpivoting logic.

Education

Degrees, certifications, and relevant coursework

Delhi Technological University logoDU

Delhi Technological University

Master of Technology, Software Engineering

2022 - 2024

Grade: 8.26/10

Pursued a Master of Technology in Software Engineering, achieving a GPA of 8.26/10.

Manipal University Jaipur logoMJ

Manipal University Jaipur

Bachelor of Technology, Computer Science Engineering

2018 - 2022

Grade: 8.67/10

Completed a Bachelor of Technology in Computer Science Engineering with a GPA of 8.67/10.

Databricks logoDA

Databricks

Databricks Certified Generative AI Engineer Associate, Generative AI

Earned the Databricks Certified Generative AI Engineer Associate certification.

Databricks logoDA

Databricks

Databricks Certified Data Engineer Associate, Data Engineering

Earned the Databricks Certified Data Engineer Associate certification.

Microsoft logoMI

Microsoft

Microsoft Certified Azure AI Fundamentals, Artificial Intelligence

Earned the Microsoft Certified Azure AI Fundamentals certification.

IBM logoIB

IBM

Machine Learning with Python, Machine Learning

Completed the Coursera course 'Machine Learning with Python' certified by IBM.

IBM logoIB

IBM

Data Analysis with Python, Data Science

Completed the Coursera course 'Data Analysis with Python' certified by IBM.

IBM logoIB

IBM

Databases and SQL for Data Science with Python, Data Science

Completed the Coursera course 'Databases and SQL for Data Science with Python' certified by IBM.

IBM logoIB

IBM

Data Visualization with Python, Data Science

Completed the Coursera course 'Data Visualization with Python' certified by IBM.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan