Looking for a job

Abhimanyu Gabhrani

@abhimanyugabhrani

Message

I migrate large-scale legacy data pipelines to Azure Databricks.

India

Message

At Celebal Technologies, I migrate large-scale legacy data platforms to Azure Databricks for clients including NXP Semiconductors. I led the conversion of 510+ BTEQ, TPT, and Shell scripts into PySpark notebooks for supply chain planning, reducing team effort by approximately 35–40%.

I design reliable migration and orchestration patterns, including dual Oracle JDA and Databricks control tables for zero-downtime cutovers. I also built ADLS reconciliation frameworks and reusable PySpark utilities that cut per-script maintenance effort by approximately 50%.

I work across PySpark, Databricks, Azure Data Factory, ADLS Gen2, and Azure Logic Apps, with experience modernizing Teradata, Oracle, Talend, and MS SQL Server workloads. I’ve also created an 18-pattern BTEQ-to-PySpark playbook and a 17-point review checklist to accelerate AI-assisted delivery.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Celebal Technologies

Aug 2024 - Present (2 years 1 month)

Led end-to-end migration of 510+ BTEQ/TPT/Shell scripts to PySpark notebooks for a global semiconductor client's Supply Chain Planning domain on Databricks, achieving 85-90% AI-assisted conversion accuracy and reducing team effort by ~35-40%. Designed dual control table architecture enabling parallel-run orchestration during Teradata-to-Databricks cutover, ensuring zero-downtime JDA load schedulin

PySpark Databricks Azure Data Factory Azure Logic Apps ADLS Teradata Oracle MS SQL Server Talend Shell Scripting ETL ELT Modernization Medallion Architecture Metadata Driven Pipeline Design CI CD AI assisted Development

Data Engineer - Intern

Celebal Technologies

Apr 2024 - Jul 2024 (3 months)

Developed PySpark notebooks implementing complex business logic and data transformations; created unit tests and validation frameworks to catch quality issues before production loads. Converted legacy MS SQL Server stored procedures and views into Databricks notebooks across DEV, UAT, and PROD Azure environments.

PySpark Databricks MS SQL Server Azure Unit Testing Data Validation

Education

Degrees, certifications, and relevant coursework

Jaipur Engineering College and Research Center

B.Tech, Computer Science

Grade: 9.32/10.00

Pursued a B.Tech in Computer Science with a CGPA of 9.32/10.00, including coursework in Data Structures and Algorithms, Object Oriented Programming, Computer Networks, and Operating Systems.