Open to opportunities

Anuj Kumar

@anujkumar13

Message

Senior Data Engineer building scalable Azure/AWS data platforms with PySpark and Databricks.

India

Message

What I'm looking for

I’m looking for a Senior Data Engineering role where I can own end-to-end ETL/ELT and data platform modernization on Azure/AWS with Databricks and PySpark—emphasizing data quality, orchestration, performance, and opportunities to apply GenAI and prompt engineering.

I’m a Senior Data Engineer with 7+ years of experience designing, developing, and optimizing scalable enterprise data solutions across Azure and AWS. I’m proficient in Databricks, PySpark, Python, SQL, and Delta Lake, building end-to-end ETL/ELT pipelines with medallion architecture and reliable workflow orchestration using Airflow and Databricks Workflows.

In my roles, I take end-to-end ownership—from development and testing to deployment and production support—while strengthening data quality, validation, exception handling, and performance optimization. I’ve delivered modernization workstreams (e.g., finance pipelines for DPM), integrated Oracle Fusion ERP (BICC) with REST APIs, improved Spark processing performance by up to 30%, and partnered with stakeholders to produce Power BI–ready curated datasets, with growing exposure to Generative AI, Prompt Engineering, and Databricks GenAI.

Experience

Work history, roles, and key accomplishments

Current

Senior Consultant

Current

Xebia IT Architects India Pvt Ltd

Aug 2025 - Present (11 months)

Led the finance workstream for the MDOP data platform modernization, owning solution design, development, testing, deployment, and production support for finance data pipelines. Built and orchestrated scalable ETL/ELT workflows and implemented data quality, validation, and performance optimization on Azure.

PySpark Azure Databricks Databricks Workflows ETL ELT Data Quality Data Validation Git CI CD Agile

Data Engineer

Fractal Analytics

Feb 2023 - Aug 2025 (2 years 6 months)

Delivered end-to-end Azure and AWS data engineering solutions across retail, supply chain, logistics, survey analytics, and finance domains. Developed ETL/ELT pipelines, integrated Oracle Fusion ERP finance data, improved Spark processing performance, and delivered curated datasets for Power BI and analytics.

Azure Databricks PySpark SQL Delta Lake ETL ELT Workflow Automation Power BI Predictive Analytics

Azure Data Engineer

Infogain

Jun 2021 - Jan 2023 (1 year 7 months)

Designed, developed, and deployed scalable ETL pipelines for healthcare/pharmaceuticals and manufacturing/packaging domains using Azure and AWS. Automated data ingestion, transformation, and data quality processes and enabled business reporting through Power BI dashboards.

Azure AWS SQL Python ETL Data Ingestion data transformation Data Quality Power BI

Consultant

Intellect Design Arena Pvt Ltd

Jan 2019 - Dec 2020 (1 year 11 months)

Contributed to the development and maintenance of the Global Liquidity Engine (HSBC) by supporting enterprise liquidity management operations. Performed data validation and testing activities, resolved production issues, and automated testing interfaces to reduce manual effort and improve release efficiency.

Data Validation Unit Testing Deployment Environment Management Testing Automation