# Ankur Patel

Ankur Patel is a remote worker on Himalayas, Senior Data Engineer at DCM Shriram Limited, based in India.

Source: https://himalayas.app/@ankurpatel

```text
Senior Data Engineer (5.8 yrs) — Azure Databricks, PySpark, Kafka, Delta Lake. Lakehouse, real-time streaming, CI/CD, and production GenAI/RAG
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | India |
| Authorized to work in | India |
| Job categories | Data Engineer, Data Architect, Data Analyst, Data Scientist, ETL Developer, Data Platform Engineer |
| Skills | Snowflake, DBT, Docker, Kubernetes, Airflow, Azure Data Factory, Databricks, Azure Synapse, Microsoft Fabric, Python, SQL, Power BI, Tableau, Apache Spark, ETL ELT Data Pipelines, Git, Pandas, PySpark, Serverless, Azure Functions, GitHub, Azure, Data Warehouse, CI CD Pipelines, Kafka, Data Modeling |
| Website | https://drive.google.com/file/d/1DaMUy_dSXdBSGm58OhBhZzAIiJSEAYv2/view |
| LinkedIn | https://linkedin.com/in/helloankur/ |
| GitHub | https://github.com/Anku1903 |
| Twitter | https://x.com/theankur19 |

## What I'm looking for

```text
I am looking for opportunities that allow me to leverage my data engineering skills in a collaborative environment, focusing on innovative projects that drive business success.
```

## About

```text
Senior Data Engineer, 5.8 years, building production data platforms on Azure Databricks — lakehouse, real-time streaming, CI/CD, and GenAI that ships to real users.

Currently at DCM Shriram Limited, a listed Indian chemicals manufacturer, where I own the end-to-end Data & AI platform and Azure DevOps CI/CD. Two plant-optimization platforms I built end-to-end have delivered $1.2M (₹10.8 Cr) in measured savings, and re-architecting the data platform cut Azure cloud spend 65% in under 6 months — root-caused a mis-set blob access tier driving 99.5% of storage operation cost, capped Kafka to 1 eCKU, retuned pipeline triggers, and right-sized clusters and App Service plans. I set technical direction for a cross-functional team of 4 (2 Data Engineers, 2 Data Scientists).

Before that, 5 years as a Data & Analytics Engineer on multi-year engagements with international clients across e-commerce, retail, and healthcare — Kafka + Databricks streaming, Snowflake + dbt warehouses, CDP implementations, and HIPAA-compliant healthcare pipelines.

What I build:

- Config-driven streaming frameworks on Databricks — one Lakeflow Spark Declarative Pipeline serving every real-time use case through pure configuration; 1/3 the infrastructure cost of the setup it replaced, zero repeated failures, 1-second event latency

- Production GenAI / RAG on Azure AI Search and Azure OpenAI — hybrid BM25 + vector retrieval, semantic reranking, metadata filtering, and source citations across 70 GB of documentation

- Lakehouse platforms on Delta Lake with Unity Catalog and a Databricks Asset Bundle monorepo across DEV / TEST / PROD

- Real-time Kafka pipelines and medallion architectures processing millions of daily events

- Full-stack data applications — FastAPI + PostgreSQL fronting Pyomo optimization models (MILP / nonlinear)

Stack

Daily: Python · SQL · PySpark · Azure Databricks · Delta Lake · Delta Live Tables · Unity Catalog · Databricks Asset Bundles · Kafka · FastAPI · Docker · Azure DevOps

Regular: dbt · Snowflake · Azure Data Factory · Synapse · Terraform · PostgreSQL · Azure Functions · React

GenAI: Azure AI Search · Azure OpenAI · LangChain · FAISS · Pyomo (MILP / nonlinear)
```

## Experience

### Senior Data Engineer (current)

DCM Shriram Limited. Oct 2025 - Jul 2026

```text
Own the end-to-end Data & AI platform on Azure Databricks — real-time streaming, lakehouse, CI/CD, and production GenAI/RAG serving multiple chemical manufacturing plants. Re-architecture cut Azure cloud spend 65% in under 6 months; two end-to-end optimization platforms delivered $1.2M in measured savings. Set technical direction for a team of 4 (2 DE, 2 DS) and own Azure DevOps CI/CD.
```

Skills: Databricks, Spark, Snowflake, DBT, Kafka, Delta-Lake, Delta-Live-Tables, Azure-Data-Factory, Azure-Synapse, Tableau, PostgreSQL, Python, Machine-Learning, Airflow, Docker, Azure-DevOps, Azure-Functions, Data-Modeling, SQL, CI-CD-Pipelines

### Data Engineering Consultant

Self-employed. Aug 2020 - Aug 2025

```text
Multi-year engagements with international clients across e-commerce, retail, and healthcare. Architected 30+ production pipelines processing 10M+ records daily on Databricks, PySpark, and Azure. Built Kafka + Databricks Structured Streaming platforms (client-reported 28% revenue lift), Snowflake + dbt customer data platforms, and HIPAA-compliant healthcare pipelines (500K+ daily records).
```

Skills: PySpark, SQL, Databricks, Azure-Data-Factory, Azure-Data-Lake-Store, Azure-Synapse, Data-Modeling, Tableau, Snowflake, DBT, Airflow, Docker, Kubernetes, CI-CD-Pipelines, Azure-DevOps, Kafka, Python, Scrapy

## Education

### Vishwakarma Government Engineering College

B.Tech. in Information & Technology Engineering, Information & Technology Engineering. 2017 - 2020. Grade: 8.60 CGPA

Activities and societies: Activities and societies: - Engaged in coding hackathons and online challenges - Joined seminars on emerging IT technologies - Attended workshops on data analytics and machine learning - Participated in inter-college coding contests - Participated in open-source project contributions during college

```text
Graduated with a B.Tech in Information Technology.

Focused on programming, databases, data engineering, and data analytics.
Built foundations through coursework in algorithms, distributed systems, and database design — later shaped into a full career in production data engineering.
```

## Tech stack

- Snowflake
- Apache Spark
- AWS Glue
- Tableau
- AWS IAM
- Microsoft Azure
- GitHub
- Kubernetes
- Azure Pipelines
- PySpark
- dbt
- MySQL
- PostgreSQL
- Databricks
- Python
- Kafka
- AWS Lambda
- Azure Functions
- Kafka Streams
- Git
- Airflow
- Amazon Web Services (AWS)
- Microsoft Power BI
- SQL
- Azure Blob Storage

To contact Ankur, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Amit Singh Negi](https://himalayas.app/@amitsinghnegi): Data Engineer 2, MAQ Software
- [Devendra Mukati](https://himalayas.app/@devendramukati): AI Data Engineer AI Product D&A, AICoE, 3M Global Technology Centre
- [ajay singh](https://himalayas.app/@ajaysingh17): Senior Data Engineer, HashedIn by Deloitte
- [Vivek Gupta](https://himalayas.app/@vivekgupta6): Senior AI & Data Engineer, Experis (AT&T)
- [Manjot Singh](https://himalayas.app/@manjotsingh7): Senior Data Engineer, Aptus Data Labs
- [ashish kumar](https://himalayas.app/@ashishkumar39): Data Engineer, Workday
- [rajin User](https://himalayas.app/@rajinuser): Specialist Data Engineer, LTIMindtree
- [Deepak Singh](https://himalayas.app/@deepaksingh15): Senior Consultant, Deloitte
- [Neha Pandey](https://himalayas.app/@nehapandey1): Senior Platform Engineer, MetLife
- [Sameer Kumar](https://himalayas.app/@sameerkumar10): Software Engineer II, MAQ Software
