Looking for a job

Ankur Patel

@ankurpatel

Senior Data Engineer (5.7 yrs) architecting production data platforms end-to-end — lakehouse, streaming, CI/CD, and GenAI/RAG.

India

Message

What I'm looking for

I am looking for opportunities that allow me to leverage my data engineering skills in a collaborative environment, focusing on innovative projects that drive business success.

Senior Data Engineer with 5.7 years shipping production data platforms and GenAI applications that move numbers the business actually tracks.

Currently at DCM Shriram Limited — a multi-billion-dollar listed conglomerate — where I own the end-to-end Data & AI platform and Azure DevOps CI/CD on Azure Databricks. Re-architected systems have cut Azure cloud spend by 54% in under a year, and my optimization platforms have delivered seven-figure USD business impact within months of launch. Lead a cross-functional team of 4 (2 DE, 2 DS).

Prior 5 years as an independent consultant: 25+ data engineering projects across e-commerce, retail, and healthcare clients — Kafka + Databricks streaming, Snowflake + DBT warehouses, HIPAA-compliant healthcare pipelines.

Daily stack: Python, SQL, PySpark, Azure Databricks, Delta Lake, Unity Catalog, Databricks Asset Bundles, Kafka, Azure Data factory, FastAPI, Docker, Azure DevOps. Production GenAI experience with FAISS, Azure OpenAI, LangChain, and RAG (hybrid search + metadata filtering).

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

DCM Shriram Limited

Oct 2025 - May 2026 (7 months)

Own the end-to-end Data & AI platform on Azure Databricks — real-time streaming, lakehouse, CI/CD, and production GenAI/RAG serving multiple chemical manufacturing plants. Re-architected systems have cut Azure cloud spend by 54% and delivered seven-figure USD business impact through two end-to-end optimization platforms. Lead a cross-functional team of 4 (2 DE, 2 DS).

Data Engineering Consultant

Self-employed

Aug 2020 - Aug 2025 (5 years)

Delivered 25+ data engineering and analytics projects for e-commerce, retail, and healthcare clients. Architected 30+ production data pipelines processing 10M+ records daily on Databricks, PySpark, and Azure. Built Kafka + Databricks Structured Streaming platforms (28% revenue lift on clickstream personalization) and HIPAA-compliant healthcare streaming pipelines (500K+ daily records).

Pyspark SQL Databricks Azure Data Factory Azure Data Lake Store Azure Synapse Data Modeling Tableau Snowflake DBT Airflow Docker Kubernetes CI CD Pipelines Azure DevOps Kafka Python Scrapy

Education

Degrees, certifications, and relevant coursework

Vishwakarma Government Engineering College

B.Tech. in Information & Technology Engineering, Information & Technology Engineering

2017 - 2020

Grade: 8.60 CGPA

Activities and societies: Activities and societies: - Engaged in coding hackathons and online challenges - Joined seminars on emerging IT technologies - Attended workshops on data analytics and machine learning - Participated in inter-college coding contests - Participated in open-source project contributions during college

Graduated with a B.Tech in Information Technology.

Focused on programming, databases, data engineering, and data analytics.
Built foundations through coursework in algorithms, distributed systems, and database design — later shaped into a full career in production data engineering.