Open to opportunities

Chandru DP

@chandrudp

Message

Senior Data & AI Engineer building scalable GenAI and data platforms.

India

Message

What I'm looking for

I’m looking for Senior Data & AI opportunities where I can build enterprise GenAI (RAG/LLM) pipelines and data platforms, deliver measurable impact, and collaborate with stakeholders to ship scalable AI systems in USA, Singapore, or Europe.

I’m a results-driven Senior Data & AI Engineer with 7+ years designing enterprise-grade data platforms, AI-powered pipelines, and LLM-based solutions. I’m deeply hands-on with Azure Databricks, PySpark, Snowflake, Airflow, and RAG architectures, and I’ve delivered GenAI systems using Claude API, Databricks GenAI, OpenAI, and automation-first LLM workflows.

Most recently, I architected an automated Root Cause Analysis (RCA) system using the Claude API integrated with Databricks, reducing manual incident triage time by ~80%. I also built end-to-end GenAI pipelines with Databricks GenAI, Vector Search, and RAG to enable semantic search and AI-driven analytics at enterprise scale, improving data processing efficiency by 40% through scalable PySpark & Spark SQL pipelines. Across roles, I’ve advanced semantic search with Snowflake Cortex Search and delivered faster insight retrieval (40%) and reporting automation (saving 20+ hours/week), while maintaining strong engineering hygiene through CI/CD, secure deployments, and clear KT and documentation.

Experience

Work history, roles, and key accomplishments

Current

Senior Data & AI Engineer

Current

Fractal Analytics Pvt Ltd

Nov 2025 - Present (7 months)

Architected an enterprise Automated Root Cause Analysis (RCA) system using the Claude API with Databricks, reducing manual incident triage time by ~80%. Built Azure Databricks GenAI + RAG pipelines and scalable PySpark/Spark SQL ETL, improving processing efficiency by 40%.

Claude Azure Databricks Pyspark Databricks Vector Search RAG Airflow CI CD Git

Data Engineer

Dentsu Global Services Pvt Ltd

Jun 2022 - Oct 2025 (3 years 4 months)

Developed Snowflake Cortex Search workflows (indexes, embeddings, vector search, RAG) and integrated OpenAI to improve insight retrieval speed by 40%. Built Azure Data Factory ETL into Snowflake and automated reporting pipelines with Python/Azure Functions, saving 20+ hours/week.

Snowflake Cortex AI Vector Search RAG Azure Data Factory Azure Functions Spark Optimization Jenkins CI CD

Data Engineer

Merkle Inspire Pvt Ltd

Dec 2021 - May 2022 (5 months)

Built Spark ETL pipelines with complex transformations and loaded data into Snowflake using the Spark-Snowflake connector. Doubled Spark/Hive query execution speed and engineered an ML-based phishing domain detection pipeline with REST API-based real-time classification.

Pyspark Snowflake REST APIs Data Pipelines Spark & Hive Performance Tuning Jenkins GitHub Actions CI CD

Data Engineer

Tata Consultancy Services (Core Integra Pvt Ltd)

Jun 2017 - Nov 2019 (2 years 5 months)

Engineered Hive-based data models using partitioning and bucketing, achieving 30% faster query performance. Migrated ETL to Spark on Delta Lake and designed normalized Star/Snowflake schemas to support reporting and AI model training pipelines.

Hive Pyspark Delta Lake ETL