Open to opportunities

Rahul Dhaundiyal

@rahuldhaundiyal

Senior Data Engineer and Cloud/Big Data Architect, building high-throughput ETL and real-time streaming platforms for enterprises.

India

Message

What I'm looking for

I’m looking to lead enterprise cloud data platform builds—ETL/streaming, architecture, and performance tuning across Azure/GCP/Hadoop—partnering with teams to improve reliability, latency, and data quality.

I’m a Senior Data Engineer with 8+ years architecting enterprise-scale data platforms. I’ve built 1PB+ data lakes and run high-throughput ETL pipelines processing 50TB+ daily and 1B+ events, improving pipeline reliability by 50% and reducing latency by 30%.

I specialize in cloud migrations, real-time streaming, and distributed systems optimization across Azure, GCP, and Hadoop ecosystems. From designing zero-data-loss Hadoop migrations to leading orchestration with Airflow, I turn complex business requirements into scalable, maintainable data architectures.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

TEKsystems

Feb 2024 - Present (2 years 5 months)

Architected cloud-native data solutions on Azure and GCP using Spark ETL for multi-terabyte workloads. Optimized partitioning and query performance and led an Apache Airflow POC to improve orchestration reliability and monitoring.

GCP Airflow Apache Spark PySpark ETL Data Partitioning and Tuning

Senior Data Engineer

Infosys Consulting

Sep 2023 - Jan 2024 (4 months)

Designed and implemented GCP-based data integration pipelines to process Excel, CSV, and SAV inputs using Python, SQL, and Spark. Built scalable ETL pipelines to ensure data integrity and seamless loading into target data warehouses.

GCP Data Warehouse Python SQL Apache Spark ETL Data Integration Data Integrity

Senior Solution Architect

Inspira Enterprise

Mar 2023 - Sep 2023 (6 months)

Led end-to-end Hadoop infrastructure design for a state government project, migrating legacy RDBMS systems to a scalable big data platform. Developed real-time data access APIs and built Spark migration pipelines to enable zero data loss during transition.

Hadoop HDFS Apache Spark API Development Data Loss Prevention System Architecture Performance Optimization

Senior Hadoop Developer

Datamatics & Miracle Software Systems

Mar 2021 - Jan 2023 (1 year 10 months)

Built robust big data solutions on the Hadoop ecosystem, optimizing enterprise data processing workflows. Implemented data quality frameworks and monitoring to significantly reduce production issues.

Hadoop Ecosystem Apache Spark Data Quality Monitoring Production Support Hadoop

Senior Data Analyst

Accenture

Mar 2017 - Mar 2021 (4 years)

Developed Sqoop jobs for RDBMS-to-Hive ingestion and created Spark-based data transformation pipelines. Built custom GIS applications and database solutions to automate workflows and improve operational efficiency, while mentoring junior engineers.

Sqoop Apache Hive Apache Spark RDBMS To Hive Ingestion GIS SQL Workflow Automation Mentorship