HimalayasHimalayas logo
Rohit DidelRD
Open to opportunities

Rohit Didel

@rohitdidel

Data Engineer building enterprise ETL pipelines with Spark and Azure to deliver faster, business-ready analytics.

India
Message

What I'm looking for

I’m looking for a data engineering role where I can own ETL performance and scalability using Spark/Hive/Azure, collaborate with analytics/BI teams, and build executive-ready dashboards and reliable pipelines with measurable business impact.

I’m a results-driven Data Engineer with 2+ years building enterprise-scale ETL pipelines that improve speed, reliability, and decision-ready outputs. At American Express, I reduced data ingestion time by 35% by migrating batch workflows and optimizing end-to-end processing.

I specialize in turning raw data complexity into measurable business impact—whether that’s cutting Hive query execution time by 28% through partition pruning and schema restructuring, or improving targeting accuracy by ~22% by automating Hive & Hadoop ETL for marketing campaigns. I also built pipeline refreshes that shrank data availability from 6 hrs to under 2 hrs for 500K+ daily records, and reduced team reporting workload by 40% by consolidating multiple reports into a single Tableau HR dashboard.

I bring strong distributed and cloud engineering through Apache Spark (Scala), including Spark Streaming for 50M+ events and GraphX analysis for 10M+ node graphs for anomaly and pattern detection with sub-second latency. On Azure, I’ve architected full data workflows with ADF → ADLS Gen2 → HDInsight/Databricks and delivered Power BI dashboards that cut incident response time by 50%.

Experience

Work history, roles, and key accomplishments

BL

Data Engineer

BDI Plus Lab Pvt. Ltd.

Aug 2022 - May 2024 (1 year 9 months)

Reduced data ingestion time by 35% by migrating batch workflows from Hive to Apache Spark, cutting query execution time by 28% for 100+ TB customer datasets. Automated Hive/Hadoop ETL for marketing campaigns, improving targeting accuracy ~22% and reducing data availability time (6 hrs to under 2 hrs), while saving 15+ hrs/week and cutting reporting workload by 40% via Tableau dashboard consolidati

Education

Degrees, certifications, and relevant coursework

Indian Institute of Technology Guwahati logoIG

Indian Institute of Technology Guwahati

Bachelor of Technology, Civil Engineering

Earned a B.Tech in Civil Engineering at IIT Guwahati.

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan