RDRohit Dubey
@rohitdubey2
Data engineer specializing in scalable Azure/Databricks pipelines, PySpark optimization, and ETL automation.
IndiaWhat I'm looking for
I am a data engineer with 2+ years of experience building scalable, highly available ETL pipelines and optimizing PySpark/SparkSQL jobs in Databricks and Azure. I focus on designing medallion architectures, Delta Lake-based data models, and performance tuning to reduce runtime and cost.
At my current role I implemented incremental ingestion frameworks in Azure Data Factory, integrated external APIs, and delivered Silver-layer Delta tables that feed BI and ML use cases, achieving significant runtime reductions. Previously I migrated a 50TB enterprise warehouse to Databricks, improved query performance, and automated end-to-end workflows with Airflow and Databricks tooling.
I combine strong engineering discipline—unit testing, CI/CD in Azure DevOps, and Agile delivery—with hands-on skills in PySpark, Python, SQL and Azure services to deliver reliable data platforms that support analytics and ML initiatives.
Experience
Work history, roles, and key accomplishments
Data Engineer
Ryan Specialty Group
Oct 2024 - Present (1 year)
Orchestrated an incremental ingestion framework in Azure Data Factory into Databricks Medallion Architecture, reducing runtime and complexity by 40% and enabling KPI-based Gold datasets for ML/AI use cases.
Data Engineer
GE Vernova
Jul 2023 - Oct 2024 (1 year 3 months)
Migrated a 50TB enterprise data warehouse to Databricks with Delta Lake and Unity Catalog, improving query performance by 35% and automating workflows with Airflow and Databricks orchestration.
Software Engineer Intern
Enquero
Mar 2023 - Jun 2023 (3 months)
Built scalable SQL Server schemas and developed 10 RESTful Node.js APIs for the Genkart e-commerce platform, improving API testing efficiency by 40% and driving CI/CD adoption.
Education
Degrees, certifications, and relevant coursework
MTMaulana Azad National Institute of Technology
Bachelor of Technology, Electrical Engineering
2019 - 2023
Grade: CGPA 8.00
Completed a Bachelor of Technology in Electrical Engineering with a CGPA of 8.00 from Maulana Azad National Institute of Technology between 2019 and 2023.
Availability
Location
IndiaAuthorized to work in
Job categories
Interested in hiring Rohit?
You can contact Rohit and 90k+ other talented remote workers on Himalayas.
Message RohitFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
