I’m looking for a role where I can work on end-to-end data engineering building scalable pipelines, working with technologies like Spark, Airflow, and cloud platforms. I have learned from challenging projects and also contribute my existing skills. Stability and alignment with my career path are very important to me, so I’m looking for a role where I can stay and grow for the long term.
Kshitij Khandelwal
@kshitijkhandelwal
Data Engineer with 3.5+ years’ experience in scalable data systems, ETL pipelines, and cloud platforms like AWS & Azure , Snowflakes
What I'm looking for
Data Engineer with 3.5+ years of experience, including 9 months of freelancing, in designing and maintaining scalable data systems. Skilled in building robust ETL pipelines and optimizing workflows using AWS Glue, Databricks, Redshift, Snowflake, DBT, Airflow, and PySpark. Experienced in delivering data solutions that support supply chain optimization and market share analysis, enabling businesses to make data-driven decisions.
Experience
Work history, roles, and key accomplishments
Data Engineer
Sigmoid
Jun 2025 - Present (4 months)
1. Developed and maintained automated ETL pipelines using DBT, integrating data from AWS S3 and orchestrating workflows with Apache Airflow to ensure efficient and reliable data processing.
2. Achieved up to 90% improvement in time complexity and query performance by migrating legacy Java and Scala data processing code to highly optimized DBT models.
• Designed and implemented a scalable data warehouse using a star schema in SQL Server, and orchestrated 20+ automated ETL workflows with Azure Data Factory to support multi-country market share analysis for Hershey’s across 10+ regions.
• Built metadata-driven ETL pipelines using ADF and PySpark in Azure Databricks to process millions of sales records across global markets.
Software Engineer - Data Engineer
Zeeve
Mar 2023 - Jan 2024 (10 months)
• Pipeline Optimization: Reduced pipeline failures by 25% across cross domain datasets (Finance, Procurement, Sales) by leveraging Azure Data Factory, optimizing SQL queries, and implementing error handling mechanisms.
• Machine Learning Implementation: Developed algorithms using Pearson correlation and IQR-based outlier detection on the Toyota dataset, boosting data quality by 35%.
Data Engineer
Outshade
Jun 2022 - Feb 2023 (8 months)
• Provided end-to-end support for Azure Data Factory (ADF) pipelines, including monitoring, debugging, and performance optimization.
• Automated data workflows and implemented error-handling & alerting mechanisms to ensure high availability.
• Assisted clients in troubleshooting failed pipeline runs, identifying root causes, and applying fixes.
Education
Degrees, certifications, and relevant coursework
Skit Jaipur
Bachelor of Engineering, Computer Science
2019 - 2023
Completed a Bachelor of Engineering in Computer Science with notable coursework in Data Structures Algorithms, Cloud Computing, and Database Management.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Website
medium.com/p/58db0984da27Portfolio
medium.com/p/58db0984da27Salary expectations
Job categories
Interested in hiring Kshitij?
You can contact Kshitij and 90k+ other talented remote workers on Himalayas.
Message KshitijFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
