Shivansh Sharma
@shivanshsharma1
Databricks-certified data engineer building scalable Spark ETL pipelines for reliable analytics.
IndiaWhat I'm looking for
I am a Databricks Certified Data Engineer with nearly three years of hands-on experience designing and optimizing large-scale cloud data solutions using Spark, SQL, Scala, and Python.
I have built reusable, parameterized ETL components and end-to-end Databricks pipelines ingesting high-volume sources like Salesforce, improving pipeline performance and maintainability across projects.
My work includes optimizing distributed Spark workloads (caching, checkpointing, broadcast joins) to cut runtimes by ~75%, developing data validation frameworks with 100+ UDF rules, and automating orchestration with ADF and Autosys to reduce operational overhead.
I bring a pragmatic, quality-focused approach to data engineering, delivering reliable data, resolving schema and governance gaps, and driving measurable improvements in development speed, data quality, and observability.
Experience
Work history, roles, and key accomplishments
Develop and optimize Databricks/Spark ETL pipelines, improving runtime by ~75% through caching, checkpointing, and join optimizations while ensuring SLA compliance and reducing QA effort by 40%.
NABuilt end-to-end Databricks ETL pipelines ingesting 100k–100M daily records, implemented schema validation with 100+ UDF rules and automation that reduced operational overhead by 50%.
Education
Degrees, certifications, and relevant coursework
LULovely Professional University
Bachelor of Technology, Electronics and Communication Engineering
2019 - 2023
Grade: 7.96 CGPA
Completed a Bachelor of Technology in Electronics and Communication Engineering with a 7.96 CGPA from May 2019 to May 2023.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Interested in hiring Shivansh?
You can contact Shivansh and 90k+ other talented remote workers on Himalayas.
Message ShivanshFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
