Shubham Shivaji Sonawane
@shubhamshivajisonawa
I build scalable, compliant healthcare data pipelines using PySpark, Databricks, Airflow, and cloud platforms.
IndiaWhat I'm looking for
At Deloitte, I architect data pipeline solutions for three healthcare analytics programs and build PySpark and Databricks pipelines processing 500M+ records daily. I cut job runtime by 30% through partitioning and cluster tuning while delivering production pipelines from design through deployment and support.
Previously at TCS, I developed enterprise ETL pipelines, orchestrated 40+ Airflow DAGs, and optimized Spark workloads processing more than 1TB daily. My work reduced data load errors by 35%, recovery time by 50%, and compute costs by 25%.
I translate healthcare requirements into technical specifications, work closely with product owners and client stakeholders, and build for governance, audit readiness, and reliable operations. I have also mentored five junior data engineers and standardized GitLab practices across engineering teams.
My hands-on stack includes Python, SQL, PySpark, Spark, Databricks, Airflow, AWS, Azure, and healthcare data compliance practices including HIPAA.
Experience
Work history, roles, and key accomplishments
Architected data pipeline solutions for 3 concurrent healthcare analytics programs, defining data flow design and system interfaces aligned with governance and compliance standards. Built scalable PySpark and Databricks pipelines processing 500M+ records daily, cutting job runtime 30% through partitioning and cluster tuning.
Developed ETL pipelines for enterprise data warehouse integration, designing source-to-target mappings that reduced data load errors by 35%. Orchestrated 40+ Airflow DAGs managing enterprise-scale data pipelines, with dependency and error-handling logic cutting failed-run recovery time 50%.
Software Associate
Mythos Technology
May 2020 - Mar 2021 (10 months)
Collaborated with cross-functional teams to gather requirements for 5 analytical solutions, supporting on-time delivery in an early-career engineering role. Analyzed healthcare insurance datasets to identify anomalies and trends, delivering insights that informed 3 process improvements for business stakeholders.
Education
Degrees, certifications, and relevant coursework
University of Leicester
Master of Science, Cloud Computing
2024 - 2025
Pursuing a Master's in Cloud Computing while delivering freelance data engineering projects for healthcare clients.
Pune University
Bachelor of Technology, Information Technology
Completed a Bachelor of Technology in Information Technology.
Pune University
Higher Secondary Certificate, General Studies
Completed Higher Secondary Certificate (H.S.C).
Availability
Location
IndiaAuthorized to work in
Job categories
Interested in hiring Shubham Shivaji?
You can contact Shubham Shivaji and 90k+ other talented remote workers on Himalayas.
Message Shubham ShivajiGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
