Sarhad Gautam
@sarhadgautam
Staff Data Engineer specializing in PySpark, Databricks, and data platform optimization.
IndiaWhat I'm looking for
I am a seasoned Data Engineer with 11+ years of experience in data warehousing, big data engineering, and analytical dashboard creation. I specialize in optimizing data pipelines using PySpark, Spark with Scala, and SQL, and have led migrations from Snowflake to Databricks Lakehouse that reduced runtime by 20%.
I hold an M.Tech in Data Science and Engineering from BITS Pilani and have built production Databricks pipelines under the Medallion framework, designed Power BI dashboards with DAX and Power Query, and automated validation and testing frameworks that improved data quality and reduced testing time. I deliver results through strong governance, Agile practices, and cross-functional collaboration.
Experience
Work history, roles, and key accomplishments
Staff Data Engineer
Altimetrik Pvt. Limited
Feb 2020 - Present (5 years 8 months)
Optimized data ecosystem by transitioning from Snowflake to Databricks Lakehouse, reducing pipeline runtime by 20% and improving efficiency; developed PySpark Databricks pipelines under a Medallion framework and built Power BI dashboards to enhance data quality monitoring by 15%.
Senior Software Engineer
Infostretch Ltd.
Sep 2019 - Feb 2020 (5 months)
Automated manual UI validation workflows using Selenium, reducing testing effort by ~20 hours/week and managed versioning via GitHub to ensure codebase integrity and collaboration.
Test Engineering Analyst
Accenture Ltd.
May 2018 - Aug 2019 (1 year 3 months)
Built a hybrid automation framework to validate banking data flows into Hive on Hadoop, improving data accuracy by 15% and authored complex SQL for transformation validation, reducing error rates by 10%.
Test Engineer
Infosys Ltd.
Aug 2014 - Apr 2018 (3 years 8 months)
Designed and executed data warehouse testing during migration to improve data accuracy by 10%, and automated regression suites using Java TestNG to cut testing time by ~10 hours/week.
Education
Degrees, certifications, and relevant coursework
BPBirla Institute of Technology and Science, Pilani
Master of Technology, Data Science and Engineering
Completed M.Tech (WILP) in Data Science and Engineering at BITS Pilani in April 2023.
National Institute of Technology, Warangal (Edureka)
Post Graduate Program Certification, Data Science
Completed a Post Graduate Program Certification through NIT Warangal in November 2020.
Sikkim Manipal Institute of Technology
Bachelor of Technology
Completed Bachelor of Technology degree in August 2014.
Tech stack
Software and tools used professionally
Availability
Location
IndiaAuthorized to work in
Job categories
Interested in hiring Sarhad?
You can contact Sarhad and 90k+ other talented remote workers on Himalayas.
Message SarhadFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
