Subhashini Damu
@subhashinidamu
Big Data engineer specializing in Spark, Scala, AWS and performance-optimized ETL pipelines.
What I'm looking for
I am a results-driven Big Data engineer with around 7 years of experience delivering scalable ETL solutions using Spark, Scala, PySpark, Hadoop ecosystem tools and cloud services like AWS and Snowflake. I have led migrations (Databricks→EMR Serverless, Redshift→Snowflake), optimized job performance and costs, and automated data workflows using Airflow, Oozie and Control-M.
I collaborate closely with product owners, onboard and mentor trainees, and build monitoring dashboards (ElasticSearch/Kibana) to replace manual operations. My work emphasizes data reliability, performance tuning, and pragmatic automation to accelerate analytics and business outcomes.
Experience
Work history, roles, and key accomplishments
Senior Big Data Engineer
Comcast
Oct 2023 - Present (2 years 2 months)
Upgraded and migrated data pipelines to EMR Serverless and Snowflake, transitioned storage to Apache Iceberg, and optimized ETL to reduce job execution time and cloud costs while enabling dynamic parameterization across pipelines.
Big Data Engineer
Societe Generale
Aug 2021 - Oct 2023 (2 years 2 months)
Developed and optimized ETL pipelines across Hadoop and Spark ecosystems, created performant Hive schemas and ingestion modules, and built Elastic/Kibana dashboards to replace manual monitoring and surface production exceptions.
Big Data Engineer
DXC Technology
Jun 2020 - Oct 2023 (3 years 4 months)
Maintained and monitored IBNEXT analytical platform data pipelines using Oozie and MongoDB, performed ETL development in Spark/Scala/Hive, and implemented automated error logging and performance tuning to ensure production reliability.
Big Data Engineer
DXC Technology
Jan 2020 - Jun 2020 (5 months)
Migrated TAC jobs to Oozie, supported Spark streaming and Talend integrations, performed root-cause analysis and Hive optimizations to improve job reliability and performance for an enterprise analytics platform.
Big Data Developer
DXC Technology
Nov 2017 - Dec 2019 (2 years 1 month)
Implemented Hive and Spark-based report generation for finance revenue recognition, tuned Hive performance via partitioning/bucketing, and automated Hadoop workflows using Oozie and Falcon while monitoring clusters with Ambari.
Education
Degrees, certifications, and relevant coursework
Hindusthan College Of Engineering and Technology
Bachelor of Engineering, Computer Science
2013 - 2017
Grade: 78%
Completed a Bachelor of Engineering in Computer Science with a focus on core computing concepts and software development.
YRTV Matriculation Higher Secondary School
HSC, Higher Secondary Education
2012 - 2013
Grade: 88.7%
Completed Higher Secondary Certificate with an emphasis on general secondary education.
YRTV Matriculation Higher Secondary School
SSLC, Secondary Education
2010 - 2011
Grade: 92.8%
Completed Secondary School Leaving Certificate (SSLC) demonstrating strong academic performance.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Interested in hiring Subhashini?
You can contact Subhashini and 90k+ other talented remote workers on Himalayas.
Message SubhashiniFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
