Open to opportunities

Sabal Subedi

@sabalsubedi

Message

Innovative Data Engineer with expertise in cloud-native data platforms.

United States

Message

What I'm looking for

I am seeking a role that fosters innovation, collaboration, and growth opportunities in data engineering.

I am an innovative and results-driven Data Engineer with over 6 years of experience in designing and scaling cloud-native data platforms across various industries, including healthcare, energy, retail, and insurance. My expertise lies in architecting robust ETL and real-time streaming pipelines using AWS, Azure, and GCP, along with hands-on experience in technologies such as Spark, Kafka, Databricks, and Snowflake. I have a proven track record of transforming legacy systems into modern lakehouse architectures, optimizing performance, and enabling machine learning readiness.

Throughout my career, I have demonstrated excellence in implementing HIPAA, GDPR, and SOX-compliant solutions while leading enterprise-wide initiatives in data governance and CI/CD automation. My strong leadership skills have allowed me to mentor engineers and drive cross-functional alignment, delivering business-critical analytics solutions that accelerate decision-making and digital transformation. I am a true cloud-first builder with the technical breadth and business acumen to make an immediate impact in any organization.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Change Healthcare

Jun 2022 - Present (3 years 2 months)

Optimized data pipelines by integrating AWS Glue for ETL workflows, Snowpipe for seamless data ingestion into Snowflake, Lambda for serverless processing, and Athena for interactive queries over S3 stored datasets. Integrated the Data Build Tool (DBT) into data transformation workflows to standardize SQL-based transformations, ensuring scalable and reliable analytics pipelines with effective metad

AWS Glue Snowpipe Snowflake AWS Lambda DBT AWS Step Functions Pyspark Scala Apache Spark

Data Engineer

Duke Energy

Jan 2020 - Present (5 years 7 months)

Architected and deployed scalable PySpark pipelines on AWS EMR, processing over 5TB of retail transaction and inventory data daily. Built real-time streaming solutions using Kafka and Spark Streaming to capture and analyze clickstream data for personalized marketing. Migrated legacy Oracle ETL workflows to AWS Glue integrated with Redshift, reducing job runtimes.

Pyspark Kafka Oracle AWS Glue Redshift Delta Lake Databricks Snowflake

ETL Developer

Allstate

Aug 2018 - Present (7 years)

Designed and developed scalable ETL pipelines using Spark, AWS Glue, and Hive to process insurance claims, underwriting, and policy data across batch and streaming use cases. Integrated AWS RDS and S3 data sources into Snowflake, implementing secure data transfer and transformation processes with Glue and DBT for consistent schema management. Migrated legacy Talend jobs into AWS Glue-based pipelin

Spark AWS Glue Hive AWS RDS AWS S3 Snowflake DBT Apache Airflow Tableau SQL Talend

Education

Degrees, certifications, and relevant coursework

Idaho State University

Master’s, Computer science

Completed a Master's degree in Computer Science. Focused on advanced topics in the field, preparing for a career in data engineering and related areas.