Looking for a job

Digdarshan Subedi

@digdarshansubedi

Senior Data Engineer at LifePoint Health who built a healthcare lakehouse for 15M+ records and cut cloud compute costs by over $200K annually.

United States

Message

At LifePoint Health, I led the architecture and implementation of an AWS S3 lakehouse that organizes healthcare data for clinical operations, finance, and population health analytics. I designed ingestion frameworks for EHR and other datasets, enabling ingestion of 15M+ records.

I also led the migration of legacy ETL pipelines to cloud-native platforms and optimized Redshift and BigQuery workloads, reducing cloud compute costs by over $200K annually. Previously, I helped build Azure data pipelines and lakehouse solutions at Western Union and developed data platforms for insurance analytics at Liberty Mutual and Chubb.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

LifePoint Health

Jun 2025 - Present (1 year 4 months)

Led architecture and implementation of an enterprise AWS S3 lakehouse using Parquet and Delta storage, organizing healthcare data into raw, curated, and trusted zones. Designed scalable ingestion frameworks and optimized Redshift and BigQuery workloads, reducing cloud compute costs by over $200K annually.

Data Engineer

Western Union

Jan 2023 - May 2025 (2 years 4 months)

Helped design and implement Azure Data Factory ingestion pipelines for global remittance transactions and customer activity logs into ADLS Gen2. Built large-scale ETL pipelines using PySpark on Azure Databricks and supported migration of legacy AWS S3/Glue pipelines to Azure.

Azure Data Factory ADLS Gen2 Databricks PySpark Delta Lake Azure Synapse Event Hub Stream Analytics Azure Purview Great Expectations Deequ azure monitor Log Analytics Azure DevOps Git CI CD MLFlow Power BI

Data Engineer

Liberty Mutual

Mar 2020 - Nov 2022 (2 years 8 months)

Developed and maintained production ETL pipelines using SQL, Python, and Azure Data Factory to integrate claims, policy, billing, and customer data. Created SQL queries, stored procedures, and dimensional models in Azure SQL Database and Azure Synapse Analytics.

SQL Python Azure Data Factory ADLS Gen2 Databricks PySpark Azure Synapse Azure SQL Database Power BI Git Azure DevOps

Big Data Developer

Chubb

Sep 2018 - Feb 2020 (1 year 5 months)

Developed large-scale batch pipelines on Hadoop/HDFS to process claims, policy transactions, and underwriting data. Built ingestion workflows using Apache Sqoop and implemented transformation logic using HiveQL, Apache Hive, Apache Pig, and Java MapReduce.