Open to opportunities

Pragyan Sharma

@pragyansharma

Message

I build scalable healthcare and financial-services data pipelines across Azure, AWS, and GCP.

United States

Message

What I'm looking for

I'm looking to build scalable, governed cloud data platforms and real-time pipelines for healthcare or financial-services analytics, with opportunities to improve data quality, automation, compliance, and business decision-making.

At MetLife, I architect enterprise healthcare and insurance lakehouse solutions across Azure Data Lake Storage Gen2, Databricks, Synapse, Microsoft Fabric, and Snowflake, improving data accessibility by approximately 40%. I build ETL/ELT and real-time pipelines for claims, provider, member, and clinical data while strengthening governance, security, monitoring, and PHI/PII compliance.

Previously, I delivered large-scale financial data pipelines at Capital One and healthcare data platforms at Guardian Life and Signify Health. Across these roles, I’ve improved processing efficiency and reporting latency by about 30%, built data-quality frameworks, automated cloud infrastructure and CI/CD, and supported analytics for fraud, risk, reporting, and care workflows.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

MetLife

Jun 2024 - Present (2 years 2 months)

Architected enterprise healthcare and insurance Lakehouse solutions using Azure and Databricks, improving data accessibility by 40%. Developed scalable ETL/ELT pipelines and implemented Medallion Architecture, reducing reporting latency and ensuring compliance with HIPAA and GDPR.

Data Engineer

Capital One

Aug 2022 - Mar 2024 (1 year 7 months)

Developed scalable big data pipelines using Apache Spark on AWS and GCP, improving processing efficiency by 30%. Built batch and near real-time ingestion pipelines with AWS Glue, Airflow, and Kafka, and implemented data quality frameworks reducing reporting defects by 25%.

Apache Spark PySpark Scala AWS GCP AWS Glue Airflow Kafka Databricks Snowflake BigQuery Amazon EMR Python SQL Terraform Docker Kubernetes Jenkins GitHub Actions Power BI Tableau AWS IAM RBAC PCI DSS SOX

Data Engineer

Guardian Life

Jan 2021 - Jul 2022 (1 year 6 months)

Developed and maintained scalable ETL pipelines using Apache Spark and Hive for healthcare and insurance data. Migrated legacy SQL ETL to Spark SQL, implemented incremental processing, and tuned Spark workloads achieving 30% improvement in job execution time.

Apache Spark Hive Apache Flume HDFS Python Shell Scripting Java Tableau Jira Data Quality SQL Tuning

Big Data Developer

Signify Health

Aug 2018 - Jan 2021 (2 years 5 months)

Developed and maintained scalable ETL pipelines using Apache Spark and Hive for healthcare data. Built end-to-end workflows with Oozie, implemented near real-time ingestion with Kafka and Flume, and tuned Spark jobs achieving 30% performance improvement.