Open to opportunities

Divya sharma

@divyasharma2

Message

Senior Data Engineer specializing in cloud-native, secure data platforms for healthcare and finance.

United States

Message

What I'm looking for

I seek a senior data engineering role building secure, cloud-native data platforms with strong governance, CI/CD, and AI/ML integration in collaborative, impact-driven teams.

I am a Senior Data Engineer with over seven years of experience building secure, cloud-native data solutions across healthcare, financial services, and insurance. I design and deploy scalable batch and real-time ETL/ELT pipelines using Azure, AWS, and GCP, processing terabytes of data daily to enable analytics for multiple downstream teams.

I have implemented lakehouse and Medallion architectures, Delta Lake, and optimized data warehouses in Snowflake, Synapse, and Redshift to improve performance and reduce costs. I lead data governance, security and compliance efforts (HIPAA, SOC2, PCI-DSS) and automate CI/CD to accelerate reliable deployments.

I integrate advanced analytics and AI workflows—RAG pipelines, LLM APIs, LangChain, and vector databases—to enable generative AI use cases and semantic search. I focus on operational excellence, data quality, and delivering measurable business impact through robust, production-grade data platforms.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Change Healthcare

May 2023 - Present (2 years 9 months)

Architected and deployed an Azure lakehouse supporting 200+ TB and reduced query latency by 40%; engineered 25+ PySpark ETL pipelines processing 50M+ records daily with 99.8% SLA adherence and implemented Delta Lake medallion architecture to cut data inconsistencies by 90%.

Azure Data Factory Databricks Pyspark Delta Lake Azure Synapse Data Modeling CI CD

Data Engineer

Bank of America

Jan 2021 - Apr 2023 (2 years 3 months)

Designed and deployed AWS Glue and Databricks pipelines processing 100M+ transactions daily for risk analytics with 99.7% success rate; built Snowflake warehouses and streaming pipelines using Kinesis to enable sub-2-minute fraud detection alerts.

AWS Glue Databricks Snowflake AWS Kinesis Spark Structured Streaming SQL Python AWS S3 CI CD

ETL Developer

Zywave, Inc.

Oct 2018 - Dec 2020 (2 years 2 months)

Developed 15+ batch ETL pipelines with Airflow, SQL and Python processing 20M+ insurance records daily and built an AWS S3 data repository (5 TB) supporting 50+ downstream reports while improving data freshness from 24 to 6 hours.