Open to opportunities

Shreejan Pandey

@shreejanpandey

Message

Senior data engineer crafting scalable cloud data platforms and real-time pipelines to drive analytics and governance.

United States

Message

What I'm looking for

I seek a senior data engineering role building cloud-native, governed data platforms and real-time pipelines, with cross-functional leadership and mentorship opportunities.

I am a Senior Data Engineer with eight years of hands-on experience building scalable data platforms across AWS, Azure, GCP, and Snowflake. I design and deliver complex ingestion and transformation pipelines (Kafka, Spark, dbt, Airflow) that reduced processing times from hours to under one hour and enabled near real-time analytics for millions of members.

I lead cross-functional teams, mentor engineers, and drive cloud migrations and governance initiatives to improve throughput, reduce infrastructure costs, and ensure HIPAA/GDPR compliance. My work integrates data warehousing, observability, and security to provide high-quality, production-ready data for analytics and ML teams.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

HighMark Health

Aug 2024 - Present (1 year 6 months)

Architected cloud-first data platform and ingestion pipelines across Azure and GCP, integrating 10+ legacy systems to enable near-real-time insights for 7M members and reduced claims processing from hours to under an hour.

Azure Data Factory Apache Kafka Snowflake BigQuery Pyspark Apache Airflow DBT Data Governance Azure Key Vault

Data Engineer

Guardian Life Insurance

Jan 2022 - Jul 2024 (2 years 6 months)

Supported migration of ETL processes to AWS and built ingestion pipelines with Kafka and Kinesis into S3, improving data flow efficiency and enabling real-time analytics for policy and claims data.

AWS Glue Apache Kafka Kinesis Pyspark Redshift S3 Apache Airflow DBT QuickSight

Junior Data Engineer

Liberty Mutual

Apr 2019 - Dec 2021 (2 years 8 months)

Developed real-time ingestion pipelines and migrated legacy ETL to Azure Synapse and Databricks, improving data access and reducing reporting times for underwriting and risk teams.

Azure Data Factory Azure Event Hubs Azure Synapse Databricks Pyspark Power BI Azure Key Vault

Backend Developer

SalesForce

Feb 2018 - Mar 2019 (1 year 1 month)

Built backend services and data ingestion pipelines integrating Salesforce CRM with backend systems using Python and APIs, reducing sync times and automating data migration processes.