Open to opportunities

Prithvi Shetty

@prithvishetty

Message

I build governed cloud data platforms and high-volume pipelines for regulated industries.

United States

Message

What I'm looking for

I'm looking to build governed, cloud-native data platforms and scalable batch and streaming pipelines that improve data quality, analytics readiness and predictive insights in regulated enterprise environments.

At Galderma, I own 20+ production healthcare pipelines across Azure and Databricks, integrating clinical, claims, operational and third-party data into governed lakehouse and warehouse models. I improved Databricks and Spark job performance by 25–45% and delivered reporting layers for 50+ clinical, operational and leadership stakeholders.

Previously, at BCBS and Northern Trust, I built insurance and financial data platforms across AWS, Snowflake, Redshift, EMR, Kafka, Informatica and Talend. My work included processing millions of claims and transaction records, improving Redshift query performance by 35%, maintaining 98%+ pipeline SLA adherence, and reducing legacy ETL processing time by 30% through an Informatica-to-Talend migration.

I bring 9+ years of experience building batch and streaming pipelines, data quality controls, governed analytics datasets and ML-ready workflows across healthcare, insurance, banking and financial services.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Galderma

Nov 2023 - Present (2 years 10 months)

Owned 20+ production healthcare data pipelines across Azure and Databricks, integrating 10+ source systems and implementing 50+ validation checks. Improved Databricks and Spark job performance by 25-45% through partitioning, caching, and DAG tuning.

Azure Databricks Delta Lake PySpark Spark Snowflake DBT Unity Catalog Airflow Python CI CD Tableau Power BI

Data Engineer

BCBS

Dec 2021 - Nov 2023 (1 year 11 months)

Built and supported 30+ production insurance data pipelines, integrating 15+ source systems into AWS and Snowflake. Improved Redshift reporting query performance by 35% and maintained 98%+ SLA adherence.

AWS EMR Redshift Snowflake Spark SQL Data Modeling Monitoring Alerting Security

ETL Engineer

Northern Trust Bank

May 2020 - Dec 2021 (1 year 7 months)

Maintained and modernized 25+ Informatica and Talend ETL workflows, consolidating data into 15+ curated reporting datasets. Led migration to Talend, reducing processing time by 30%.

Informatica Talend Kafka AWS Redshift Hadoop Spark EMR CI CD Cloudwatch

Hadoop Engineer

Luxoft India Pvt. Ltd

Jul 2017 - Jul 2018 (1 year)

Administered Hadoop clusters and developed Hive, Spark, SQL, and Python ETL pipelines. Tuned 20+ Hadoop and Spark jobs to improve throughput and reduce resource contention.

Hadoop Hive Spark SQL Python Jenkins Docker

Data Analyst

Optimum Info System Pvt Ltd

Nov 2015 - Jun 2017 (1 year 7 months)

Automated data extraction, cleaning, and transformation workflows using Python, pandas, NumPy, and SQL. Built 10+ Tableau dashboards to visualize KPIs and support operational decision-making.

Python Pandas NumPy SQL Tableau