Open to opportunities

Naresh Chaudhary

@nareshchaudhary

Senior Data Engineer modernizing healthcare and enterprise data platforms with cloud ETL/ELT, lakehouse, and real-time pipelines.

United States

Message

What I'm looking for

I’m looking for a role where I can modernize enterprise data platforms end to end—ETL/ELT, lakehouse, and real-time ingestion—while owning performance tuning, data quality, and production reliability in cloud environments.

I’ve built and modernized enterprise data platforms at Highmark Health, leading migrations to GCP with BigQuery, Snowflake, Databricks, and Cloud Storage. I designed scalable ETL/ELT workflows and standardized a Databricks Delta Lake medallion architecture so teams could trust and reuse analytics-ready datasets.

Before that, at Pfizer, I consolidated clinical and supply chain data into a lakehouse using Databricks, Delta Lake, Amazon S3, and Snowflake. I also accelerated onboarding with metadata-driven frameworks, orchestrated end-to-end pipelines with Airflow (MWAA), and delivered real-time and batch ingestion with Kinesis, Lambda, and Kafka while optimizing query performance.

Earlier in my career, I supported cloud-first reporting at Bank of America and developed Python utilities and data processing scripts at Deloitte—automating cleansing, transformations, and validation, plus building robust batch workflows with Spark, Hive, and Hadoop.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Highmark Health

Jan 2024 - Present (2 years 7 months)

Architected scalable healthcare data platforms on GCP using BigQuery, Snowflake, and Databricks to process over 4 TB of data weekly. Led migration of legacy platforms to GCP, improving scalability by 35%.

Google Cloud Platform BigQuery Cloud Storage Dataflow Pub Sub Cloud Functions IAM KMS Dataplex Cloud Build Apache Spark Apache Beam Terraform SQL Python Looker Databricks DBT Snowflake Delta Lake

Data Engineer

Pfizer

Jun 2022 - Dec 2023 (1 year 6 months)

Designed and implemented a scalable Lakehouse architecture using Databricks, Delta Lake, Amazon S3, and Snowflake. Led migration of legacy data warehouses to Snowflake and AWS.

AWS S3 AWS Glue EMR Redshift Lambda IAM KMS Lake Formation Apache Spark PySpark SQL Python Oracle Terraform Parquet Jira Confluence Databricks DBT Snowflake Delta Lake Power BI Tableau Amazon Quicksight Great Expectations

Data Developer

Bank of America

Apr 2021 - May 2022 (1 year 1 month)

Assisted in developing batch ETL pipelines using Azure Data Factory and Azure Databricks. Built scalable ingestion workflows into ADLS Gen2 using Parquet and partitioning.

Azure Azure Data Factory Azure Databricks Azure ADLS Gen2 azure monitor RBAC Apache Spark PySpark Delta Lake SQL Python Power BI Jira Confluence Microsoft Teams Parquet

Python Developer

Deloitte

Aug 2019 - Mar 2021 (1 year 7 months)

Developed Python based backend utilities and data processing scripts using Pandas and NumPy. Wrote and optimized SQL queries in Microsoft SQL Server and Oracle.