Open to opportunities

Shiv Hari Baral

@shivharibaral

Message

I am a Senior Data Engineer delivering secure, scalable cloud data platforms and self-service analytics.

United States

Message

What I'm looking for

I seek a senior data engineering role building secure, scalable cloud data platforms and self-service analytics, partnering with ML teams in an Agile, compliance-focused environment where I can mentor and drive production-grade delivery.

I am a Senior Data Engineer with 6+ years building secure, scalable data platforms across AWS, Azure, and GCP to enable executive-ready analytics and compliant data access.

I have delivered both real-time and batch ETL/ELT pipelines, tuned data warehouses to reduce query times by up to 60%, modularized transformations with dbt to cut query time by 45%, and built centralized data lakes for multi-domain analytics.

I prioritize data quality, governance, and security—implementing Great Expectations, Lake Formation, KMS, IAM, and vaulting solutions—while shipping reproducible infrastructure with Terraform, CI/CD, and automated monitoring to reduce MTTR and SLA breaches.

I am an Agile collaborator and mentor who partners with product and ML teams to produce feature-ready datasets, deploy RAG and predictive models, and drive trustworthy, production-grade analytics across regulated industries.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Cardinal Health

Jun 2023 - Present (2 years 2 months)

Designed and deployed a centralized data lake and AWS-native ETL platform, tuning Redshift and introducing dbt to reduce weekly sales report execution time by 60% and query time by 45%. Implemented data quality frameworks and Terraform-driven infrastructure, reducing reconciliation effort by 30% and maintaining 100% HIPAA/compliance adherence.

AWS Glue Amazon Redshift DBT Terraform Pyspark Kinesis Great Expectations Airflow

Data Analytics Engineer

Lockheed Martin

Jan 2021 - Apr 2023 (2 years 3 months)

Built multi-cloud real-time and batch ingestion pipelines into S3, ADLS Gen2, and GCS and containerized secure processing on EKS, standardizing schema-on-read patterns for analytics-ready datasets. Established unified metadata and lineage across Glue Catalog and Azure Purview, and delivered executive dashboards and monitoring to support governance and anomaly detection.

AWS Glue Pyspark Azure Synapse BigQuery Kafka Airflow DBT

Data Engineer

Berkshire Hathaway

Aug 2018 - Dec 2020 (2 years 4 months)

Migrated legacy clinical ETL to AWS Glue, Step Functions, and Lambda, reducing end-to-end batch processing time by 60% and cutting operational dashboard lag by 35%. Implemented HIPAA-compliant data lake and reproducible Terraform deployments, reducing manual environment setup time by 70% and improving auditability with dbt lineage.