Nirmal Shahi
@nirmalshahi
Senior Data Engineer specializing in scalable, cost‑efficient multi‑cloud platforms.
What I'm looking for
I am a Senior Data Engineer with over eight years of experience building, modernizing, and stabilizing large-scale cloud data platforms across GCP, AWS, and Azure. I combine deep technical expertise with a full ownership mentality to deliver reliable data ecosystems that serve executives and 100+ internal stakeholders.
I have architected platforms processing more than 1.5 TB of data daily, redesigned failing batch and streaming architectures to reduce pipeline failures by 45% and latency by 40%, and optimized Snowflake to lower warehouse costs by 32%, saving over $600K annually.
My work includes implementing Terraform IaC, enterprise CI/CD (Azure DevOps, GitHub Actions, Cloud Build), and robust IAM and encryption controls to meet audit and regulatory standards. I champion observability, automated retries, schema validation, and monitoring practices that significantly reduce MTTD/MTTR and operational incidents.
I mentor and grow cross-functional squads, standardize data testing and documentation, and partner with product, clinical, and security stakeholders to deliver high-impact analytics and near real-time ingestion solutions that improve decision support and care outcomes.
Experience
Work history, roles, and key accomplishments
Senior Data Engineer
Universal Health Service
Mar 2023 - Present (2 years 11 months)
Led design and implementation of a cloud-native, multi-region GCP data platform serving 400+ facilities, reducing end-to-end data latency by 40% and pipeline failures by 85% through orchestration, observability, and IaC improvements.
Data Engineer
Medtronic
Jan 2021 - Feb 2023 (2 years 1 month)
Designed and supported Azure-native data pipelines and migrations from AWS, improving batch processing efficiency by 40% and reducing operational overhead by 30% via ETL/ELT redesign and Terraform IaC.
Data Engineer
MassMutual
Jun 2019 - Dec 2020 (1 year 6 months)
Supported policy and claims reporting pipelines on AWS and Snowflake, reducing job failures by 50% and compute usage by 20% through ETL automation, dbt/Snowflake transformations, and Airflow orchestration.
Junior Backend Developer
XYZ Financial Services
Jan 2018 - May 2019 (1 year 4 months)
Built scalable batch pipelines and stabilized ETL workflows using AWS, Redshift, and Airflow, improving reporting turnaround by 35% and reducing recurring failures by 60%.
Education
Degrees, certifications, and relevant coursework
Southern Illinois University Edwardsville
Master of Science, Computer Science
Master of Science in Computer Science focused on advanced computing topics and applied data systems.
Tech stack
Software and tools used professionally
Azure Synapse
Apache Spark
AWS IAM
Microsoft Azure
Google Cloud Platform
GitHub
Kubernetes
Jenkins
GitHub Actions
Azure Pipelines
PySpark
dbt
MySQL
PostgreSQL
MongoDB
Gmail
Spring Boot
Databricks
Terraform
Azure DevOps
Java
Kafka
Azure Monitor
Azure Active Directory
Avro
Azure SQL Database
Airflow
Apache Beam
Amazon Web Services (AWS)
SQL
Factory
Beam
Remote
Jan
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Nirmal?
You can contact Nirmal and 90k+ other talented remote workers on Himalayas.
Message NirmalFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
