Bishal Bhattarai

I’m a Senior Data Engineer with 7+ years of professional experience designing and building scalable, secure, real-time data pipelines across healthcare and finance. I focus on delivering trusted analytics solutions in regulated environments, including early-stage Generative AI use cases.

I built a metadata-driven, self-service ingestion framework using AWS Glue, Spark, and S3 that enabled rapid onboarding of 10+ structured and semi-structured source systems into the lakehouse—reducing integration time by 60%. I engineered AWS-based pipelines with S3, Lambda, Step Functions, CloudWatch, and Glue Data Catalog for metadata management and auditability, and I optimize Spark jobs with Spark DataFrame and Spark SQL to cut execution time by 40% through partitioning, caching, and parallelization.

On healthcare platforms, I designed HIPAA-compliant patient monitoring analytics using AWS services including S3, SNS, SQS, Lambda, and Kinesis. I used Spark Structured Streaming with PySpark, Kafka/Kinesis, checkpointing, watermarking, and exactly-once processing patterns, and I enforced governance and security with Lake Formation RBAC, IAM/KMS, VPC Endpoints, and CloudTrail/CloudWatch with PHI masking and least-privilege access.

Across roles, I’ve delivered production-grade warehouse and modeling work with Snowflake, Delta Lake, and Medallion architecture (including star schema/snowflake-style modeling and SCD Type 2). I also automate deployments with CI/CD (Jenkins, GitHub Actions, Azure DevOps), provision infrastructure with Terraform modules, and lead POCs to enable LLM-integrated data platforms for retrieval-augmented generation (RAG) and conversational analytics.