NK

Open to opportunities

nirjal kharel

@nirjalkharel

I build governed cloud data platforms and high-volume pipelines for healthcare, banking, and financial analytics.

At Pfizer, I lead eight commercial data products that process 350–500 GB daily, delivering governed prescription, payer, patient services, and HCP/HCO analytics. I build AWS lakehouse pipelines with Databricks, Spark, Snowflake, dbt, and Airflow, improving a critical nightly workflow by about 33%.

I've also modernized banking and insurance data platforms at Bank of America and The Hartford, supporting batch, CDC, and streaming workloads. I focus on reliable, secure data products with strong quality, governance, observability, and privacy controls for regulated data.

Experience

Work history, roles, and key accomplishments

PF

Current

Senior Data Engineer

Current

Oct 2023 - Present (2 years 11 months)

Lead end-to-end engineering and production ownership for 8 enterprise commercial data products, architecting scalable ETL/ELT pipelines and a cloud-native AWS Lakehouse with Medallion architecture. Implemented data governance, security, and AI/ML-ready pipelines while mentoring junior engineers.

BA

Data Engineer

Bank of America

Mar 2021 - Aug 2023 (2 years 5 months)

Engineered and supported 18 production ETL/ELT pipelines processing 120-160 GB of banking data daily, modernizing legacy SSIS workflows to Azure Data Factory and Databricks. Implemented Medallion architecture, CDC, and data quality controls while optimizing Spark workloads.

Python SQL PySpark Spark SQL Azure Data Factory Azure Databricks ADLS Gen2 Delta Lake Snowflake DBT SSIS SQL Server CDC Merge Star Schemas SCD Power BI Tableau Azure RBAC Key Vaults Microsoft Purview CI CD Azure DevOps

TH

Big Data Developer

Aug 2019 - Feb 2021 (1 year 6 months)

Developed and maintained 10-12 production ETL and Big Data pipelines processing 50-70 GB of policy and claims data daily. Assisted with cloud modernization to GCP and implemented data quality checks, incremental loading, and dimensional models.

Python SQL PySpark Apache Spark Hadoop HDFS Hive GCP Cloud Storage Dataflow Dataproc BigQuery Kafka Pub Sub Airflow Cloud Composer Oozie Tableau Power BI Jenkins CI CD IAM

Education

Degrees, certifications, and relevant coursework

UA

University of Texas at Arlington

Bachelor of Science, Information Systems

Bachelor of Science in Information Systems from the University of Texas at Arlington.

Availability

Open to opportunities

Location

United States

Authorized to work in

Social media

Job categories

Data Engineer Big Data Developer

Skills

Python SQL PySpark Spark SQL BASH Shell Scripting ETL ELT Batch Processing Real time processing Change Data Capture Incremental Loading Metadata Driven Architecture REST API Integration SFTP Data Cleaning data transformation Data Enrichment Deduplication Data Validation Data Reconciliation Azure Azure Data Factory Azure Databricks Data Lake Storage Gen2 Azure Synapse Azure Event Hubs Azure Functions Azure Key Vault Microsoft Purview Microsoft Fabric OneLake AWS S3 AWS Glue Amazon EMR Amazon Redshift Amazon Kinesis AWS Lambda DynamoDB Cloudwatch GCP BigQuery Dataflow Pub Sub Google Cloud Storage Databricks Apache Spark Delta Lake Unity Catalog Hadoop DBT Spark Structured Streaming Medallion Architecture Partitioning Caching Schema Evolution Distributed Processing Spark Optimization Query Optimization Cloud Cost Optimization Snowflake Dimensional Modeling Star Schemas Dimensional Modeling (Star And Snowflake Schemas)3NF Fact Tables Dimension Tables SCD Type 1 SCD2 Data Marts Semantic Modeling Parquet Avro JSON CSV XML Airflow Databricks Workflows SSIS Ab Initio Workflow Orchestration Dependency Management Data Backfilling SLA Management Failure Recovery Kafka Azure Stream Analytics Event Driven Architecture Stream Processing Dbt Testing Great Expectations Data Profiling Schema Validation Data Quality Framework Data Lineage Metadata Management Data Cataloging RBAC Row level security Column Level Security (CLS)Data Masking Managed Identities Private Endpoints Encryption HIPAA GDPR SOC2 Git GitHub Actions Azure DevOps Jenkins CI CD Terraform Infrastructure as Code ARM Templates CloudFormation Docker Kubernetes Testing Automation Production Monitoring Logging Alerting Pipeline Monitoring Incident Troubleshooting Performance Monitoring Monitoring Cost monitoring AI ML Data Pipelines LLM Training Data RAG Pipeline Document Processing Chunking Embeddings Vector Search Semantic Search Retrieval Pipelines Predictive Analytics PostgreSQL Microsoft SQL Server Oracle MongoDB Redis Power BI Tableau SAP Analytics Cloud KPI Reporting Dashboarding Healthcare Claims Clinical Data Provider Data Management Eligibility Payments Data Banking Transactions Fraud Generative AI Amazon Bedrock AWS Sagemaker Databricks Auto Loader Delta Change Data Feed Photon Adaptive Query Execution (AQE)Tokenization GxP FDA 21 CFR Part 11 HDFS Hive Dataproc Sqoop Cloud Composer Oozie IAM Cloud Build

Interested in hiring nirjal?

You can contact nirjal and 90k+ other talented remote workers on Himalayas.

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!