Anjan Regmi
@anjanregmi
I am a Senior Data Engineer specializing in scalable cloud data platforms.
What I'm looking for
I am a Senior Data Engineer with 6+ years designing and building scalable, cloud-native data platforms across finance, healthcare, and retail. I build and optimize end-to-end ETL and streaming pipelines using AWS, Azure, and GCP, and integrate ML feature pipelines to drive business outcomes.
I focus on data governance, security, cost optimization, and observability while mentoring engineers and aligning data initiatives with product and compliance goals. My work has reduced pipeline effort and costs, improved deployment success, and delivered governed data products to broad stakeholder groups.
Experience
Work history, roles, and key accomplishments
Designed a scalable AWS S3 data lake and led development of 40+ ETL workflows using AWS Glue and Airflow, reducing manual effort and improving pipeline efficiency by 50%. Built real-time ingestion pipelines processing 2,000,000 events daily and implemented governance and security measures (PII masking, KMS) to meet SOC 2/HIPAA/GDPR requirements.
Big Data Developer
Cerner Corporation
Aug 2020 - Mar 2023 (2 years 7 months)
Implemented scalable ETL pipelines from Azure Blob to Snowflake and built 50+ PySpark pipelines and Synapse data marts, accelerating BI workloads and cutting query latency by 50%. Automated deployments and data quality with Jenkins, Databricks CLI, Terraform, and Great Expectations while ensuring HIPAA and SOC 2 compliance.
Data Engineer
WinCo Foods
Jan 2019 - Jun 2020 (1 year 5 months)
Developed 30+ high-throughput ETL pipelines using Informatica and Python, migrated MapReduce jobs to PySpark improving performance by over 50%, and modeled data marts for analytics across 300+ retail outlets. Implemented real-time ingestion with Kafka and Flume, data validation with Great Expectations, and reconciliation logic that reduced financial discrepancies by 35%.
Education
Degrees, certifications, and relevant coursework
Anjan hasn't added their education
Don't worry, there are 90k+ talented remote workers on Himalayas
Tech stack
Software and tools used professionally
Azure Synapse
Apache Spark
AWS Glue
AtScale
Data Studio
Amazon Quicksight
Amazon S3
GitHub
GitLab
Kubernetes
Jenkins
GitHub Actions
NumPy
Pandas
PySpark
dbt
DB
Sqoop
MySQL
PostgreSQL
MongoDB
Cassandra
Hadoop
HBase
Gmail
Databricks
Terraform
AWS CloudFormation
Jira
JSON
XML
Apache Flume
TensorFlow
PyTorch
scikit-learn
Keras
Kafka
Grafana
Kibana
Prometheus
Azure Monitor
Zookeeper
Ubuntu
Linux
macOS
Windows
Elasticsearch
Avro
AWS Lambda
Azure Functions
pytest
Airflow
Apache Beam
Time Analytics
SQL
Azure Blob Storage
ServiceNow
AWS KMS
LangChain
Great Expectations
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Anjan?
You can contact Anjan and 90k+ other talented remote workers on Himalayas.
Message AnjanFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
