Anish Pokharel
@anishpokharel
Senior data engineer building reliable batch and streaming pipelines and AI-ready data infrastructure.
What I'm looking for
I’m a Senior Data Engineer with over 7 years of experience turning large, complex data into reliable platforms my stakeholders can trust. I design and optimize batch and streaming ETL/ELT pipelines using Apache Spark, Kafka, Apache Airflow, and dbt—centered on data modeling, data quality, and data governance.
Much of my recent work focuses on lakehouse architectures and migrating legacy ETL into cloud-native pipelines across Azure, AWS, and GCP, including Snowflake and Databricks. I also lead migration initiatives and mentor junior engineers, and I’ve shifted toward AI data infrastructure—building RAG pipelines with embedding workflows, vector search, and LLM integration while treating security, HIPAA compliance, and governance as design principles from day one.
Experience
Work history, roles, and key accomplishments
Designed and built enterprise-scale insurance data pipelines on Azure, including batch and near real-time streaming for policy and transaction data. Led legacy SSIS/SQL Server ETL migration to cloud-native pipelines and implemented governance, security, and automated data quality.
Built scalable GCP data pipelines for insurance analytics, including distributed ETL/ELT on Dataproc and a BigQuery lakehouse with dbt transformations. Implemented batch and streaming orchestration, governance, and data quality using Cloud Composer, Pub/Sub/Kafka, Dataplex, and Great Expectations.
Supported migration from legacy Hadoop/Hive workloads to modern cloud pipelines using Databricks and Spark. Developed AWS Glue ETL for high-volume transactions and built streaming and data quality frameworks across S3, Kinesis, Lambda/Step Functions, and Snowflake.
Built and tuned Hadoop-based ETL pipelines for customer engagement and retail transaction data using Hive, Pig, Sqoop, and MapReduce. Developed ingestion, streaming, and data quality workflows with Oozie, Flume, and Hive UDFs, and supported reporting outputs to Teradata and analytics teams.
Education
Degrees, certifications, and relevant coursework
Midwestern State University
Master of Business Administration (MBA), Business Analytics
Completed an MBA with a focus in Business Analytics at Midwestern State University in Wichita Falls, Texas.
Tech stack
Software and tools used professionally
Amazon Redshift
Azure Synapse
Apache Spark
AWS Glue
AWS IAM
Azure RBAC
Google Cloud Platform
Stackdriver
GitHub
Docker Cloud
AWS CodePipeline
GitHub Actions
Pandas
PySpark
dbt
Sqoop
MySQL
Hadoop
Gmail
Databricks
Terraform
Azure DevOps
Java
JSON
Kafka
Zookeeper
Avro
Azure SQL Database
Airflow
Azure Analysis Services
SQL
Apache Impala
Delta Lake
Great Expectations
Bash
Microsoft Fabric
Keep
Factory
Matter
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Anish?
You can contact Anish and 90k+ other talented remote workers on Himalayas.
Message AnishGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
