Open to opportunities

Sandesh Poudel

@sandeshpoudel

Message

Experienced data engineer specializing in scalable data solutions.

United States

Message

What I'm looking for

I am looking for a role that challenges my data engineering skills and offers opportunities for growth in a collaborative environment.

With over 7 years of experience in data engineering, I have honed my skills in designing and implementing scalable data solutions that drive business insights. My expertise lies in building robust ETL/ELT pipelines, utilizing technologies such as AWS Glue, Redshift, and Azure Data Factory to ensure seamless data integration and processing.

Throughout my career, I have led the development of high-volume data pipelines, leveraging tools like Apache Spark, Kafka, and Snowflake. My hands-on experience with Python, Scala, and advanced SQL enables me to perform real-time analytics and build machine learning models that enhance decision-making. I am passionate about optimizing data workflows and ensuring data governance, which has allowed me to deliver actionable insights to stakeholders effectively.

Experience

Work history, roles, and key accomplishments

Current

Data Engineer

Current

Highmark Health

May 2022 - Present (3 years)

Designed and developed ETL pipelines using Informatica PowerCenter and Python, optimizing data workflows and ensuring compliance with GDPR and HIPAA standards. Led data migration to Azure SQL DB and automated data ingestion into Azure Synapse Analytics, enhancing data processing efficiency.

ETL Python Azure Data Factory Azure Synapse GDPR HIPAA Databricks Azure SQL

Data Engineer

BOK Financial

Jun 2019 - Mar 2022 (2 years 9 months)

Implemented scalable Big Data processing on AWS EMR, automating data workflows with Apache Airflow and developing Python scripts for data cleaning. Designed data warehouses using Amazon Redshift and PostgreSQL, focusing on query optimization and scalability.

Apache Airflow Python Amazon Redshift PostgreSQL AWS Lambda Glue Snowflake Terraform Kibana

Big Data Developer

Centene Corporation

Sep 2017 - Apr 2019 (1 year 7 months)

Processed large-scale datasets using HDFS and Apache Hive, developing batch and real-time data processing workflows with Apache Spark and Kafka. Automated data ingestion pipelines and designed NoSQL database solutions using HBase.

Hadoop Apache Hive Apache Spark Kafka Sqoop HBase AWS S3 Python Flumes

Education

Degrees, certifications, and relevant coursework

Wright State University

Master’s in Data Analytics and Insights, Data Analytics

Master’s in Data Analytics and Insights program focused on equipping students with the skills to analyze data and derive actionable insights for business decision-making.