Open to opportunities

Sanjit Thapa Magar

@sanjitthapamagar

Message

Data Engineer with 7 years of experience in scalable data solutions.

United States

Message

What I'm looking for

I am looking for a role that offers opportunities for growth, collaboration, and innovative data solutions.

I am a Data Engineer with over 7 years of experience in designing, building, and optimizing scalable data pipelines and ETL workflows. My expertise lies in developing end-to-end data solutions on AWS and Azure, utilizing services like AWS Glue, Redshift, and Azure Data Factory to drive business insights and operational efficiency.

Throughout my career, I have harnessed big data tools such as Apache Spark and Kafka to manage large-scale datasets effectively. I am passionate about delivering actionable insights through in-depth data analyses and visualizations, enabling data-driven decision-making. My strong technical skills in Python, SQL, and various cloud technologies empower me to create robust data architectures that support diverse analytical needs.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Truist Financial

May 2023 - Present (2 years 1 month)

Designed and deployed intricate ETL procedures using AWS Glue and Apache Airflow. Developed serverless architectures for data processing and managed data lakes on AWS S3. Optimized Apache Spark jobs for improved analytics performance and integrated third-party APIs into AWS pipelines.

AWS Glue Apache Airflow AWS Lambda Amazon S3 Apache Spark Snowflake PostgreSQL Jenkins Docker Kubernetes

Big Data Developer

Cerner Corporation

Aug 2020 - Mar 2023 (2 years 7 months)

Implemented scalable data pipelines using PySpark and optimized data warehouses with Azure Synapse Analytics. Automated real-time data ingestion and developed Python-based data validation frameworks. Managed large datasets using Azure Databricks and designed event-driven architectures.

Pyspark Azure Data Factory Azure Synapse Azure Blob Storage Databricks Azure Functions Terraform Spark

Data Engineer

WinCo Foods

Jan 2017 - Jul 2020 (3 years 6 months)

Created and evaluated ETL processes using Informatica PowerCenter and automated data operations with Apache Airflow. Built reliable data pipelines with Apache Spark and optimized SQL queries. Developed dashboards using Kibana for actionable insights.