Open to opportunities

Shubh Singh

@shubhsingh

Message

Data Engineer specializing in scalable cloud-native big data pipelines and reliability.

India

Message

What I'm looking for

I am seeking a mid-level data engineering role building cloud-native, reliable, high-quality data pipelines and scalable analytics platforms with strong emphasis on data quality, automation, and collaboration.

I am a Data Engineer focused on building and optimizing scalable big data pipelines across Azure, AWS, and GCP to support analytics and machine learning.

I have hands-on experience with distributed computing using Apache Spark, Databricks, Hadoop ecosystem tools, and modern ELT frameworks such as dbt and Delta Live Tables.

My projects include end-to-end implementations that achieved 99.99% data quality and 100% idempotency, reusable star-schema builders, and dynamic, parameterized ingestion pipelines for real-world datasets.

I prioritize data quality, reliability, and performance optimization, and I deliver cloud-native solutions with strong orchestration, error handling, and validation practices to make data production-ready for analytics and ML.

Experience

Work history, roles, and key accomplishments

Data Engineer

Self-Directed Projects

Jul 2024 - May 2025 (10 months)

Built end-to-end cloud-native big data pipelines using Databricks, Delta Live Tables, and cloud orchestration to deliver high-quality analytical datasets with 99.99% data quality and 100% idempotency for ingestion workflows.

Pyspark Databricks Delta Live Tables Azure Data Factory DBT Autoloader Airflow Delta Lake SQL Auto Loader

Education

Degrees, certifications, and relevant coursework

DIT University

Bachelor of Technology, Data Science & Analytics

2021 -

Pursuing a Bachelor of Technology in Data Science & Analytics at DIT University, covering data engineering, machine learning, and big data technologies with expected completion in May 2025.