Open to opportunities

Yash Master

@yashmaster

Message

Senior data engineer building governed ETL/ELT pipelines and lakehouse models for scalable enterprise analytics.

United States

Message

What I'm looking for

I’m looking to lead end-to-end data engineering on lakehouses—ETL/ELT, streaming, and dbt transformations—backed by strong governance, lineage, and data quality. I want to build reliable platforms teams can trust for analytics and reporting.

I’m a data engineer with 7+ years building and scaling ETL/ELT pipelines across AWS, Azure, and Databricks. I’m currently leading a legacy-to-cloud migration of enrollment data for university partner clients, engineering Python-based API ingestion into a Databricks Unity Catalog Lakehouse and dbt-driven transformations through silver, gold, and semantic layers.

I build production-grade models and reusable logic—like a Databricks Delta Lake star schema (fact plus 8 conformed dimensions) and 12 version-controlled dbt macros that centralize complex enrollment business rules. I also focus on lineage and reliability, using watermark-based incremental loads and governance patterns so partner data stays isolated in a shared multi-tenant Lakehouse.

Previously, I built real-time streaming pipelines (Kafka, Flink) and Spark batch jobs, and led a migration of Hulu’s on-prem feature store to AWS. I’m equally comfortable engineering the pipeline and the dashboards on top—bringing a practical blend of data engineering, analytics, and BI reporting to ensure teams share one governed source of truth.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Risepoint

Apr 2026 - Present (4 months)

Led a legacy-to-cloud migration of enrollment data for university partners, building Python-based API ingestion into a Databricks Unity Catalog Lakehouse. Implemented Bronze→Silver→Gold dbt pipelines, semantic-layer modeling, incremental watermark loads, and data-quality dashboards with governance controls.

Python Databricks Unity Catalog Delta Lake DBT SQL Data Ingestion Data Lineage Watermarking Data Modeling Data Quality Governance

Data & Analytics Engineer

Disney

Mar 2023 - Apr 2026 (3 years 1 month)

Built and maintained ETL/ELT pipelines and real-time streaming for Disney Streaming Services (DSS) and Hulu, translating stakeholder roadmaps into data products. Developed Kafka/Flink streaming and Spark batch feature pipelines, implemented feature-management API services, and supported production monitoring and CI/CD.

Harmony HBase S3 Delta Lake Hive Kafka Spark EC2 Athena Cloudwatch Redshift Jenkins GitHub Spinnaker Kubernetes PagerDuty APIs CRUD

Data Engineer

Accelerant

Feb 2022 - Mar 2023 (1 year 1 month)

Built Azure Data Factory pipelines to orchestrate ETL across multiple source systems and developed PySpark/Spark SQL applications for customer-facing insights. Tuned Databricks Spark, implemented Python UDFs, deployed ML models on Azure ML Studio, and migrated serving to Azure AKS/Container Apps with CI/CD in Azure DevOps.

Azure Data Factory Datasets Pipelines PySpark Databricks Azure ML Azure Container Apps Python UDFs Azure DevOps Azure Repos Azure Boards CI CD

Software Engineer

ELK Products

Mar 2020 - Feb 2022 (1 year 11 months)

Developed embedded software in C/C++, Python, and Java for control systems, including firmware aligned to industry standards and structured error handling. Integrated AWS IoT Core for reliable device-to-cloud communication and supported testing/debugging and engineering documentation.

C C++Python Java Embedded Software Firmware Development AWS IoT Core Testing Debugging

Engineering Intern

MCS

Jun 2016 - Dec 2017 (1 year 6 months)

Built SSIS packages to extract, transform, and load data from OLEDB, flat files, FTP/SFTP, and Excel sources into a SQL Server data warehouse. Designed and maintained SQL Server objects and automated scheduled batch workflows and SSRS reports for recurring reporting cycles.