Open to opportunities

Shane Emad User

@shaneemaduser

Message

Lead Data Engineer building scalable lakehouse and real-time data platforms.

United States

Message

What I'm looking for

I seek technical leadership roles building scalable cloud-native data platforms, prioritizing data quality, observability, and cross-functional collaboration.

I am a Lead Data Engineer with a decade of experience designing and delivering scalable data platforms, real-time streaming systems, and Lakehouse architectures that enable analytics and ML at enterprise scale. I have led cross-functional teams to modernize legacy systems, enforce governance and data quality, and reduce infrastructure costs while improving performance and reliability.

My work spans cloud and distributed environments—architecting platforms with Databricks, Snowflake, Spark, Kafka, and Kubernetes, and implementing validation, lineage, and observability frameworks that cut incidents and accelerate time-to-insight. I focus on secure, production-ready data products, mentorship, and operational excellence to drive data, AI, and business intelligence outcomes.

Experience

Work history, roles, and key accomplishments

Lead Data Solutions Engineer

OneTrust

Mar 2023 - Feb 2026 (2 years 11 months)

Architected an enterprise Lakehouse on Azure Databricks, Snowflake, Spark, and Delta Lake enabling scalable analytics and ML workloads and reduced infrastructure costs by over 25%. Led cross-functional teams to deliver real-time streaming pipelines, executive reporting datasets, and governance standards improving data quality and reliability.

Databricks Snowflake Spark Delta Lake Kafka DBT Power BI Kubernetes Python

Senior Distributed Data Engineer

Nice

Jan 2020 - Feb 2023 (3 years 1 month)

Engineered distributed batch and streaming pipelines with Spark, Airflow, Kafka, and Snowflake, migrating legacy systems to cloud-native architecture and accelerating data onboarding while improving performance and reliability.

Spark Airflow Kafka Snowflake DBT Python SQL AWS Distributed Systems

Data Integration Engineer

Grafana Labs

Jun 2017 - Dec 2019 (2 years 6 months)

Developed scalable ingestion pipelines and unified ingestion frameworks using Python, SQL, and orchestration tools, automating ETL workflows and monitoring to reduce manual intervention and improve enterprise analytics readiness.

Python SQL APIs ETL Orchestration Data Modeling Data Validation Monitoring Warehouse Design

Data Engineer (AI Platform)

Nexla

Mar 2016 - May 2017 (1 year 2 months)

Built foundational pipelines with Python, SQL, Hadoop, and Spark to support analytics and ML experimentation, producing feature-ready datasets and improving processing efficiency and stability.