Open to opportunities

Joshua Rogers

@joshuarogers1

Message

Staff Data Engineer building scalable lakehouse and real-time governed data platforms.

United States

Message

What I'm looking for

I’m looking to build and modernize governed lakehouse and streaming platforms—owning real-time pipelines, reliability (SLA), and lineage/security. I want to partner with data science and engineering teams to ship faster, improve audit readiness, and scale ML-ready analytics.

I’m a Staff Data Engineer with 9+ years of experience building scalable lakehouse, streaming, and cloud-native data platforms using Databricks, Spark, Kafka, Snowflake, Redshift, and AWS/Azure.

I deliver real-time pipelines, medallion architectures, and governed analytics platforms that support personalization, healthcare interoperability, experimentation, and ML workloads at petabyte scale—backed by production-grade engineering and 99.9%+ SLA reliability.

Most recently, I architected Nike’s Consumer 360 Personalization Lakehouse Platform and led real-time feature and audience workflows, cutting feature delivery latency from 4 hours to under 45 seconds. Earlier, I modernized an enterprise healthcare lakehouse, improving ingestion reliability to 99.9%, speeding onboarding by 60%, and strengthening HIPAA/SOC2-aligned governance and security controls.

Experience

Work history, roles, and key accomplishments

Current

Staff Data Engineer

Current

Nike

Dec 2023 - Present (2 years 7 months)

Architected Nike’s Consumer 360 Personalization Lakehouse Platform, unifying multiple telemetry sources into a centralized platform processing 120M+ events daily. Led development of a real-time personalization and audience feature platform and implemented enterprise medallion architecture with CDC ingestion and governed analytics.

Senior Data Engineer Tech Lead

Optum

Feb 2021 - Nov 2023 (2 years 9 months)

Modernized an enterprise healthcare lakehouse platform consolidating claims, EHR, pharmacy, provider, enrollment, and FHIR interoperability datasets for 285M+ records. Led HIPAA-compliant batch and streaming ingestion, governed semantic marts, and orchestration/observability modernization.

Senior Data Engineer

Uber

Aug 2019 - Jan 2021 (1 year 5 months)

Engineered a real-time Uber Eats Marketplace Analytics & Experimentation Platform for operational dashboards, merchant quality monitoring, delivery ETA analytics, and experimentation telemetry. Built high-volume Kafka ingestion and CDC pipelines, Spark/Hive ETL with Hudi, and monitoring frameworks to improve freshness and reduce recovery time.

Kafka Spark Hudi Pinot Hive Presto ETL Incremental Ingestion Replayable Backfills Curated Experimentation Datasets A B Testing Lineage Query Optimization

Data Engineer

Walmart

Oct 2015 - Jul 2019 (3 years 9 months)

Modernized Walmart’s supplier and replenishment analytics ecosystem by building batch and near real-time pipelines for POS, inventory, shipment, supplier EDI, and clickstream data. Developed large-scale Spark/Hadoop ETL and monitoring/reconciliation frameworks to improve data completeness and reduce operational support and batch runtimes.