Skip to main content
JR
Open to opportunities

Joshua Rogers

@joshuarogers

Staff Data Engineer building governed, real-time lakehouse platforms that power personalization and ML at petabyte scale.

United States
Message

What I'm looking for

I’m looking to build and modernize governed data platforms—real-time lakehouses with strong reliability, lineage, and security—so teams can ship personalization and analytics faster, collaborate with ML/BI, and own end-to-end outcomes.

I’m a Staff Data Engineer with 9+ years of experience building scalable lakehouse, streaming, and cloud-native data platforms using Databricks, Spark, Kafka, Snowflake, Redshift, and AWS/Azure technologies. I focus on real-time pipelines, medallion architectures, and governed analytics that support personalization, healthcare interoperability, experimentation, and ML workloads at petabyte scale.

At Nike, I architected a Consumer 360 Personalization Lakehouse Platform unifying app, SNKRS, NRC, Nike.com, and partner telemetry into a centralized member intelligence platform processing 120M+ consumer interaction events daily. I led a real-time Personalization & Audience Feature Platform that reduced feature delivery latency from 4 hours to under 45 seconds, using Spark Structured Streaming, a Redis-backed Feature Store, and Delta Change Data Feed. I also built enterprise-scale Bronze/Silver/Gold medallion CDC ingestion pipelines across 40+ upstream systems, and delivered governed semantic marts enabling self-service analytics for 500+ global stakeholders.

I’ve strengthened reliability and governance through Unity Catalog, AWS Lake Formation, RBAC, OpenLineage integrations, and production engineering practices like Terraform-based IaC and CI/CD automation. At Optum, I modernized an Enterprise Healthcare Lakehouse Platform supporting 285M+ patient/member records, improving onboarding time for new clinical data domains by 60% and ingestion reliability to 99.9%. At Uber and Walmart, I delivered high-volume streaming and batch pipelines that improved freshness and performance, reduced incidents by 40%, and raised reliability—while partnering with ML teams to operationalize feature engineering and experimentation workflows.

Experience

Work history, roles, and key accomplishments

Nike logoNI
Current

Staff Data Engineer

Dec 2023 - Present (2 years 7 months)

Architected Nike’s Consumer 360 Personalization Lakehouse Platform unifying app, SNKRS, NRC, Nike.com, and partner telemetry into a centralized member intelligence system. Built real-time personalization and audience feature platforms using Spark Structured Streaming, Delta Lake, and Unity Catalog, and implemented enterprise governance, CDC ingestion, and reliability improvements.

Optum logoOP

Senior Data Engineer Tech Lead

Feb 2021 - Nov 2023 (2 years 9 months)

Led modernization of an enterprise healthcare lakehouse platform integrating claims, EHR, pharmacy, provider, enrollment, and FHIR interoperability datasets. Implemented HIPAA-compliant governed batch/streaming ingestion, semantic marts, and CDC-based Delta pipelines, and directed orchestration modernization and data quality/observability improvements.

Uber logoUB

Senior Data Engineer

Aug 2019 - Jan 2021 (1 year 5 months)

Engineered a real-time Uber Eats Marketplace analytics and experimentation platform for operational dashboards, merchant quality monitoring, delivery ETA analytics, and experimentation telemetry. Built high-volume Kafka ingestion and CDC pipelines and scalable Spark/Hudi ETL workflows, including data quality/lineage/SLA monitoring and query-performance optimizations.

WA

Data Engineer

Oct 2015 - Jul 2019 (3 years 9 months)

Modernized Walmart’s supplier and replenishment analytics ecosystem by building scalable batch and near real-time pipelines integrating POS, inventory, shipment, supplier EDI, and clickstream datasets. Developed Kafka-driven inventory processing and large-scale Spark ETL frameworks, and implemented reconciliation/replay/monitoring plus workload and runtime optimizations.

Education

Degrees, certifications, and relevant coursework

Miami University logoMU

Miami University

Bachelor's Degree, Computer Engineering

2010 - 2014

Earned a Bachelor's Degree in Computer Engineering (Engineering Management/Computer Science) from Miami University from 2010 to 2014.

Get matched with your dream remote job

Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan