Joshua Rogers
@joshuarogers
Staff Data Engineer building governed, real-time lakehouse platforms that power personalization and ML at petabyte scale.
What I'm looking for
I’m a Staff Data Engineer with 9+ years of experience building scalable lakehouse, streaming, and cloud-native data platforms using Databricks, Spark, Kafka, Snowflake, Redshift, and AWS/Azure technologies. I focus on real-time pipelines, medallion architectures, and governed analytics that support personalization, healthcare interoperability, experimentation, and ML workloads at petabyte scale.
At Nike, I architected a Consumer 360 Personalization Lakehouse Platform unifying app, SNKRS, NRC, Nike.com, and partner telemetry into a centralized member intelligence platform processing 120M+ consumer interaction events daily. I led a real-time Personalization & Audience Feature Platform that reduced feature delivery latency from 4 hours to under 45 seconds, using Spark Structured Streaming, a Redis-backed Feature Store, and Delta Change Data Feed. I also built enterprise-scale Bronze/Silver/Gold medallion CDC ingestion pipelines across 40+ upstream systems, and delivered governed semantic marts enabling self-service analytics for 500+ global stakeholders.
I’ve strengthened reliability and governance through Unity Catalog, AWS Lake Formation, RBAC, OpenLineage integrations, and production engineering practices like Terraform-based IaC and CI/CD automation. At Optum, I modernized an Enterprise Healthcare Lakehouse Platform supporting 285M+ patient/member records, improving onboarding time for new clinical data domains by 60% and ingestion reliability to 99.9%. At Uber and Walmart, I delivered high-volume streaming and batch pipelines that improved freshness and performance, reduced incidents by 40%, and raised reliability—while partnering with ML teams to operationalize feature engineering and experimentation workflows.
Experience
Work history, roles, and key accomplishments
Architected Nike’s Consumer 360 Personalization Lakehouse Platform unifying app, SNKRS, NRC, Nike.com, and partner telemetry into a centralized member intelligence system. Built real-time personalization and audience feature platforms using Spark Structured Streaming, Delta Lake, and Unity Catalog, and implemented enterprise governance, CDC ingestion, and reliability improvements.
Led modernization of an enterprise healthcare lakehouse platform integrating claims, EHR, pharmacy, provider, enrollment, and FHIR interoperability datasets. Implemented HIPAA-compliant governed batch/streaming ingestion, semantic marts, and CDC-based Delta pipelines, and directed orchestration modernization and data quality/observability improvements.
Engineered a real-time Uber Eats Marketplace analytics and experimentation platform for operational dashboards, merchant quality monitoring, delivery ETA analytics, and experimentation telemetry. Built high-volume Kafka ingestion and CDC pipelines and scalable Spark/Hudi ETL workflows, including data quality/lineage/SLA monitoring and query-performance optimizations.
Modernized Walmart’s supplier and replenishment analytics ecosystem by building scalable batch and near real-time pipelines integrating POS, inventory, shipment, supplier EDI, and clickstream datasets. Developed Kafka-driven inventory processing and large-scale Spark ETL frameworks, and implemented reconciliation/replay/monitoring plus workload and runtime optimizations.
Education
Degrees, certifications, and relevant coursework
Miami University
Bachelor's Degree, Computer Engineering
2010 - 2014
Earned a Bachelor's Degree in Computer Engineering (Engineering Management/Computer Science) from Miami University from 2010 to 2014.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Joshua?
You can contact Joshua and 90k+ other talented remote workers on Himalayas.
Message JoshuaGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
