Bryan Schaefer

I am a Lead Data Engineer specializing in architecting and operating scalable data platforms that power analytics, reporting, and machine learning workloads. I design and implement both batch and streaming pipelines, cloud-native architectures, and distributed processing frameworks using modern data stack technologies.

At Flatiron Health I directed development of 30 batch and streaming pipelines processing 5TB daily and integrated 12 healthcare data sources to deliver curated analytics datasets that support BI and ML teams. I established data reliability and observability frameworks across 50 production pipelines, reducing failure rates by 35% and delivered feature-ready datasets for 20 ML models.

Previously, I engineered ETL and streaming pipelines at Flare and Uber, optimizing multi-terabyte workflows, improving query performance and pipeline throughput, and strengthening data quality monitoring to reduce incidents. I mentor engineers, introduced CI/CD and modular pipeline standards, and translate complex business and clinical requirements into production-grade, maintainable data solutions.

I bring strong foundations in data modeling, orchestration, observability, and automated data quality controls, and I collaborate closely with engineering, analytics, and data science teams to ensure platform scalability, reliability, and long-term sustainability.