luke lopez

I’m a Senior Data Engineer with 9+ years of experience designing enterprise-scale lakehouse platforms, real-time data pipelines, and cloud-native analytics solutions. I focus on building high-performance, AI-ready data platforms that power analytics, machine learning, and business-critical decision-making at scale.

At Walmart, I led an enterprise retail lakehouse platform unifying inventory, transaction, catalog, clickstream, fulfillment, and supply-chain data using Azure Databricks and Delta Lake. I built Medallion Architecture pipelines processing 100+ TB daily, improved reporting latency by 85%, and reduced inventory freshness latency from hours to minutes with streaming ingestion at massive event throughput.

I also developed enterprise data products (inventory availability, order promise accuracy, supplier performance, fulfillment intelligence, and demand forecasting) and increased business adoption by 50%. I established governance, observability, and data-quality frameworks using Unity Catalog, Great Expectations, OpenLineage, and monitoring tools—reducing production data incidents by 45%.

I enable AI-powered retail search, recommendation, and RAG workflows with Azure OpenAI, Azure AI Search, MLflow, and Databricks Feature Store, accelerating AI feature delivery by 40%. Previously at IQVIA and Allstate, I built clinical and claims data platforms with strong compliance, CDC ingestion, and performance optimization, including healthcare-standard data modeling aligned to HL7 FHIR and other specifications.