Benny Moore

I’m a Senior Data Engineer with 7+ years designing and delivering scalable cloud-native data platforms—high-performance ETL/ELT pipelines and real-time streaming solutions—across finance, healthcare, retail, e-commerce, and technology.

I’ve built batch and streaming pipelines processing 2TB+ of data daily, improving performance by up to 50% and reducing cloud infrastructure costs by 25% through automation, optimization, and disciplined engineering practices. I’m particularly strong in Lakehouse architecture, Delta Lake, distributed processing, and enterprise data governance.

In my recent role, I designed scalable ETL/ELT pipelines using Python, PySpark, and Databricks (2TB+ daily), improved performance ~35% via Spark optimization, and led an on-prem to Snowflake migration that reduced query latency ~40% while cutting costs ~25%. I also built Kafka + Spark Structured Streaming pipelines and implemented Airflow orchestration with monitoring, retries, and SLA adherence to 99.9%.

I bring DataOps/DevOps rigor to production: dbt transformations with CI/CD, Docker, Kubernetes, and Terraform (IaC). I’ve improved transformation maintainability and deployment time (~30%), strengthened data quality and observability (reducing inconsistencies ~50–60%), and mentor junior engineers while partnering with data scientists, analysts, product managers, and business stakeholders to deliver KPI dashboards and AI-ready data foundations.