Open to opportunities

Omiel Ben

@omielben

Message

Senior Data Engineer building scalable, compliant real-time data platforms.

United States

Message

What I'm looking for

I’m looking for a role where I can build scalable cloud data platforms and reliable real-time pipelines—while strengthening governance and observability for HIPAA/GDPR/SOC2—working with cross-functional stakeholders and mentoring teams.

I’m a Senior Data Engineer with 10+ years of experience architecting and scaling cloud-native data platforms across fintech, healthcare, financial services, and enterprise analytics. I specialize in Snowflake, Databricks, dbt/dbt Cloud, Kafka, Spark, and lakehouse architectures (Delta Lake, Apache Iceberg, Hudi), delivering high-throughput batch and real-time pipelines built for ML/AI-ready data foundations.

Most recently at Mountainise, I architected and delivered end-to-end batch and real-time pipelines processing billions of healthcare records annually, achieving 99% pipeline reliability and reducing data incidents by 35%. I’m also strong in data governance, observability (Monte Carlo, Great Expectations), and compliance (HIPAA, GDPR, SOC2), with hands-on CI/CD and infrastructure automation using Terraform, Docker, Kubernetes, and GitHub Actions/Azure DevOps, plus a proven track record partnering with Product, Analytics, Finance, and Compliance teams to ensure timely, accurate data delivery.

Experience

Work history, roles, and key accomplishments

Senior Data Engineer

Mountainise

Feb 2025 - Apr 2026 (1 year 2 months)

Architected and delivered end-to-end batch and real-time healthcare data pipelines processing billions of records annually, achieving 99% reliability and reducing data incidents by 35%. Built CDC/ELT and reverse-ETL integrations across AWS/Azure/GCP and automated infrastructure and observability using Terraform, Monte Carlo, and Great Expectations.

Python SQL Pyspark Kafka Snowflake Delta Lake Apache Iceberg Terraform Monte Carlo

Data Engineer

Alpha Bridge Consulting

Aug 2020 - Jan 2025 (4 years 5 months)

Built and maintained large-scale ETL/ELT pipelines using Java, Apache Spark, NiFi, and ingestion tools like Fivetran and Airbyte across hybrid AWS/Azure environments. Implemented CDC with Debezium into Snowflake and integrated data quality/governance with Great Expectations and Monte Carlo, optimizing storage/compute costs by 22% while supporting HIPAA/GDPR/SOC2 compliance.

Java Apache Spark Apache NiFi Fivetran Airbyte Debezium Snowflake Great Expectations Monte Carlo Data Governance

ETL Developer

DAS42

Jan 2016 - Jul 2020 (4 years 6 months)

Owned ETL/ELT development to transform and load data into dimensional models and OLAP structures supporting BI, financial analytics, and ML workloads. Developed pipelines using Python, SQL, PySpark, and dbt and maintained scalable data lake patterns for downstream consumption.

Python SQL Pyspark DBT ETL ELT Dimensional Models OLAP Data Pipelines