Looking for a job

Brian Caple

@briancaple

Message

I build cloud data platforms, lakehouses, and real-time analytics pipelines.

United States

Message

What I'm looking for

I'm looking to build and optimize enterprise-scale cloud data platforms, lakehouses, and batch or real-time pipelines that deliver governed, high-quality datasets for analytics and AI/ML.

I'm building enterprise-scale batch and streaming data pipelines at InvoZone across AWS and GCP, supporting mission-critical analytics platforms.

I designed a Databricks lakehouse with Delta Lake Bronze, Silver, and Gold layers, and built ingestion frameworks for structured and semi-structured data into Snowflake, BigQuery, and Azure Synapse.

Previously at United Data Technologies, I led cloud data platform delivery for multi-terabyte analytics workloads, migrated warehouses to Redshift, BigQuery, and Snowflake, and developed Spark and Kafka pipelines.

Earlier at Altoros, I built scalable ETL frameworks, Spark applications on Databricks and AWS EMR, and data marts for enterprise reporting and analytics.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

InvoZone

Feb 2022 - Present (4 years 7 months)

Architected enterprise-scale batch and streaming data pipelines on AWS and GCP using AWS Glue, Airflow, PySpark, and Kafka. Designed and implemented a Databricks lakehouse architecture with Delta Lake and Bronze/Silver/Gold layers.

Senior Data Engineer

United Data Technologies

Nov 2017 - Jan 2022 (4 years 2 months)

Led design and delivery of enterprise cloud data platforms supporting multi-terabyte analytics workloads. Built large-scale ETL/ELT pipelines using Informatica, Talend, AWS Glue, PySpark, and Airflow.

Data Engineer

Altoros

Oct 2013 - Sep 2017 (3 years 11 months)

Designed scalable ETL frameworks for enterprise reporting and analytics systems. Built distributed Spark applications on Databricks and AWS EMR using PySpark and Spark SQL.