Open to opportunities

S Cole User

@scoleuser

Message

Senior Data Engineer specializing in scalable cloud data platforms, ETL/ELT, and real-time pipelines.

United States

Message

What I'm looking for

I seek a senior data engineering role building scalable cloud data platforms and real-time pipelines, with strong emphasis on observability, performance optimization, and enabling analytics and ML.

I am a Senior Data Engineer with 7+ years designing, building, and maintaining scalable data pipelines for batch and real-time streaming systems across healthcare, SaaS, and digital commerce domains.

I have deep expertise in advanced SQL, Python for data engineering, ETL/ELT, and cloud-native lakehouse architectures, and I routinely use Spark/PySpark, Kafka, Airflow, and ClickHouse to optimize performance and scalability.

My work has reduced pipeline failures by 38%, cut reporting latency by 45%, and decreased query latency by 52% through migrations, partitioning, and compute optimization strategies.

I hold multiple cloud and data engineering certifications (Google Cloud Professional Data Engineer, AWS Data Analytics Specialty, Azure DP-203, Snowflake SnowPro, Databricks, and dbt) and I focus on delivering reliable, monitored, and performant data platforms that enable analytics, ML, and operational use cases.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Pulse Metric Solutions

Jan 2022 - Present (4 years 1 month)

Architected and maintained large-scale ETL/ELT pipelines for clinical, claims, and behavioral datasets, reducing pipeline failures by 38% through improved Airflow orchestration and data quality checks.

Python SQL Pyspark Apache Airflow Data Modeling Data Quality AWS S3 Monitoring

Data Engineer

Insight Loop Technologies

Aug 2019 - Dec 2021 (2 years 4 months)

Built scalable ELT pipelines and real-time ingestion using Kafka and Pub/Sub patterns to power product analytics, cutting reporting latency by 45% through transformation tuning and partitioning.

Python SQL Airflow Kafka BigQuery Snowflake ELT Performance Tuning Streaming

Junior Data Engineer

Commerce Sight Analytics

Jun 2017 - Jul 2019 (2 years 1 month)

Developed SQL-based ingestion and transformation pipelines and automated API jobs to support e-commerce analytics, improving pipeline reliability with logging, validation, and monitoring.