Open to opportunities

James User

@jamesuser12

Message

Senior Data Engineer and architect specializing in scalable data pipelines.

United States

Message

What I'm looking for

I seek senior data engineering or architecture roles where I can design scalable, secure pipelines, lead teams, implement CI/CD and data‑quality practices, and drive measurable business impact in cloud or big‑data environments.

I am a Senior Data Engineer and Data Architect with 12+ years building scalable, secure data platforms and end-to-end ETL solutions across cloud and big‑data ecosystems. I have led migrations from legacy Hadoop systems to modern data lakes and cloud warehouses, improved pipeline performance by 40%, and delivered real‑time streaming systems that process millions of transactions per minute.

I excel at data model and database design, automation with CI/CD, and implementing DevSecOps and data‑quality practices. I collaborate effectively with cross‑functional teams, mentor engineers, and align data strategies with business objectives to deliver measurable analytics and reliability improvements.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

Capital One

Aug 2022 - Present (3 years 11 months)

Designed and deployed Spark and Airflow data transformation pipelines on AWS for financial analytics, boosting pipeline performance by 40% and reducing deployment complexity via containerization and data lake migration.

Performance Optimization Apache Spark Airflow AWS Docker Kubernetes CI CD DevSecOps

Staff Data Engineer

Snowflake

Apr 2019 - Jul 2022 (3 years 3 months)

Developed cloud data warehouses and ETL pipelines, refactored legacy data applications into modular services and automated CI/CD, reducing deployment time by 50% while improving database performance.

Snowflake ETL Data Modeling SQL Jenkins GitHub Actions CI CD Data Governance

Senior Data Engineer

Databricks

Jan 2016 - Mar 2019 (3 years 2 months)

Built enterprise-scale Spark and Delta Lake data solutions, automated real-time ingestion with Airflow and improved data quality, reducing errors by 30% and enabling unified analytics.

Apache Spark Delta Lake Airflow AWS Azure Data Quality Data Architecture

Data Engineer

Cloudera

Feb 2013 - Jan 2016 (2 years 11 months)

Maintained and enhanced Hadoop ecosystem big data systems, developed ETL testing automation reducing manual effort by 40%, and migrated legacy processes to Spark for improved maintainability.

Hadoop Apache Spark ETL Data Integration Database Design Performance Optimization