Open to opportunities

Daniel Andrade

@danielandrade1

I build scalable cloud data platforms, ETL pipelines, and analytics infrastructure.

I've built scalable data platforms and ETL pipelines for Capital One, Dealpath, and CCGroup, processing large-scale financial, real estate, and enterprise data with Apache Spark, Python, SQL, AWS, and Databricks. At Capital One, I improved data-processing performance by 30% through SQL and data-model optimization.

I've designed lakehouse and data warehouse architectures, automated ELT workflows with Airflow and dbt, and strengthened data quality, governance, lineage, encryption, and access controls. I work closely with analysts, data scientists, and cross-functional teams to deliver reliable data for business intelligence, AI, and predictive analytics.

Experience

Work history, roles, and key accomplishments

Current

Sr Data Engineer

Current

Capital One

Sep 2024 - Present (1 year 11 months)

Engineered ETL pipelines using Apache Spark and Python for real-time analytics. Designed data warehouse solutions on AWS Redshift and optimized SQL queries to improve performance by 30%.

Apache Spark Python AWS RedShift SQL Airflow Data Governance Data Quality Data Security ETL ELT Data Warehouse Cloud Architecture Distributed Systems Machine Learning Data Lineage

Sr Data Engineer

Dealpath

Nov 2020 - Sep 2024 (3 years 10 months)

Architected scalable data pipelines using PySpark and Databricks for real estate analytics. Developed lakehouse architecture with Delta Lake and improved data availability by 25%.

PySpark Databricks Delta Lake AWS DBT Airflow Data Quality Data Governance Data Security ETL ELT Lakehouse Cloud Architecture Cost Optimization

Sr Data Engineer

CCGroup Inc.

Sep 2019 - Nov 2020 (1 year 2 months)

Designed and developed ETL pipelines using Scala and Apache Spark. Implemented data lake solutions on AWS S3 and optimized SQL performance improving query speed by 20%.

Scala Apache Spark S3 SQL Airflow Data Quality Data Governance Data Security ETL Data Lake Cloud Architecture Streaming Batch Processing

Data Engineer Intern

University of California, Davis

Jan 2019 - Jun 2019 (5 months)

Developed data ingestion pipelines using Python and SQL for research analytics. Assisted in building data models and implementing data validation processes.

Python SQL Data Modeling Data Validation Data Quality ETL

Data Engineering Intern

UC Davis

Apr 2016 - Jun 2016 (2 months)

Supported development of ETL workflows using Python and SQL for academic projects. Contributed to database schema design and data cleansing activities.

Python SQL ETL Database Design Data Quality