Open to opportunities

Andy Fields

@andyfields

Message

Senior Data Engineer specializing in scalable ETL, real-time analytics, and data platform reliability.

United States

Message

What I'm looking for

I seek a role focused on building scalable, real-time data platforms where I can lead engineering efforts, improve data quality, and mentor teams while aligning solutions to business outcomes.

I am a Senior Data Engineer with 10+ years of experience designing and optimizing large-scale data pipelines for e-commerce, retail, and tech organizations. I build high-performance ETL workflows using AWS, Trino, Spark, and Hive, implement governance and metadata solutions, and deliver reusable dashboards and reliable data products that enable faster business decisions.

I lead and mentor engineering teams, streamline data discovery with tools like Amundsen, and drive improvements in data quality, performance, and operational efficiency. I thrive on solving complex data problems, aligning technical solutions with business goals, and fostering cross-functional collaboration to deliver measurable impact.

Experience

Work history, roles, and key accomplishments

Senior Data Engineer

Lyft, Inc

Oct 2021 - Oct 2025 (4 years)

Built and optimized scalable ETL pipelines and orchestration for near-real-time ride-sharing analytics, reducing data ingestion time and improving pipeline reliability across high-traffic operations.

AWS Trino Spark Airflow Hive Amundsen ETL Data Lineage Mode

Senior Data Engineer

Amazon

Aug 2018 - Sep 2021 (3 years 1 month)

Architected and optimized ETL pipelines and real-time ingestion for Amazon’s Vendor Management system, improving vendor analytics and enabling faster, secure supplier data workflows.

AWS Glue Redshift Pyspark Kinesis Lambda SQL Data Modeling Lake Formation Data Governance

Data Engineer

Zaloni

Jan 2015 - Jul 2018 (3 years 6 months)

Built and maintained an enterprise data lake for The Gap using Spark and Hive, automating ingestion and enhancing metadata governance to support real-time inventory and customer analytics.

Apache Spark Hive Sqoop Kafka AWS S3 EMR Zaloni Bedrock Data Lake ETL

Education

Degrees, certifications, and relevant coursework

Texas Tech University

Bachelor of Science, Computer Science

2010 - 2014

Completed a Bachelor of Science in Computer Science with coursework in algorithms, systems, and software engineering from August 2010 to December 2014.