Looking for a job

Eric McGann

@ericmcgann

Message

Senior Data Engineer with expertise in real-time analytics solutions.

United States

Message

What I'm looking for

I am looking for opportunities that foster innovation, collaboration, and growth in data engineering and analytics.

As a Senior Data Engineer with over 8 years of experience, I specialize in designing and building end-to-end data solutions for real-time analytics, business intelligence, and AI applications. My journey has taken me through various roles where I've developed and maintained ETL pipelines, orchestrated workflows, and led ML-Ops efforts, all while ensuring data quality and performance.

At Chewy, I built and maintained ETL pipelines using Azure Data Factory, PySpark, and SQL, ingesting logistics and fulfillment data into Azure Data Lake Gen2 and Snowflake. My work has enabled near-real-time processing of delivery signals and exception alerts, significantly enhancing operational efficiency. Previously, at Walmart Global Tech, I designed large-scale data pipelines and implemented event-driven ETL workflows, which improved data ingestion and transformation across multiple domains, ultimately leading to smarter decision-making.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Chewy

Jun 2022 - Present (3 years 1 month)

As a Senior Data Engineer, I built and maintained ETL pipelines for logistics data using Azure Data Factory, PySpark, and SQL. I developed batch and streaming data pipelines with Databricks and Apache Spark, orchestrated workflows with Apache Airflow, and led ML-Ops efforts by deploying a custom Feature Store in Databricks.

Azure Data Factory Pyspark SQL Databricks Apache Spark Apache Airflow Snowflake Delta Lake

Senior Data Engineer

Walmart Global Tech

Jan 2020 - Jun 2022 (2 years 5 months)

In my role at Walmart Global Tech, I designed and developed large-scale data pipelines using Apache Spark and Scala, supporting the Pricing Intelligence platform. I implemented event-driven ETL workflows with Apache Airflow and led the build-out of a unified pricing metrics layer in dbt.

Apache Spark Scala Apache Airflow DBT Snowflake BigQuery ETL Data Pipelines

Data Engineer

TikTok

Oct 2017 - Dec 2019 (2 years 2 months)

As a Data Engineer at TikTok, I developed and optimized large-scale batch and streaming pipelines using Spark and Kafka. I migrated user engagement data marts to Snowflake, improving query performance significantly, and built the Content Insights Hub in Tableau to support global content strategy.

Spark Kafka Snowflake Tableau Data Migration Batch SQL Optimization

Education

Degrees, certifications, and relevant coursework

Villanova University

Bachelor of Science, Computer Science

2013 - 2017

Bachelor’s Degree in Computer Science, focusing on software development, data structures, algorithms, and systems design. Developed a strong foundation in programming and analytical skills necessary for a career in data engineering.