Open to opportunities

Michael Livingston

@michaellivingston1

Message

Big Data & software engineer building scalable streaming and ETL data platforms.

United States

Message

What I'm looking for

I’m looking for a role where I build reliable big-data streaming and ETL systems in the cloud, improve performance, and strengthen data quality with observability—so teams can trust analytics and scale with confidence.

I’m a Big Data & Software Engineer with 9+ years designing and implementing scalable data platforms, real-time streaming systems, and distributed processing solutions. I build robust ETL pipelines, data lakes, and data warehousing architectures, using strong data validation to improve reliability and performance.

Recently, I designed a real-time event processing platform with Apache Flink for low-latency transformations at millions of events per day, and built ingestion pipelines with Apache Kafka plus schema enforcement via Confluent Schema Registry. I’ve also developed cloud-based data lakes on Amazon S3 (improving query performance ~30%), implemented ACID-compliant storage with Apache Iceberg, and delivered batch/stream pipelines with Apache Spark (Structured Streaming) alongside Snowflake improvements (~25% lower query latency) and Delta Lake incremental processing.

Experience

Work history, roles, and key accomplishments

Current

Big Data & Software Engineer

Current

AAA Auto Club Enterprises

Apr 2025 - Present (11 months)

Designed a real-time event processing platform with Apache Flink for low-latency transformations handling millions of events per day. Built Kafka ingestion with schema enforcement and developed an S3-based data lake that improved query performance by ~30%.

Apache Flink Apache Kafka Amazon S3 Apache Iceberg Anomaly Detection

Current

Software Engineer

Current

AAA

Apr 2022 - Present (3 years 11 months)

Built large-scale batch and streaming pipelines using Apache Spark (Structured Streaming), processing terabytes of data daily. Reduced Snowflake query latency by ~25% and optimized Spark job execution time by ~20%, while enforcing data quality with Great Expectations.

Apache Spark Spark Structured Streaming Apache Airflow Snowflake Python fastAPI Delta Lake Great Expectations Azure Data Factory Data Validation

Software Engineer

T-Mobile

Jul 2021 - Apr 2022 (9 months)

Developed Python/NumPy data preprocessing pipelines to support model feature extraction and transformation. Built batch data pipelines and model evaluation workflows, improving prediction accuracy by ~10%.

Python NumPy data preprocessing Data Pipelines Relational Databases Model Evaluation Unit Testing

DevOps Engineer

AAA

Aug 2020 - Jul 2021 (11 months)

Implemented Jenkins CI/CD pipelines to reduce deployment time by ~40% and integrated automated test stages before deployment. Containerized services with Docker and Kubernetes, and improved monitoring issue detection time by ~30% using Prometheus and Grafana.

Jenkins CI CD Docker Kubernetes Terraform Prometheus Grafana Monitoring Automated Testing

Java Developer

AAA

Jul 2018 - Aug 2020 (2 years 1 month)

Developed backend REST services using Java, Spring Boot, and Hibernate to support internal business systems. Optimized MySQL and PostgreSQL queries for better data retrieval performance and improved application stability with JUnit and integration tests.

Java Spring Boot Hibernate Spring MVC JPA MySQL PostgreSQL Apache Kafka RabbitMQ Junit

Student Web Development Assistant

Tarleton State University

Jan 2017 - May 2018 (1 year 4 months)

Assisted in developing and maintaining simple web pages using HTML, CSS, JavaScript, and basic Python scripting. Supported site maintenance tasks and collaborated using Git for version control and basic debugging.

HTML CSS JavaScript Python Web Development Git Debugging Version Control