Open to opportunities

Skyler Shahid

@skylershahid1

Message

Senior Data Engineer driving scalable cloud-native data platforms and real-time pipelines.

United States

Message

What I'm looking for

I seek a senior data engineering role building cloud-native, scalable ETL and real-time data platforms, with leadership opportunities and strong emphasis on CI/CD, governance, and cross-functional collaboration.

I am a Senior Data Engineer with 12+ years building scalable data pipelines, data lakes, and real-time processing systems across AWS and GCP.

I design and implement cloud-native analytics platforms using tools like AWS Glue, S3, Redshift, BigQuery, Kafka, and Spark, and I focus on reducing latency and improving performance.

I lead engineering teams, introduce CI/CD and infrastructure-as-code (Terraform, Jenkins, GitLab CI), and enforce data governance and metadata strategies to ensure reliable, compliant data operations.

My work has included large migrations to cloud platforms, implementing streaming architectures that cut latency to seconds, and improving deployment efficiency and infrastructure cost-effectiveness.

Experience

Work history, roles, and key accomplishments

Current

Senior Lead Data Engineer

Current

TakeOut7

Jan 2022 - Present (3 years 9 months)

Architected cloud-native data pipelines with AWS Glue, S3, Redshift and Lambda to enable scalable analytics across business units; implemented Kafka + Spark streaming reducing data latency from hours to seconds and introduced CI/CD to cut deployments 40%.

AWS Glue S3 Redshift)Apache Kafka Spark Structured Streaming Terraform Jenkins Gitlab CI Data Governance

Senior Data Engineer

Square

Jan 2018 - Dec 2021 (3 years 11 months)

Designed and maintained large-scale Spark and Kafka pipelines on AWS, led migration from on-premises to cloud reducing processing time 40%, and implemented data quality frameworks and automated testing to improve reliability.

Apache Spark Apache Kafka AWS S3 Redshift)Glue ETL Data Quality Airflow Python SQL Cloud Migration

Data Engineer

AstroPrint

Jul 2014 - Dec 2017 (3 years 5 months)

Developed batch and real-time ETL processes with Python, Airflow, and SQL to integrate multiple sources into a unified data warehouse, improving analytics and reducing infrastructure costs by 25%.

Python Apache Airflow SQL ETL Data Warehousing Monitoring Data Validation

Junior Data Engineer

Charles IT

Aug 2012 - Jun 2014 (1 year 10 months)

Supported database design and ETL development in PostgreSQL and MySQL, wrote complex SQL and stored procedures, and helped deploy BI dashboards to improve department reporting.