Open to opportunities

Skyler Shahid

@skylershahid

Message

Senior data engineer specializing in cloud-native pipelines, real-time streaming, and data platforms.

United States

Message

What I'm looking for

I seek a senior data engineering role building cloud-native, real-time data platforms with strong emphasis on governance, CI/CD, and scalable architectures.

I am a Senior Lead Data Engineer with over 12 years of experience building scalable data pipelines, data lakes, and real-time processing systems across cloud platforms such as AWS and GCP. I design and implement end-to-end ETL workflows, data architectures, and metadata management strategies that enable reliable analytics and BI.

I have led cross-functional teams and mentored engineers while delivering measurable improvements: architecting cloud-native pipelines with AWS Glue, S3, and Redshift; implementing Kafka and Spark Structured Streaming to reduce latency from hours to seconds; and introducing CI/CD for data engineering that cut deployment time by 40%.

I prioritize data governance, quality, and performance optimization, and I seek to apply my expertise in modern data stacks—Spark, Kafka, Airflow, BigQuery, and Redshift—to drive business insights and scalable, production-grade data platforms.

Experience

Work history, roles, and key accomplishments

Current

Senior Lead Data Engineer

Current

Takeout7

Jan 2022 - Present (3 years 8 months)

Architected end-to-end cloud-native data pipelines using AWS Glue, S3, Redshift and Lambda to enable a scalable analytics platform; implemented real-time streaming with Kafka and Spark Structured Streaming, reducing data latency from hours to seconds and introduced CI/CD workflows that cut deployment time by 40%.

AWS Glue Amazon S3 Amazon Redshift Kafka Spark Structured Streaming Terraform Jenkins Gitlab CI Data Governance

Senior Data Engineer

Square

Jan 2018 - Dec 2021 (3 years 11 months)

Designed and maintained large-scale batch and streaming pipelines using Apache Spark, Kafka and AWS (S3, Redshift, Glue); led on-premises to cloud migrations that reduced processing time by 40% and implemented data quality frameworks and automated testing to ensure reliability.

Apache Spark Kafka AWS S3 Amazon Redshift AWS Glue ETL Data Quality Automated Testing Cloud Migration

Data Engineer

AstroPrint

Jul 2014 - Dec 2017 (3 years 5 months)

Developed batch and real-time ETL processes with Python, Airflow and SQL, integrated multiple data sources into a unified data warehouse and implemented monitoring and validation tooling that reduced failures and improved analytics reporting.

Python Apache Airflow SQL ETL Data Warehousing Monitoring Data Validation Performance Optimization

Junior Data Engineer

Charles IT

Aug 2012 - Jun 2014 (1 year 10 months)

Supported database design, development and optimization in PostgreSQL and MySQL; built early-stage ETL workflows and complex SQL queries, and assisted in deploying BI dashboards to improve department-level reporting.