Open to opportunities

Bin Yasir

@binyasir2

Message

Senior Data Engineer building reliable, scalable ETL/ELT and cloud data platforms.

United States

Message

What I'm looking for

I’m looking for a senior data engineering role where I design well-architected lakehouse pipelines, improve data reliability and cost efficiency, and partner with teams to deliver ML-ready, observable data at scale.

I’m a Senior Data Engineer with over 10 years designing, building, and optimizing large-scale data pipelines, cloud data platforms, and analytics infrastructure. I focus on improving data reliability, performance, and availability through automation, quality frameworks, and scalable engineering patterns, combining modern cloud technologies with strong engineering principles to deliver data solutions that scale with business growth.

In my recent work, I’ve architected and managed cloud-native data platforms on AWS and Azure, building scalable ETL/ELT pipelines with PySpark, Airflow, AWS Glue, and Kafka. I’ve designed lakehouse architectures with Delta Lake and Databricks to unify batch and streaming data, automated data quality validation with Great Expectations (reducing data incidents by nearly 45%), and supported low-latency analytics with real-time streaming. I also standardize infrastructure provisioning with Terraform, reduce processing costs through optimized partitioning/caching/compute scaling, and lead efforts in cataloging, lineage, and metadata ingestion to strengthen compliance and observability.

Experience

Work history, roles, and key accomplishments

Current

Solution Architect

Current

G2O

Nov 2022 - Present (3 years 6 months)

Architected cloud-native data platforms on AWS and Azure for analytics, ML workloads, and cross-organization data sharing. Built ETL/ELT and lakehouse pipelines with Delta Lake/Databricks, automated data quality with Great Expectations (nearly 45% fewer data incidents), and reduced cloud data processing costs by 35%.

Pyspark Apache Airflow AWS Glue Kafka Delta Lake Databricks Terraform Great Expectations Kinesis IAM

Senior Data Engineer

TeamDynamix

Jan 2019 - Oct 2022 (3 years 9 months)

Designed and implemented end-to-end batch and streaming data pipelines using Airflow, Spark, and AWS Glue. Migrated legacy ETL to PySpark on EMR/Databricks, improved observability with Great Expectations and anomaly detection, and reduced code duplication via reusable Python libraries.

Apache Airflow Pyspark AWS Glue Amazon EMR Databricks Amazon Redshift Snowflake Great Expectations Kafka IAM

Data Engineer

Optimum Technology, Inc.

Mar 2017 - Dec 2018 (1 year 9 months)

Built cloud-native AWS ETL pipelines using Lambda, Glue, Python, and Redshift to support BI dashboards and operational reporting. Automated workflow logging/monitoring with CloudWatch and an ELK stack, added security checks for malformed/sensitive records, and supported migration from on-premises databases to AWS-managed services.

AWS Lambda AWS Glue Python Amazon Redshift Cloudwatch ELK Stack Data Modeling IAM Kinesis SQS

Junior Data Engineer / Data Analyst

Intellix Software

Oct 2015 - Feb 2017 (1 year 4 months)

Assisted with ETL and SQL transformations for analytics and reporting, including Python-based automation to clean, normalize, and validate datasets. Built dashboards, supported migration of workloads from on-premises to AWS RDS and S3, and performed data quality checks and incident triage across multiple environments.