Open to opportunities

A Shaw

@ashaw

Message

Data engineer and data architect delivering cloud-native, real-time big data platforms.

United States

Message

What I'm looking for

I’m looking for a role where I can architect multi-cloud lakehouse data platforms and lead real-time ETL/ELT with Kafka/Spark/Databricks, partnering with AI/ML and analytics teams to deliver scalable, secure, compliant data products.

I’m a Dynamicandresults-oriented Data Engineer, Data Architect, and Analytics Expert with 9+ yearsof experience delivering end-to-end big data solutions across AWS, Azure, and GCP. I specialize in architecting cloud-native data platforms that stay scalable, fault-tolerant, and low-latency under real business workloads.

In my recent role as Lead Data Engineer (Architecture and Integration), I architected real-time inventory and supply chain data platforms with Apache Kafka, Flink, and Databricks—enabling sub-second updates on product availability. I built and maintained Lakehouse architecture using Databricks (Delta Lake) and Snowflake, unified structured and semi-structured data from 15+ sources, and orchestrated ETL/ELT with PySpark, Airflow, and Databricks Workflows. I also integrate services like Pub/Sub, Dataflow, and BigQuery for both real-time ingestion and batch analytics, while defining governance and schema standardization for HIPAA and GDPR-aligned compliance.

Earlier, I led enterprise data architecture and cloud migrations, transitioning on-prem solutions to AWS Redshift, Snowflake, and BigQuery while building responsive SQL systems for instant insights. I’ve consistently connected streaming systems and analytics—using Kafka/Kinesis, Spark, and Python—to power BI, executive analytics, and predictive ML workflows. Across roles, I mentor junior engineers, partner with cross-functional teams, and drive practical data architecture decisions that accelerate innovation and business growth.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

StealthAI Startup (StitchVision)

Aug 2023 - Present (2 years 11 months)

Architected a real-time inventory and supply-chain data platform using Kafka, Flink, and Databricks, and led an enterprise multi-cloud data architecture across AWS and GCP. Built and governed a Lakehouse on Databricks/Delta Lake and Snowflake, implemented ETL/ELT workflows, and integrated ML-driven inventory forecasting.

Data Engineering Team Lead

Horizon Technologies (Addo AI)

Jan 2022 - Jul 2023 (1 year 6 months)

Led the design and deployment of enterprise data architectures for machine learning and BI use cases, including building a user health data platform from Kafka streams. Drove cloud migration and analytics enablement across Google Cloud and AWS data warehouses, and automated data integration pipelines for CRM and customer segmentation.

Apache Kafka Google Cloud Platform AWS RedShift Snowflake BigQuery Python ETL Apache Spark Advanced SQL PostgreSQL CRM Apache NiFi Clustering Data Architecture Data Latency Optimization

Data Engineer (Remote)

Amazon Web Services (AWS)

May 2020 - Dec 2021 (1 year 7 months)

Built scalable ETL pipelines on AWS using Glue, PySpark, and Lambda, and designed Redshift data marts for BI and analytics. Implemented a centralized S3 data lake with Glue Data Catalog and schema versioning, automated infrastructure provisioning with Terraform, and delivered SQL-based reporting via Athena and QuickSight.

AWS Glue Pyspark AWS Lambda Amazon Redshift Amazon S3 Glue Data Catalog AWS Kinesis Terraform Python QuickSight Athena Redshift Spectrum SQL Infrastructure Automation

Data Engineer

Mercurial Minds

Jan 2015 - Apr 2020 (5 years 3 months)

Developed document management and search capabilities using Kafka/Flink streaming, columnar storage, and Python-based retrieval. Built collaborative real-time features, integrated structured and unstructured data architectures, created data APIs for microservices, and managed backups and analytics across AWS and Azure.