Open to opportunities

Randy Lambert

@randylambert

Message

I build scalable data platforms, streaming pipelines, and AI-ready products that improve speed, reliability, and cost.

United States

Message

What I'm looking for

I'm looking to build and modernize large-scale data platforms, streaming systems, and AI-ready data products where I can improve reliability, performance, governance, and cloud efficiency while mentoring engineers.

I've modernized data platforms at phData, Uber, and Capital One, building batch, streaming, and AI-ready data products with Snowflake, dbt, Airflow, Spark, Python, SQL, AWS, and GCP. At phData, I helped migrate a B2B SaaS platform to Snowflake and dbt Cloud in under a year, expanding data-engineering capacity by 4×.

I've reduced a machine-learning pipeline from 20 hours to 13 minutes, helped deliver more than $282K in annual AWS savings, and supported Uber workloads processing 100B+ messages daily. I build reusable ingestion, modeling, quality, governance, and delivery standards while mentoring engineers and improving platform reliability.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

phData

Aug 2021 - Present (5 years)

Led modernization of a B2B SaaS data platform to Snowflake, Airflow, and dbt, and built reusable ingestion frameworks and dimensional models. Reengineered ML pipelines with Snowpark, reducing processing time from 20 hours to 13 minutes.

Snowflake DBT Airflow Python SQL Snowflake Snowpark AWS GCP Docker Kubernetes CI CD Dimensional Models RAG LLM Vector Search

Senior Data Engineer

Uber

May 2018 - Aug 2021 (3 years 3 months)

Built and optimized Spark-based ingestion pipelines using Kafka, Hive, HDFS, Parquet, and Hudi, supporting 100B+ messages per day. Engineered stateful event-processing workflows with Flink and Pinot, and implemented Hudi-based incremental processing.

Apache Spark Kafka Apache Flink Apache Pinot Hive HDFS Parquet Hudi Presto SQL Data Modeling

Data Engineer

Capital One

Jun 2015 - May 2018 (2 years 11 months)

Built batch and event-driven financial-data pipelines using Python, Spark, AWS services, and Redshift. Developed transformation workflows and dimensional models, and migrated on-premises workflows to AWS with CI/CD automation.