HR

Open to opportunities

Ham Rehman

@hamrehman

I lead cloud-native streaming data platforms, building reliable pipelines for analytics and AI.

What I'm looking for

I’m looking to lead cloud-native streaming and distributed data platform work—building scalable pipelines with strong observability, automation, and reliability for analytics and AI, in a team that modernizes systems and values maintainable engineering.

I’m a Senior Data Engineer with 12 years of experience, currently working as a Lead Data Engineer designing scalable data platforms and implementing Tecton DataOps practices. I focus on automation, pipeline reliability, observability, and workflow optimization to keep data dependable end to end.

I’ve designed streaming data pipelines using Kafka and Spark to support event-driven processing, and I’ve integrated Starburst to enable unified querying across initiatives. I build reusable data frameworks to standardize pipeline development and improve maintainability.

On the infrastructure side, I develop cloud-native architectures and improve efficiency with optimized processing jobs. I’ve worked with AWS, GCP, Kubernetes, Docker, Terraform, Jenkins, and CI/CD with GitOps to help deploy and automate modern data platforms.

My background includes building batch and streaming pipelines across cloud and hybrid environments using Spark and Kafka, and delivering ETL workflows for enterprise data integration. I enjoy collaborating with engineering teams to design scalable architecture, modernize legacy systems into Lakehouse/Data Platforms, and use strong monitoring, alerting, and logging for reliability and governance.

Experience

Work history, roles, and key accomplishments

MI

Senior Data Engineer

Microsoft

Jul 2020 - Jul 2022 (2 years)

Developed distributed, real-time data pipelines using Kafka and Spark Streaming, supporting analytics and operational use cases. Optimized Spark processing on cloud platforms and enabled data platforms for machine learning and advanced analytics initiatives.

Apache Kafka Apache Flink Azure Trino (Starburst)Presto Databricks Kubernetes Terraform CI CD Delta Lake

LC

Data Engineer

Logic20/20 (Consulting)

Jun 2015 - Jun 2019 (4 years)

Built batch and streaming pipelines across cloud and hybrid environments using Spark and Kafka. Designed scalable storage and processing solutions using modern data modeling and reliability/observability practices.

Apache Spark Apache Kafka Data Vault Logging Monte Carlo Data Governance Pandas

TE

Associate Data Engineer

TEKsystems

Jun 2013 - May 2015 (1 year 11 months)

Developed ETL workflows for enterprise data integration and reporting across multiple systems. Performed Python/Pandas transformations, cleansing, and validation, and supported data operations by troubleshooting pipeline issues.

ETL Python Pandas Data Integration data transformation Data Cleanse Data Validation Data Warehousing Pipeline Troubleshooting

Education

Degrees, certifications, and relevant coursework

KC

Kean College

Bachelor's in Computer Science, Computer Science

Earned a Bachelor's degree in Computer Science from Kean College.

Tech stack

Software and tools used professionally

Apache Flink

Kubernetes

Jenkins

Pandas

PySpark

Gmail

Databricks

Terraform

Kafka

SQL

Apache Iceberg

Monte Carlo

Tecton

Delta Lake

Trino

Starburst

Bash

Find your dream job

Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!