Open to opportunities

Syed Hassan Raza

@syedhassanraza1

Message

Lead Data Engineer building Databricks lakehouse platforms and AI-ready streaming analytics.

United States

Message

What I'm looking for

I’m looking to lead modern data platform work—Databricks lakehouses, batch/streaming ETL/ELT, and AI-ready pipelines—while strengthening governance, lineage, and performance so teams get trusted, scalable datasets.

I architect and build enterprise-scale cloud-native data platforms with Databricks, Apache Spark, and Airflow—so analytics, machine learning, and Generative AI workloads have reliable data foundations.

At Astronomer Remote, I’ve designed Lakehouse architectures with Delta Lake, Unity Catalog, and Medallion modeling, then automated ingestion and transformations using Databricks Workflows and Delta Live Tables. I also build multi-terabyte batch/ELT pipelines and near real-time streaming solutions with Kafka, Spark Structured Streaming, and AWS Kinesis.

I’ve spent earlier years creating scalable ETL/ELT on Hadoop and Spark stacks at Qubole, and developing production ETL workflows at Tresata. Across roles, I focus on data governance, lineage/metadata management, and performance optimization for trusted enterprise datasets.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

Astronomer

May 2022 - Present (4 years 3 months)

Architected enterprise-scale cloud-native data platforms using Databricks, Apache Spark, Airflow, and AWS services. Designed and implemented Lakehouse architectures with Delta Lake, Unity Catalog, and Medallion data modeling.

Databricks Apache Spark PySpark Delta Lake Airflow Kafka AWS Terraform Docker Jenkins GitHub Actions Unity Catalog Delta Live Tables

Senior Data Engineer

Fivetran

Nov 2018 - Apr 2022 (3 years 5 months)

Developed enterprise-grade ETL and ELT pipelines using Databricks, PySpark, SQL, and Spark. Built scalable data ingestion frameworks integrating APIs, SaaS platforms, databases, and cloud systems.

Databricks PySpark Spark SQL Kafka Terraform Jenkins Delta Lake Data Lake Data Warehouse

Data Engineer

Qubole

Mar 2015 - Oct 2018 (3 years 7 months)

Designed and developed distributed data processing solutions using Hadoop, Spark, Hive, HBase, and AWS services. Built scalable ETL frameworks supporting enterprise reporting and analytics.

Hadoop Spark PySpark Hive HBase AWS Python BASH ETL

ETL Developer / Junior Data Engineer

Tresata

Sep 2013 - Feb 2015 (1 year 5 months)

Designed and developed ETL workflows using SQL, Python, and enterprise integration technologies. Built reusable transformation logic supporting operational and analytical reporting systems.

SQL Python Hadoop Hive HDFS ETL