Open to opportunities

Syeda Hasan

@syedahasan

I've built Azure and Databricks data platforms for enterprise analytics and real-time pipelines.

I've delivered enterprise data platforms for Walmart, Dish Wireless, Scotiabank, Citi Bank, and American Express, building data warehouses, ETL/ELT pipelines, and analytics solutions across Azure, Databricks, SQL, and Power BI.

At Walmart, I built dynamic pipelines ingesting Salesforce, SQL Server, Oracle, and Marketo data into S3, architected Bronze, Silver, and Gold Delta Lake layers, implemented Type II slowly changing dimensions, and deployed Databricks notebooks through CI/CD. I also optimize high-volume workloads with partitioning, bucketing, salting, data-skew handling, and Z-order clustering while supporting governed, compliant data environments.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Walmart

Sep 2021 - Present (4 years 11 months)

Involved in data warehouse implementation using Databricks, notebooks, and SQL warehouses. Created dynamic data pipelines to ingest data from various sources into data lake storage and architected a 3-layered Medallion architecture using Delta Lake.

Databricks SQL Data Factory Delta Lake Unity Catalog CI CD EDI fastAPI HIPAA

Azure Data Engineer

Dish Wireless

Feb 2020 - Sep 2021 (1 year 7 months)

Implemented ETL/ELT solutions to integrate various data sources and created a unified enterprise data model for analytics. Built an ETL framework using Azure Data Factory pipelines, stored procedures, and Azure functions, and developed Databricks notebooks for transformations.

Azure Data Factory Databricks PySpark SQL fastAPI Azure Logic Apps

Azure Data Engineer

Scotiabank

Jul 2018 - Feb 2020 (1 year 7 months)

Responsible for developing ETL pipelines using Azure Data Factory, Data Lake, and Azure Data Warehouse. Created pipelines to extract, transform, and load data from various sources, and performed data modeling with Star and Snowflake schemas.

Azure Data Factory Azure Data Lake Databricks Delta Lake SparkSQL Power BI fastAPI Pydantic

Data Engineer

Citi Bank

Sep 2015 - Jun 2018 (2 years 9 months)

Executed a proof of concept for Azure implementation and transformed batch data from multiple sources into data frames using PySpark. Developed SQL queries and optimized performance, and created ETL processes using SSIS.

PySpark SQL Server MySQL PostgreSQL SSIS T SQL fastAPI

Business Intelligence Developer

American Express

Jul 2014 - Sep 2015 (1 year 2 months)

Responsible for development of SQL objects and SSIS packages to load data into data warehouse. Optimized queries using SQL Profiler and Tuning Advisor, and implemented Change Data Capture for incremental extraction.

SQL Server SSIS T SQL Change Data Capture Tuning Advisor