Open to opportunities

Adnan R Memon

@adnanrmemon

Message

Lead Data Engineer specializing in cloud-native, scalable data platforms across AWS, Azure, GCP.

United States

Message

What I'm looking for

I seek senior roles building secure, scalable cloud data platforms; I value cross-functional collaboration, regulatory compliance, automation, and measurable cost/performance improvements.

I am a Lead Data Engineer with 12+ years of experience designing, developing, and operating cloud-native data platforms across AWS, Azure, and Google Cloud. I architect and modernize high-performance data lakes and warehouses (Snowflake, Redshift, BigQuery, Synapse, Databricks), build robust ETL/ELT and streaming pipelines, and enforce governance, security, and observability to deliver audit-ready analytics for financial, healthcare, and enterprise use cases.

I have led large-scale migrations from on-prem Hadoop/Teradata to cloud platforms, optimized PySpark workloads for serverless execution, and implemented IaC and CI/CD automation with Terraform, CloudFormation, and Azure DevOps. I collaborate with product, compliance, BI, and leadership to translate business requirements into scalable, cost-optimized data solutions that meet regulatory and operational SLAs.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

Jun 2021 - Present (5 years)

Led migration of large-scale PySpark workloads from EMR to AWS Glue, architected end-to-end ETL/ELT pipelines and serverless analytics on S3/Iceberg, and implemented data quality and compliance controls to support enterprise BI and real-time analytics.

AWS Glue Pyspark Apache Iceberg Redshift Snowflake Terraform Kafka Great Expectations

Senior Data Engineer

Methodist Healthcare System

Nov 2019 - May 2021 (1 year 6 months)

Architected Azure PaaS-based data platforms and end-to-end ETL/ELT pipelines with Databricks and Synapse, optimized Spark workloads for low-latency processing, and implemented CI/CD, observability, and governance for healthcare analytics.

Azure Data Factory Databricks Synapse Pyspark Azure Event Hubs DBT Great Expectations Azure DevOps

Senior Data Engineer

CDW Corporation

Apr 2017 - Dec 2018 (1 year 8 months)

Designed and implemented a Snowflake-based enterprise data warehouse for 100+ datasets, built continuous ingestion with Snowpipe/Streams/Tasks, and led migrations from Teradata/Redshift to Snowflake improving scalability and performance.

Snowflake Snowpipe Python Pyspark WhereScape Talend Looker Power BI DBT

Senior Data Engineer

Advent Health

Aug 2015 - Mar 2017 (1 year 7 months)

Led migration of Hadoop/MapReduce workloads to AWS EMR/Spark, developed Spark-based ETL frameworks to load transactional data into Redshift, and implemented CDC, data lineage, and PCI-compliant pipelines for financial reporting.

Spark Pyspark Redshift Apache Iceberg Kafka CloudFormation Athena

Data Engineer

Wells Fargo

Jun 2014 - Jul 2015 (1 year 1 month)

Built and maintained batch and streaming pipelines on GCP using Cloud Dataflow, Cloud Composer, and BigQuery, enabling near real-time analytics and regulatory reporting while improving legacy Hadoop workloads.

GCP Dataflow BigQuery Cloud Composer Apache Beam Cloud Pub Sub Airflow DBT