Open to opportunities

Abdullah virk

@abdullahvirk

Message

Senior data engineer specializing in cloud-native data platforms and governance.

United States

Message

What I'm looking for

I seek a role building secure, scalable cloud-native data platforms (ETL/ELT, streaming, governance) with strong DataOps, mentorship, and cost-conscious infrastructure practices.

I am a Senior Data Engineer with 8+ years designing scalable cloud-native data platforms, data warehouses, and real-time streaming architectures across AWS and Azure. I build analytics-ready systems using Databricks, Spark, Airflow, Kafka, Snowflake, and Lakehouse patterns, with strong emphasis on governance and cost optimization.

I have led platform modernization, mentored engineers, and delivered HIPAA-aligned solutions for healthcare and regulated industries, implementing data lineage, validation, PII masking, and secure access controls. I also design dimensional models, medallion architectures, and production-grade ELT/ETL pipelines optimized for performance and reliability.

I seek to deliver robust, observable data infrastructure that enables BI, reporting, and machine learning, combining DataOps, Terraform-based IaC, CI/CD, and FinOps practices to balance scalability, security, and cost.

Experience

Work history, roles, and key accomplishments

Current

Senior Data Engineer

Current

Arctic Wolf

Sep 2022 - Present (3 years 6 months)

Led design and development of cloud-based data platforms across AWS and Azure for healthcare and enterprise clients, building scalable Databricks/Spark pipelines and implementing data governance and HIPAA-aligned access controls.

Databricks Spark Python AWS Data Governance SQL Airflow HIPAA compliance

Data Platform Engineer

Nexla

Jul 2019 - Aug 2022 (3 years 1 month)

Designed and maintained an AWS cloud-native data platform with IaC using Terraform, containerized Spark services, and Airflow/dbt orchestration to enable self-service pipelines and improve observability and security.

Terraform AWS Spark Docker Kubernetes Airflow DBT Cloudwatch CI CD

Data Integration Engineer

ACC3

Mar 2017 - Jun 2019 (2 years 3 months)

Architected AWS ELT pipelines and real-time Kafka event flows, built Snowflake/dbt Medallion transformations, and implemented reverse ETL and governance controls to support analytics and ML readiness.

AWS Kafka Snowflake DBT Python Airflow Encryption