Shabby Malik
@shabbymalik
Senior Data Engineer and Cloud AI Data Architect specializing in scalable data platforms.
What I'm looking for
I am a Senior Data Engineer and Cloud & AI Data Architect with over a decade of experience building reliable, secure, and scalable data environments across AWS, Azure, GCP, Snowflake and Databricks. I specialize in ETL/ELT development, data modeling, streaming, governance and automation, and I focus on quality, maintainability, and enabling data-driven decisions.
Throughout my career I have led platform migrations and implemented lakehouse and warehouse solutions, introduced governance and CI/CD practices, and integrated ML workflows for healthcare, finance and e-commerce domains. I am known for practical problem solving, clear documentation, technical mentorship, and strong cross-team collaboration to deliver production-ready data products.
Experience
Work history, roles, and key accomplishments
Principal Data Engineer
Corro Health
May 2022 - Present (3 years 6 months)
Designed and implemented a Snowflake + Databricks healthcare data platform, developed dbt and ADF ETL pipelines, and introduced governance with Collibra and Monte Carlo to improve lineage and reliability.
Lead Data Engineer
Halo Branded Solutions
Apr 2019 - Apr 2022 (3 years)
Led design of an Azure Synapse data warehouse, built pipelines with ADF and Airflow, established CI/CD with Jenkins and Terraform, and created reusable dbt models for analytics.
Data & Cloud Engineer
Employers
Jan 2017 - Mar 2019 (2 years 2 months)
Migrated ETL to AWS Glue and Airflow, designed Kimball/Data Vault models for insurance domains, added automated testing and monitoring with Prometheus and Grafana, and supported SageMaker model deployments.
Data Engineer
GiftHealth
Jul 2014 - Dec 2016 (2 years 5 months)
Built and maintained ETL with SSIS and Talend to load healthcare data into SQL Server, created Power BI dashboards, automated refresh jobs with Python, and enforced HIPAA compliance controls.
Education
Degrees, certifications, and relevant coursework
Punjab University
Bachelor of Science, Computer Science
Bachelor of Science in Computer Science from Punjab University.
Tech stack
Software and tools used professionally
Airbyte
Fivetran
Matillion
Azure Synapse
Apache Spark
AWS Glue
Talend
Metabase
Kubernetes
Jenkins
Jupyter
NumPy
Pandas
PySpark
dbt
DB
MySQL
PostgreSQL
MongoDB
Cassandra
Hadoop
Gmail
Databricks
Neo4j
Redis
Terraform
Azure DevOps
JavaScript
Java
JSON
PowerShell
TensorFlow
MLflow
scikit-learn
Kafka
Grafana
Prometheus
GraphQL
Elasticsearch
Airflow
SQL
Dagster
Monte Carlo
Delta Lake
Trino
Collibra
Cosmos
Bash
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Shabby?
You can contact Shabby and 90k+ other talented remote workers on Himalayas.
Message ShabbyFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
