Shaffi Shahid
@shaffishahid
Senior Data Engineer and Architect delivering scalable data platforms.
What I'm looking for
I am a Senior Data Engineer and Data Architect with over 10 years of experience building and optimizing large-scale data pipelines and infrastructures across finance, healthcare, logistics, and SaaS.
I specialize in ETL/ELT design, data lake and warehouse architectures, automation, and data governance, and I have led large cloud migrations and real-time streaming implementations that improved performance and reliability.
I have hands-on expertise with AWS, Azure, GCP, Snowflake, BigQuery, Spark, Kafka, dbt, Airflow and related orchestration, monitoring, and CI/CD tooling, and I mentor engineers on cloud-native practices.
I am passionate about delivering secure, cost-effective, production-ready data systems that enable analytics and machine learning, and I focus on observability, data quality, and cross-functional collaboration to drive business value.
Experience
Work history, roles, and key accomplishments
Senior Data Engineer
GlidePath Logistics, LLC
Apr 2021 - Present (4 years 5 months)
Spearheaded migration of 120+ legacy ETL pipelines to an AWS-based stack, reducing processing times and increasing reliability; built event-driven Kafka + Spark Streaming pipelines and a governed S3 data lake to support analytics and ML integration.
Data Engineer III
HealthMotion Analytics
Feb 2017 - Mar 2021 (4 years 1 month)
Engineered high-volume ETL pipelines and a HIPAA-compliant Azure Synapse data warehouse, delivered daily ML-ready feature stores, and implemented monitoring and DR to ensure availability and security of healthcare data.
Data Engineer II
FinEdge Technologies
Jan 2014 - Jan 2017 (3 years)
Designed and maintained ETL pipelines for financial transaction and customer data, implemented dimensional models for regulatory reporting and fraud analytics, and migrated batch jobs to Airflow to improve visibility and maintainability.
Junior Data Engineer
BrightTrack Solutions
Jul 2012 - Dec 2013 (1 year 5 months)
Supported development and maintenance of ETL pipelines for B2B SaaS telemetry, performed data validation and cleansing, and automated daily imports and reports to improve data accessibility and reporting speed.
Education
Degrees, certifications, and relevant coursework
Virginia Tech
Bachelor of Science, Computer Science
Bachelor of Science in Computer Science completed at Virginia Tech.
Tech stack
Software and tools used professionally
Amazon Redshift
Matillion
Azure Synapse
Apache Spark
AWS Glue
Talend
GitHub
GitLab
Bitbucket
Kubernetes
Jenkins
GitHub Actions
GitLab CI
PySpark
dbt
MySQL
PostgreSQL
MongoDB
Microsoft SQL Server
Couchbase
Cassandra
Hadoop
InfluxDB
Gmail
Databricks
Neo4j
Redis
Terraform
Azure DevOps
Java
JSON
Kafka
Apache NiFi
PagerDuty
Grafana
Prometheus
Linux
Datadog
Airflow
Google BigQuery
TimescaleDB
Luigi
SQL
Delta Lake
Great Expectations
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Shaffi?
You can contact Shaffi and 90k+ other talented remote workers on Himalayas.
Message ShaffiFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
