Affi Ahmad
@affiahmad
Experienced Data Engineer with a passion for optimizing data systems.
What I'm looking for
I am an experienced and highly skilled Data Engineer with over 10 years of success in architecting, developing, and optimizing data pipelines and infrastructure at scale. My proven track record spans large-scale data environments in finance, healthcare, logistics, and SaaS. I have deep expertise in building ETL/ELT workflows, managing data lakes and warehouses, and implementing data governance.
Throughout my career, I have demonstrated my ability to work with diverse data ecosystems and cloud platforms, delivering efficient, secure, and reliable data systems that power business intelligence and machine learning initiatives. I am passionate about mentoring junior engineers and collaborating with cross-functional teams to streamline data workflows and integrate advanced analytics solutions.
Experience
Work history, roles, and key accomplishments
Senior Data Engineer
GlidePath Logistics, LLC
Apr 2021 - Present (4 years 4 months)
Spearheaded the migration of 120+ legacy ETL pipelines from SSIS to a modern AWS-based stack (Glue + Lambda + S3 + Redshift), reducing processing times and increasing reliability. Designed and implemented event-driven data pipelines using Kafka and Spark Streaming to ingest real-time tracking data for logistics analytics. Built data lake architecture using S3 and Lake Formation to standardize data
Data Engineer III
HealthMotion Analytics
Feb 2017 - Present (8 years 6 months)
Engineered high-volume ETL pipelines in Apache NiFi and Spark to ingest and process patient records, device telemetry, and claims data from multiple providers. Developed a HIPAA-compliant data warehouse solution on Azure Synapse and implemented robust encryption, logging, and auditing. Collaborated with Data Scientists to deliver machine learning-ready feature stores refreshed daily using Airflow
Data Engineer II
FinEdge Technologies
Jan 2014 - Present (11 years 7 months)
Designed and maintained ETL pipelines for ingesting transaction and customer data from over 30 financial sources using Informatica and SSIS. Implemented dimensional modeling (Star & Snowflake) in SQL Server Data Warehouse to support regulatory reporting and fraud analytics. Migrated and refactored batch jobs to Apache Airflow, improving maintainability and runtime visibility.
Junior Data Engineer
BrightTrack Solutions
Jul 2012 - Present (13 years 1 month)
Assisted in the development and support of ETL pipelines that processed customer behavior and telemetry logs from B2B SaaS products. Performed data validation, profiling, and cleansing on new data integrations using Python and Bash. Maintained PostgreSQL databases and wrote automation scripts to schedule daily imports and reports.
Education
Degrees, certifications, and relevant coursework
Preston University
Master of Science, Computer Science
Completed a Master of Science in Computer Science. The program focused on advanced topics in computer science, preparing for complex data engineering challenges.
Tech stack
Software and tools used professionally
Amazon Redshift
Matillion
Azure Synapse
Apache Spark
AWS Glue
Talend
GitHub
GitLab
Bitbucket
Kubernetes
Jenkins
GitHub Actions
GitLab CI
PySpark
dbt
MySQL
PostgreSQL
MongoDB
Microsoft SQL Server
Couchbase
Cassandra
Hadoop
InfluxDB
Gmail
Databricks
Neo4j
Redis
Terraform
Azure DevOps
Java
JSON
Kafka
Apache NiFi
PagerDuty
Grafana
Prometheus
Linux
Datadog
Airflow
Google BigQuery
TimescaleDB
Luigi
SQL
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Affi?
You can contact Affi and 90k+ other talented remote workers on Himalayas.
Message AffiFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
