AFFI AHMED
@affiahmed
Accomplished Senior Data Engineer specializing in cloud and big data solutions.
United StatesWhat I'm looking for
I am an accomplished Senior Data Engineer with a decade of expertise in architecting scalable data ecosystems. My experience spans leveraging cloud platforms, big data frameworks, and advanced programming to drive enterprise analytics. I excel in orchestrating high-performance ETL/ELT pipelines and optimizing data warehouses, ensuring robust governance and delivering impactful solutions for complex, large-scale data challenges.
Throughout my career, I have integrated cutting-edge technologies like Apache Spark, Kafka, and Snowflake to enhance data processing efficiency and business insights. My commitment to data quality, security, and compliance is demonstrated through my use of tools like Collibra and AWS Lake Formation. I am recognized for my ability to collaborate with cross-functional teams to deliver innovative, cost-effective data solutions that empower strategic decision-making.
Experience
Work history, roles, and key accomplishments
Senior Data Engineer
PureSpectrum
Jan 2020 - Present (5 years 5 months)
Architected and deployed high-throughput ETL pipelines using Apache Airflow and Python, processing petabyte-scale datasets to support real-time analytics for global e-commerce platforms. Optimized Snowflake-based data warehouse, reducing query latency by 40% and cutting operational costs through efficient resource allocation. Implemented Kubernetes-based containerized workflows, enhancing deployme
Lead Data Engineer
Striveworks
Jun 2016 - Dec 2019 (3 years 6 months)
Spearheaded development of real-time streaming pipelines using Kafka and Spark, enabling low-latency insights for financial trading systems. Designed Azure Databricks solutions to integrate disparate data sources, streamlining analytics for 200+ business users. Automated CI/CD processes with Jenkins and GitHub Actions, reducing pipeline deployment time by 30% and improving team productivity.
Data Engineer
Fivetran
Mar 2013 - May 2016 (3 years 2 months)
Built scalable data ingestion frameworks on AWS, utilizing S3, Glue, and Lambda to process 10TB+ daily transactional data for retail clients. Configured Prometheus and Grafana for pipeline monitoring, achieving 99.9% uptime and rapid issue resolution for critical workflows. Developed Java-based tools for data transformation, integrating heterogeneous systems and enabling seamless reporting for sta
Junior Data Engineer
Hex
Jul 2011 - Feb 2013 (1 year 7 months)
Engineered ELT processes with Apache NiFi and dbt, transforming raw data into actionable insights for healthcare analytics platforms. Migrated legacy Oracle databases to GCP BigQuery, improving query speed by 50% and supporting scalable analytics for 100+ users. Utilized Scala for custom Spark jobs, processing large-scale datasets to deliver predictive models for patient outcomes.
Education
Degrees, certifications, and relevant coursework
National University of Sciences and Technology (NUST)
Bachelor of Computer Science, Computer Science
Completed a Bachelor of Computer Science degree. Gained foundational knowledge in computer science principles and practices.
Tech stack
Software and tools used professionally
Availability
Location
United StatesAuthorized to work in
Job categories
Interested in hiring AFFI?
You can contact AFFI and 90k+ other talented remote workers on Himalayas.
Message AFFIFind your dream job
Sign up now and join over 85,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
