Affsar User
@affsaruser
Senior Data Engineer with 9+ years building scalable cloud-native data platforms across AWS, Azure, and GCP.
What I'm looking for
I’m a Senior Data Engineer with 9+ years building scalable, cloud-native data platforms across AWS, Azure, and GCP. I specialize in ETL/ELT pipelines, real-time streaming, data observability, and modern warehouse architectures using Spark, Kafka, Snowflake, and Databricks.
At NiCE, I designed an enterprise-wide data observability framework across 100+ pipelines using Snowflake, dbt, and Airflow to improve transparency and reliability. I built a large-scale data diffing and validation system to compare prod vs staging datasets, achieving 99.8% data accuracy and release confidence, while processing 5B+ records per day with sub-10-minute latency. I reduced data incidents by 40% by implementing schema drift detection, anomaly monitoring, and failure alerts, and I embedded automated data quality checks directly into CI/CD pipelines.
Previously at Slickdeals, I built scalable Spark pipelines for data validation, transformation, and enrichment that power recommendation systems, analytics, fraud detection, and real-time personalization. I expanded observability and data lineage tracking across Snowflake and Airflow workflows, implemented column-level lineage to prevent downstream breakages, and improved Snowflake performance through query optimization, clustering, and warehouse tuning.
Earlier at Foley, I improved ETL pipelines for compliance, risk, and safety datasets using Hadoop and SQL, and built enterprise data warehouse models for Tableau and Power BI dashboards. I also pushed measurable gains in SLA and data accuracy, and I continue to bring a DataOps mindset—governance, CI/CD, and reliable delivery—to every platform I build.
Experience
Work history, roles, and key accomplishments
Lead Data Engineer
NiCE
Dec 2022 - Present (3 years 4 months)
Designed an enterprise data observability framework across 100+ Snowflake/dbt/Airflow pipelines to improve reliability, reducing data incidents by 40%. Built large-scale data diffing and validation processing 5B+ records/day with sub-10-minute latency, achieving 99.8% data accuracy and higher release confidence.
Senior Data Engineer
Slickdeals
Aug 2019 - Nov 2022 (3 years 3 months)
Built scalable Spark pipelines for validation, transformation, and enrichment to support analytics, recommendation systems, fraud detection, and real-time personalization. Expanded data lineage and observability in Snowflake/Airflow, strengthened data quality frameworks, and improved Snowflake performance with query optimization, clustering, and warehouse tuning to reduce compute overhead.
ETL & Data Engineer
Foley
Jun 2017 - Jul 2019 (2 years 1 month)
Improved Hadoop/SQL ETL pipelines for transportation compliance, risk, and safety datasets to ensure reliable ingestion and transformation. Increased data accuracy by 90% and reduced data delivery SLA by 40% through optimized batch processing, scheduling/resource utilization, and standardized data cleansing/validation workflows.
Education
Degrees, certifications, and relevant coursework
Affsar hasn't added their education
Don't worry, there are 90k+ talented remote workers on Himalayas
Tech stack
Software and tools used professionally
Splunk
Apache Spark
AWS Glue
Druid
Superset
GitHub
GitLab
Kubernetes
Jenkins
GitHub Actions
dbt
MySQL
PostgreSQL
MongoDB
Couchbase
Cassandra
Hadoop
Vertica
Gmail
Databricks
Amazon Neptune
Neo4j
Redis
Terraform
Azure DevOps
Java
MLflow
Neptune
Kafka
Grafana
Datadog
ws
Serverless
Airflow
Time Analytics
Luigi
SQL
Azkaban
Delta Lake
Column
Factory
Availability
Location
Authorized to work in
Job categories
Skills
Interested in hiring Affsar?
You can contact Affsar and 90k+ other talented remote workers on Himalayas.
Message AffsarFind your dream job
Sign up now and join over 100,000 remote workers who receive personalized job alerts, curated job matches, and more for free!
