Open to opportunities

Ali Asher

@aliasher

Message

Lead Data Engineer specializing in scalable big data pipelines and cloud platforms.

United States

Message

What I'm looking for

I seek senior/lead data engineering roles where I can architect scalable cloud-based pipelines, lead teams, productionize streaming and ML workflows, and mentor engineers while driving measurable business impact.

I am a Lead Data Engineer with over ten years building scalable data pipelines and cloud-based analytics platforms. I architect solutions using Apache Spark, AWS Glue, Kafka, Lambda, and multi-cloud tools (AWS, Azure, GCP) to process large-scale datasets and migrate on-prem Hadoop to AWS.

I have guided teams of eight engineers, established CI/CD with Jenkins and Docker, and deployed Airflow, Databricks, and Snowflake to accelerate reporting and ML workflows. I collaborate with data scientists to productionize machine learning pipelines, mentor junior engineers to raise code quality, and deliver reliable, high-performance data solutions that drive business insights.

Experience

Work history, roles, and key accomplishments

Current

Lead Data Engineer

Current

Palantir

Jan 2022 - Present (3 years 7 months)

Architected scalable data pipelines using Apache Spark and AWS Glue and directed migration of on-prem Hadoop to AWS to improve processing efficiency for large-scale datasets. Engineered real-time streaming with Kafka and AWS Lambda and led a team of eight engineers to deliver timely business insights.

Apache Spark AWS Glue Apache Kafka AWS Lambda AWS RedShift Jenkins Docker CI CD

Senior Data Engineer

Tecurement

Mar 2020 - Dec 2021 (1 year 9 months)

Built ETL workflows with Azure Data Factory and Databricks and refined Snowflake queries to accelerate BI reporting. Deployed Apache Airflow for orchestration to ensure reliable pipelines and mentored junior engineers to improve delivery.

Azure Data Factory Databricks Snowflake Apache Airflow ETL Python SQL Azure

Data Engineer

Twintel

Jun 2017 - Feb 2020 (2 years 8 months)

Built data pipelines with Python and Apache NiFi and designed star-schema models for PostgreSQL to improve query performance and enable Tableau dashboards for real-time insights. Automated ingestion with Bash scripts, reducing manual processing.

Python Apache NiFi PostgreSQL BASH Tableau ETL Kafka Jenkins

Associate Data Engineer

Peak Solutions

May 2015 - May 2017 (2 years)

Developed ETL scripts in Python and SQL to process MySQL and MongoDB sources and supported Hadoop-based processing for customer analytics. Established automated data quality checks that reduced errors and improved pipeline reliability.