# Ali Hasan Khan

Ali Hasan Khan is a remote worker on Himalayas, Senior AI/ML Engineer at ProArch, based in United States.

Source: https://himalayas.app/@alihasankhan1

```text
Senior AI/ML Engineer at ProArch who deployed RL policies that improved long-horizon task success by 34%.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | United States |
| Authorized to work in | United States |
| Salary expectations | 200k+ USD |
| Job categories | AI ML Engineer |
| Skills | Reinforcement Learning, Policy Optimization, Actor Critic, PPO, SAC, TD3, Offline RL, CQL, IQL, Imitation Learning, RLHF, DPO, Multi Agent RL, Hierarchical RL, Constrained Reinforcement Learning |

## About

```text
At ProArch, I architected a reinforcement learning platform for sequential decision-making, training actor-critic agents that improved long-horizon task success by 34% over the legacy heuristic baseline. I also applied RLHF and DPO to fine-tune large language models, improving human-preference win rate by 27% and reducing hallucination rate by 31%.

Previously, at Synack, I built reinforcement learning agents for adaptive security testing that increased unique vulnerability discovery by 28% per engagement. At Meta, I built Python and SQL analytics pipelines and developed early machine learning models for engagement and churn forecasting.
```

## Experience

### Senior AI/ML Engineer

ProArch. Nov 2023 - Jul 2026

```text
Architected an end-to-end reinforcement learning platform for sequential decision-making, training actor-critic agents with PPO, SAC, and TD3 that improved long-horizon task success by 34%. Applied RLHF and DPO to fine-tune large language models, improving human-preference win rate by 27% and reducing hallucination rate by 31%.
```

Skills: Python, PyTorch, TensorFlow, Jax, PPO, SAC, TD3, CQL, IQL, RLHF, DPO, Ray, Kubernetes, Kafka, Redis, Grafana, Prometheus, Optuna, RayTune, Spark, Airflow, BigQuery, Docker, Triton-Inference-Server, Onnx, TorchScript, MADDPG, QMIX, HER, GAE, Curriculum-Learning, Constrained-RL, Human-In-The-Loop, Fsdp, AMP

### Machine Learning Engineer

Synack. Jun 2019 - Oct 2023

```text
Built deep reinforcement learning agents for adaptive security testing, training DQN and PPO policies for sequential attack-path selection that increased unique vulnerability discovery by 28% per engagement. Implemented adversarial evaluation suites and red-team versus blue-team scenarios to harden models against evasion and distribution shift.
```

Skills: Python, PyTorch, TensorFlow, DQN, PPO, Imitation-Learning, Kafka, Spark, Docker, Kubernetes, AWS-Sagemaker, CI-CD, ONNX-Runtime, Optuna, RayTune, A-B-Testing, Shadow-Deployments

### Data Analyst

[Meta](https://himalayas.app/companies/meta). Dec 2017 - May 2019

```text
Built foundational Python and SQL analytics pipelines over petabyte-scale datasets using Presto, Spark, and Hive, producing the metrics backbone later reused for machine learning feature development. Developed early machine learning models to forecast user engagement and churn, improving forecast error by 18%.
```

Skills: Python, SQL, Presto, Spark, Hive, XGBoost, scikit-learn, Airflow, Tableau, A-B-Testing, Hypothesis-Testing, Causal-Inference, Cohort-Analysis, Survival-Analysis, Time-Series-Decomposition, Anomaly-Detection

## Education

### Florida Agricultural and Mechanical University

Bachelor of Science, Computer Science. 2013 - 2017

```text
Bachelor of Science in Computer Science from Florida Agricultural and Mechanical University, completed from 2013 to 2017.
```

## Tech stack

- Snowflake
- Apache Spark
- Presto
- Tableau
- Kubernetes
- Terraform
- Python
- Java
- Go
- C++
- Scala
- TensorFlow
- PyTorch
- MLflow
- scikit-learn
- Keras
- Kubeflow
- DeepSpeed
- Grafana
- Prometheus
- Transformers
- Linux
- Git
- Docker
- SQL
- XGBoost
- LightGBM
- Ray
- JAX
- Bash
- Optuna
- MuJoCo
- Apache Kafka
- AWS

To contact Ali Hasan, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Austin Cai](https://himalayas.app/@austincai): Senior AI Engineer, Lumos
- [Moh Abdullah](https://himalayas.app/@mohabdullah): Senior Machine Learning Engineer, Luma AI
- [Shykh Hafeez](https://himalayas.app/@shykhhafeez): Senior AI/ML Software Engineer, Synthesis AI
- [Christopher Wang](https://himalayas.app/@christopherwang1): Senior ML Engineer, TogetherAI
- [jay patel](https://himalayas.app/@jaypatel11): Senior AI Engineer, Vectra AI
- [Andrew Abdullah](https://himalayas.app/@andrewabdullah): Senior AI/ML Engineer, AssemblyAI
- [Deepthi Chava](https://himalayas.app/@deepthichava): Senior AI/ML Engineer, CVS Health
- [Joshua Park](https://himalayas.app/@joshuapark): Senior AI/ML Engineer, CVS Health
- [Andrei Kuznetsov](https://himalayas.app/@andreikuznetsov): Staff Machine Learning Engineer, Ncontracts
- [Moe Riz](https://himalayas.app/@moeriz): Senior AI/ML Engineer & AI Architect, Monte Carlo
