# Arfa Patekari

Arfa Patekari is a remote worker on Himalayas, AI Engineer, LLM Evaluation & Benchmarks at Alignerr (Labelbox) and Mercor, based in United Kingdom.

Source: https://himalayas.app/@arfapatekari

```text
AI engineer at Alignerr and Mercor evaluating AI coding agents and authoring benchmark tasks for model training.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | United Kingdom |
| Authorized to work in | United Kingdom |
| Salary expectations | 50k+ GBP |
| Job categories | AI Engineer, Python Developer, Machine Learning Engineer, Backend Engineer |
| Skills | Python, Generative AI, LLM Evaluation, AI Coding Agent Evaluation, RAG, Prompt Engineering, Benchmark Design, fastAPI, OpenAI API, Anthropic API, Meta’S LLaMA, Lang Chain, Vector Databases, Azure AI Search, Ragas |
| Portfolio | https://github.com/arfaaowte/rag_llm_project |
| LinkedIn | https://linkedin.com/in/arfaaowte |
| GitHub | https://github.com/arfaaowte |

## About

```text
At Alignerr (Labelbox) and Mercor, I author benchmark tasks for AI coding agents and evaluate agentic coding transcripts and model-generated fixes against structured rubrics.

I also review LLM-generated solutions to ML problems, write justifications about correctness and feasibility, and maintain Python build scripts across open-source repositories for training data pipelines.

At Accenture, I built FastAPI services and document ingestion pipelines that supported RAG and LLM evaluation. I also developed a GenAI Configurator for comparing OpenAI, Meta Llama, and Anthropic Claude models.

At Accenture, I led GitHub Copilot performance evaluations and supported its rollout, and deployed GenAI applications with Docker and Kubernetes. Earlier, at Cleverground, I built Django REST Framework backend features for a learning management system and wrote Python and Selenium test automation.
```

## Experience

### AI Engineer, LLM Evaluation & Benchmarks (current)

Alignerr (Labelbox) and Mercor. May 2025 - Present

```text
Authored ML engineering benchmark tasks for evaluating AI coding agents and evaluated agentic coding transcripts against structured rubrics. Reviewed and ranked LLM-generated solutions to Kaggle-style ML problems and wrote build scripts for training data pipelines.
```

Skills: Python, LLM-Evaluation, Benchmarking, Agentic-coding, Rubric-based-Evaluation, Prompt-Engineering, Lang-Chain, Build-Automation, Data-Pipelines

### Senior Python Developer (AI/ML Computational Science Sr Analyst)

[Accenture](https://himalayas.app/companies/accenture). Apr 2023 - Feb 2025

```text
Built Python APIs with FastAPI and document ingestion pipelines for RAG, and developed a GenAI Configurator integrating multiple LLMs. Led GitHub Copilot rollout to over 95% adoption and containerized applications with Docker and Kubernetes.
```

Skills: Python, fastAPI, SQL, OCR, NumPy, Pandas, Vector-Databases, RAG, OpenAI, LLaMA, Claude, Docker, Kubernetes, Azure-DevOps, GitHub-Actions, AWS, CI-CD, Monitoring-Drift, Team-Leadership

### Application Development Associate

[Accenture](https://himalayas.app/companies/accenture). Jul 2021 - Apr 2023

```text
Supported service delivery for a portfolio of 50+ clients and automated service governance reporting using Excel macros and advanced Excel.
```

Skills: Service-Management, Excel-Macros, Excel, Automation

### Python Developer

Cleverground. Dec 2020 - Jul 2021

```text
Built backend features for a learning management system using Django REST Framework and PostgreSQL, and wrote Selenium and Python test automation to speed up QA.
```

Skills: Python, Django-REST-Framework, PostgreSQL, Selenium, Testing-Automation, Gitlab, Jira, Azure

## Education

### University of Mumbai

Bachelor of Engineering, Information Technology. 2016 - 2020. Grade: First Class with Distinction

```text
Bachelor of Engineering in Information Technology with First Class with Distinction.
```

### Aviatrix

Aviatrix Multi-Cloud Network Certification, Multi-Cloud Networking

```text
Multi-Cloud Network Certification.
```

## Tech stack

- Selenium
- Kubernetes
- GitHub Actions
- NumPy
- Pandas
- PostgreSQL
- Azure DevOps
- Jira
- Python
- Django REST framework
- FastAPI
- Git
- Docker
- SQL
- LangChain
- OpenAI API
- GitHub Copilot
- Ragas
- Claude Code

To contact Arfa, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Manjiri Kawathe](https://himalayas.app/@manjirikawathe): AI Engineer, ITC
- [Kashif Amin](https://himalayas.app/@kashifamin): Full Stack Engineer, Tech Logix Limited
- [Usman Aslam](https://himalayas.app/@usmanaslam): Senior AI/ML Engineer, Pixolat
- [Shyama Rani Bhosale](https://himalayas.app/@shyamaranibhosale): Full Stack Engineer, Viridien
- [Sophia Bouchama](https://himalayas.app/@sophiabouchama1): AI Engineer, Foil AI
- [KRISHNA CHAITANYA GOUD MAKTHALA](https://himalayas.app/@krishnachaitanyagoud): AI Engineer (Contract), Avsar
- [Aditya Iyer](https://himalayas.app/@adityaiyer2): Founding Engineer (Part time Venture Build), Music Event Leaders Affiliation (MELA)
- [tehilla obanor](https://himalayas.app/@tehillaobanor): Forward Deployed AI Engineer, Afterframe AI Orchestration Platform
- [navid hejazi](https://himalayas.app/@navidhejazi): Full Stack Developer, Tensator Group
- [Mohammad-Reza Azizi](https://himalayas.app/@mohammad-rezaazizi): Senior AI Engineer, MyTrek AI
