# Bojan Čolić

Bojan Čolić is a remote worker on Himalayas, SDET & AI Evaluation Engineer at ICON plc, based in Serbia.

Source: https://himalayas.app/@bojanoli

```text
SDET and AI Evaluation Engineer at ICON plc, building release-gating AI evaluations for clinical research documents.
```

| Detail | Value |
| --- | --- |
| Availability | Looking for a job |
| Location | Serbia |
| Authorized to work in | Serbia |
| Salary expectations | 60k+ USD |
| Job categories | SDET, AI Evaluation Engineer, QA Automation Engineer |
| Skills | AI Evaluation, Testing Automation, Ragas, LLM As Judge, Golden Datasets, Hallucination Detection, Red Teaming, Prompt Injection Testing, AI Safety Testing, E2E Testing, API Testing, Regression Testing, CI CD, Framework Design, BDD |

## About

```text
At ICON plc, I built the AI evaluation pipeline that each release of an AI-assisted clinical trial monitoring platform must pass. It combines RAGAS metrics, LLM-as-judge scoring, and a golden dataset created with clinical experts, alongside checks for hallucinations, prompt injection, PII, and toxicity.

At Trace Labs / OriginTrail, I set up RAG evaluation for a knowledge-graph-based AI assistant and wired safety checks into CI/CD as release gates. Earlier, at TeleTrader, I built and maintained Playwright regression tests for the Baha Webstation trading platform.
```

## Experience

### SDET & AI Evaluation Engineer (current)

[ICON plc](https://himalayas.app/companies/iconplc). May 2026 - Present

```text
Automated E2E and regression tests for a clinical trial monitoring platform using Playwright, PyTest, and Postman. Built AI evaluation pipelines with RAGAS and LLM-as-judge scoring to gate AI releases.
```

Skills: Playwright, Pytest, Postman, Jenkins, GitHub-Actions, Graylog, Grafana, Ragas, DeepEval, Mastra, Langsmith, Red-Teaming, Prompt-Injection, PII-Scanning, Toxicity-Checks, Human-In-The-Loop

### SDET & AI Evaluation Engineer

Trace Labs / OriginTrail. Feb 2023 - May 2026

```text
Developed E2E and API test suites for decentralized knowledge graph and Web3 products. Built CI/CD pipelines and implemented RAG evaluation pipelines with RAGAS and LLM-as-judge scoring.
```

Skills: Playwright, TypeScript, JavaScript, Mocha, Pytest, Postman, Jenkins, GitHub-Actions, Gherkin, BDD, Ethereum-Smart-Contracts, Ragas, LLM-As-Judge, Golden-Datasets, Hallucination-Detection, Red-Teaming, Prompt-Injection, Toxicity-Checks, PII-Scanning, A-B-Testing-Optimization, SQL, Graylog, Asana

### Automation QA Engineer

TeleTrader. Apr 2021 - Feb 2023

```text
Built and maintained Playwright regression suites for a trading platform. Ran regression tests on every release and collaborated with developers to resolve failures.
```

Skills: Playwright, JavaScript, Regression-Testing, Test-Planning, SQL, Web-Scraping

### System Administrator

Faculty of Economics and Business, University of Belgrade. Nov 2020 - Apr 2021

```text
Maintained Linux servers, network infrastructure, and SQL databases for the faculty.
```

Skills: Linux, Network-Administration, SQL, Database-Administration

## Education

### University of Belgrade

Bachelor of Science, Business Informatics. 2017 - 2022

```text
BSc in Business Informatics from the Faculty of Economics, University of Belgrade, completed in 2022.
```

### SAP

SAP West Balkans Certificate, SAP

```text
Earned the SAP West Balkans Certificate.
```

## Tech stack

- Postman
- Selenium
- GitHub
- Jenkins
- GitHub Actions
- PostgreSQL
- Slack
- Jira
- Linear
- Cypress
- Mocha
- JavaScript
- Python
- Java
- Graylog
- Grafana
- OpenTelemetry
- Asana
- TypeScript
- pytest
- Cucumber
- Git
- Docker
- SQL
- SAP
- Solidity
- Qdrant
- Playwright
- Foundry
- Hardhat
- Cursor
- DeepEval
- Maestro
- Ragas
- LangSmith
- Mem0
- Mastra
- Claude Code

To contact Bojan, message them from this profile with a Himalayas employer account: [Hire on Himalayas](https://himalayas.app/hire).

## People also viewed

- [Igor Sudar](https://himalayas.app/@igorsudar): QA Engineer, RnRobonote
- [Mrkaić Nebojša](https://himalayas.app/@mrkaineboja): Software Test Engineer, ZF Friedrichshafen
- [Stefan Nikolic](https://himalayas.app/@stefannikolic): Senior QA Automation Engineer, Tether.io
- [Jelena Jokic](https://himalayas.app/@jelenajokic): QA Engineer, Memtime
- [Nadezhda Startseva](https://himalayas.app/@nadezhdastartseva): QA Engineer, N.Progression
- [Ivan Petrović](https://himalayas.app/@ivanpetrovi): Software Engineer in Test (SDET), Protocol CRM
- [Juan Carlos Martínez Mondragón](https://himalayas.app/@juancarlosmartnezmon): Automation QA Engineer, HTEC
- [Sasa Miljkovic](https://himalayas.app/@sasamiljkovic): Senior QA Engineer, Mozzart
- [Georgije Kundacina](https://himalayas.app/@georgijekundacina): QA Lead, ADI Global Distribution
- [Irinel Tapalaga](https://himalayas.app/@irineltapalaga): QA Team lead, MyMiniFactory
