Skip to main content
Kulsum NovaKN
Looking for a job

Kulsum Nova

@kulsumnova

AI data annotator and LLM evaluator at CrowdGen, testing code generation and identifying hallucinations, logic flaws, and safety issues.

Bangladesh
Message

At CrowdGen (Appen), I evaluate and compare model responses for accuracy, truthfulness, safety, and instruction-following. I fact-check outputs, identify hallucinations and logical discrepancies, and write structured justifications for my rankings.

My software QA background helps me assess code generation beyond surface-level text. At CHEQ, a Cantaloupe Platform, I validated business logic and REST API workflows and inspected Android APKs for security compliance; I also earned ISTQB CTFL, Certified Scrum Developer, and Certified ScrumMaster credentials.

Experience

Work history, roles, and key accomplishments

CA
Current

Freelance AI Data Annotator & LLM Evaluator

CrowdGen (Appen)

Jan 2024 - Present (2 years 10 months)

Evaluated and scored model responses against multi-metric guidelines, performed side-by-side comparisons, fact-checked AI outputs, and verified code generation prompts.

RLHF
RLAIF
Multi Turn Dialogue Evaluation
Side By Side Ranking
Instruction FollowingHallucination DetectionFact Checking
Ground Truth Validation
Policy And Compliance
Red Teaming
Prompt Injection Awareness
Content Filtering
Bias Assessment
Correctness
Bug Identification
Request and Response Validation
Algorithmic ThinkingJavaScriptTypeScriptJSONMarkdownREST APIsPostman
CP

Senior Software Quality Assurance Engineer

CHEQ, a Cantaloupe Platform

Oct 2025 - Sep 2026 (11 months)

Validated complex business logic, edge cases, and REST API transaction workflows using Postman, reverse-engineered Android APKs with JADX, and authored detailed defect reports.

CP

Software Quality Assurance Engineer

CHEQ, a Cantaloupe Platform

Apr 2024 - Sep 2025 (1 year 5 months)

Performed QA testing and validation for software systems, ensuring quality and compliance.

GP

Assistant Vice President (Quality Assurance Tester)

Green Delta Insurance PLC

Aug 2021 - Apr 2024 (2 years 8 months)

Led QA reviews and user acceptance feedback analysis, drafted exhaustive test suites and acceptance rubrics.

GL

Quality Assurance Engineer

GrooveDigital LLC

Apr 2020 - Jun 2021 (1 year 2 months)

Tested digital marketing and web application workflows, formulated acceptance test cases, and collaborated in an agile remote environment.

DL

Assistant Systems Engineer

Digi Jadoo Broadband Limited

Feb 2017 - May 2020 (3 years 3 months)

Provided systems engineering support and maintenance for broadband services.

Education

Degrees, certifications, and relevant coursework

Scrum Alliance logoSA

Scrum Alliance

Certified Scrum Master (CSM), Scrum

2022 - 2028

Certified Scrum Master (CSM) from Scrum Alliance, valid from 16th January 2022 to 16th January 2028.

Scrum Alliance logoSA

Scrum Alliance

Certified Scrum Developer (CSD), Scrum

2023 - 2027

Certified Scrum Developer (CSD) from Scrum Alliance, valid from 19th December 2023 to 17th December 2027.

American International University Bangladesh logoAB

American International University Bangladesh

Master of Science, Computer Science

2017 - 2018

Grade: 3.63/4.0

Master of Science in Computer Science with a major in Information Science & Technology, GPA 3.63/4.0.

American International University Bangladesh logoAB

American International University Bangladesh

Bachelor of Science, Computer Science and Engineering

2012 - 2015

Grade: 3.83/4.0

Bachelor of Science in Computer Science and Engineering, GPA 3.83/4.0.

IS

ISTQB

Certified Tester Foundation Level (CTFL), Software Testing

Certified Tester Foundation Level (CTFL) from ISTQB, dated 26th February 2022.

Availability

Looking for a job

Location

Bangladesh

Authorized to work in

Salary expectations

60k+ USD

Skills

Data AnnotationLLM EvaluationRLHF
RLAIF
Multi Turn Dialogue Evaluation
Model Comparison
Instruction FollowingHallucination DetectionFact Checking
Ground Truth Validation
Policy And Compliance
Red Teaming
Prompt Injection Awareness
Harmful Content Filtering
Bias and Tone Assessment

Interested in hiring Kulsum?

You can contact Kulsum and 600K+ other talented remote workers on Himalayas.

Message Kulsum

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan