Looking for a job

Marto Georgiev

@martogeorgiev

AI Data Evaluator & Annotator who ranks and validates AI outputs and brings software engineering experience from Fidelity Investments.

United States

Message

As a Freelance AI Data Evaluator & Annotator, I rank AI-generated responses across coding, math, and language tasks, maintaining a 98%+ QA score. I annotate outputs for preference datasets and probe them for hallucinations, unsafe content, factual errors, and policy violations.

At Fidelity Investments, I developed Python and SQL data pipelines and microservices on AWS, processing over 2TB of financial data daily. Earlier, at BAE Systems, Inc., I developed embedded software and data processing tools in C++ and Python, and implemented optimizations that reduced processing latency by 15%.

Experience

Work history, roles, and key accomplishments

Current

Freelance AI Data Evaluator & Annotator

Current

Self Employed

Jan 2023 - Present (3 years 9 months)

Evaluate and rank AI-generated responses for quality, accuracy, and helpfulness across coding, math, and language tasks. Annotate LLM outputs with structured metadata and perform red teaming to identify hallucinations and policy violations.

Data Evaluation Pairwise Comparisons Data Annotation Labeling RLHF Prompt Generation Object Tagging And Classification Quality Assurance Red Teaming Python C++SQL

Software Engineer II

Fidelity Investments

Aug 2019 - Dec 2023 (4 years 4 months)

Developed and optimized backend data pipelines and microservices in Python and SQL on AWS, processing over 2TB of financial data daily. Conducted rigorous peer code reviews that reduced production defects by 22%.

Python SQL AWS Microservices Data Pipelines Code Review Technical Documentation API specifications

Software Engineer

BAE Systems

Jun 2017 - Jul 2019 (2 years 1 month)

Developed embedded software and data processing tools in C++ and Python under strict DoD coding standards (MISRA C++). Implemented algorithmic optimizations that reduced real-time data processing latency by 15%.

C++Python Embedded Software Data Processing MISRA C++Optimization Algorithms Unit Testing Integration Testing

Education

Degrees, certifications, and relevant coursework

DeepLearning.AI

Prompt Engineering for Developers, Prompt Engineering

Completed the DeepLearning.AI Prompt Engineering for Developers course in 2023.

AWS

AWS Certified Developer – Associate, Cloud Development

Earned the AWS Certified Developer – Associate certification in 2022.

Dartmouth College

Master of Science, Computer Science

2015 - 2017

Activities and societies: Coursework: Advanced Data Structures, Machine Learning, Discrete Math, Compiler Design

M.S. in Computer Science with focus on Machine Learning, Advanced Algorithms, and Artificial Intelligence. Capstone project on optimizing neural network pruning for edge devices achieved 40% model size reduction with less than 2% accuracy loss.