Arthur Cunha
@arthurcunha
I evaluate frontier AI models using engineering-grounded rubrics, benchmarks, and technical QA.
What I'm looking for
I evaluate and red-team frontier AI systems through five concurrent remote contracts spanning RLHF, speech-to-speech benchmarking, annotation, transcription, and technical quality assurance.
At SME Careers, I lead QA for civil, structural, and geotechnical reasoning, building rubrics, reviewing model outputs against verified references, and resolving reviewer disagreements under documented standards.
I authored three open-source Python STEM benchmarks that documented 31 LLM failure modes across five models, including universal failures that surface-level output checks missed. My reference implementations were validated against Slope/W, Taludes_V13, GAWACWIN, and published engineering methods.
Before AI evaluation, I reviewed a 1,400+ infrastructure-project portfolio at the Brazilian Air Force and built Python and Excel-VBA validation pipelines for regulatory and logical inconsistencies. I bring licensed civil engineering practice, geotechnical depth, reproducible testing, and C2 English technical writing to high-stakes model evaluation.
Experience
Work history, roles, and key accomplishments
Audio Transcription & Alignment Specialist
Alignerr
Aug 2026 - Present (1 month)
Performed word-level transcript correction and millisecond-precision audio-text alignment for speech-recognition training, held to strict accuracy and consistency thresholds.
Civil Engineering SME & QA Lead
SME Careers
Jun 2026 - Present (3 months)
Built and applied multi-step evaluation rubrics for civil, structural and geotechnical engineering reasoning, enforcing domain accuracy and instruction adherence. Identified critical failure modes and structural hallucinations, and ran pairwise model comparisons and output ranking against verified ground-truth references.
AI Training & Data Annotation Contractor
Meridial Marketplace, by Invisible Technologies
Jun 2026 - Present (3 months)
Evaluated and ranked live speech-to-speech conversations with AI models across defined scenarios, assessing naturalness, engagement, and utility. Delivered comparative preference rankings that feed RLHF pipelines.
Data Annotator
T-Maxx International Management Consulting (TMX)
May 2026 - Present (4 months)
Performed text intent analysis, SFT annotation, and RM ranking & scoring for LLM training datasets. Conducted speech transcription, audio annotation, and localisation collection under LGPD-compliant data-handling protocols.
Conducted live multi-turn voice benchmarking in blind pairwise ELO arenas, assessing conversational flow, utility, and naturalness. Classified failures by severity and authored structured, timestamped justifications to guide reinforcement learning and post-training refinement.
Head of Engineering Budget Section
Brazilian Air Force
Jan 2024 - Jun 2026 (2 years 5 months)
Built an automated QA system scaling technical validation to 1,400+ infrastructure projects, detecting logical inconsistencies and regulatory violations. Developed Python and Excel-VBA pipelines for classification and validation, and audited third-party documentation against regulatory criteria.
Project Manager - BIM, Structural & Geotechnical Design
Vidigal Engenharia Ltda
Jan 2023 - Dec 2023 (11 months)
Coordinated and trained a team of 10+ engineering interns, acting as the final quality gate on every deliverable. Owned the project pipeline including scope, deliverables, deadlines, and approval cycles with external regulatory authorities.
Design Engineer - BIM, Structural & Geotechnical Design
Vidigal Engenharia Ltda
Jan 2020 - Jun 2021 (1 year 5 months)
Performed reinforced-concrete structural design and detailing, multidisciplinary BIM coordination and clash detection, geotechnical slope stability and retaining structure design, and urban infrastructure design. Authored SOPs translating complex software workflows into reproducible team documentation.
Research Assistant - Geotechnical Engineering Laboratory
Federal University of Viçosa (UFV)
Jan 2015 - Jul 2017 (2 years 6 months)
Conducted geotechnical laboratory testing including direct shear, triaxial, permeability, CBR and soil characterisation, and field sampling and instrumentation. Reviewed and contributed to academic publications in geotechnics, roads and pavement engineering.
Education
Degrees, certifications, and relevant coursework
Federal University of Viçosa
Bachelor of Science, Civil Engineering
Bachelor of Science in Civil Engineering, with a thesis on deterministic and probabilistic analysis of a gabion retaining wall.
Pontifícia Universidade Católica de Minas Gerais
Postgraduate Specialization, Geotechnics
Postgraduate specialization in Geotechnics.
SENAI
Technical Degree, Information Technology
Technical degree in Information Technology.
Tech stack
Software and tools used professionally
Availability
Location
Authorized to work in
Portfolio
github.com/arthurcunha51engSalary expectations
Social media
Job categories
Skills
Interested in hiring Arthur?
You can contact Arthur and 90k+ other talented remote workers on Himalayas.
Message ArthurGet matched with your dream remote job
Sign up now and join over 250,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!
