The future of AI — whether in training or evaluation, classical ML or agentic workflows — starts with high-quality data.
At HumanSignal, we’re building the platform that powers the creation, curation, and evaluation of that data. From fine-tuning foundation models to validating agent behaviors in production, our tools are used by leading AI teams to ensure models are grounded in real-world signal, not noise.
Our open-source product, Label Studio, has become the de facto standard for labeling and evaluating data across modalities — from text and images to time series and agents-in-environments. With over 250,000 users and hundreds of millions of labeled samples, it’s the most widely adopted OSS solution for teams working on building AI systems.
Label Studio Enterprise builds on that traction with the security, collaboration, and scalability features needed to support mission-critical AI pipelines — powering everything from model training datasets to eval test sets to continuous feedback loops.We started before foundation models were mainstream, and we’re doubling down now that AI is eating the world. If you're excited to help leading AI teams build smarter, more accurate systems — we’d love to talk.
About the Role
HumanSignal is seeking highly qualified architecture and design professionals to contribute to AI development projects. This role involves evaluating, annotating, and validating architectural design content, technical drawings, building systems, and design principles to improve AI model performance in architectural reasoning, design critique, and technical documentation.
Compensation
Up to $130 USD/hourbased on qualifications and project complexity
Required Qualifications
Education
- Master's degree requiredin architecture or related design field
- PhD strongly preferredin:
- Architecture
- Urban Design
- Architectural History & Theory
- Building Science
- Landscape Architecture
- Or closely related design disciplines
Degree Field Requirements
Candidates must hold degrees directly in architecture or design-related fields. Acceptable programs include:
- Architecture (M.Arch, D.Arch, PhD)
- Urban Design/Urban Planning
- Landscape Architecture
- Architectural Engineering
- Building Science/Building Technology
- Architectural History & Theory
- Interior Architecture
- Sustainable Design/Environmental Design
Professional Requirements
- Professional licensure strongly preferred(AIA, RIBA, or equivalent)
- Demonstrated expertise in architectural design and building systems
- Strong understanding of building codes, regulations, and standards
Responsibilities
- Review and evaluate architectural designs for technical accuracy and design quality
- Assess AI-generated floor plans, elevations, sections, and construction documents
- Annotate design decisions, spatial relationships, and technical specifications
- Validate building code compliance and construction feasibility
- Identify errors in architectural drawings, details, and specifications
- Provide detailed feedback on design aesthetics, functionality, and sustainability
- Evaluate structural, mechanical, and environmental systems integration
- Review architectural language and technical terminology for accuracy
Qualifications
- Deep understanding of architectural design principles and building systems
- Proficiency in reading and creating architectural drawings and specifications
- Strong knowledge of building codes (IBC, local codes) and accessibility standards
- Experience with sustainable design and environmental performance
- Excellent spatial reasoning and visualization skills
- Familiarity with architectural software and design tools
- Understanding of construction methods, materials, and detailing
- Ability to critique design quality and technical execution
- Ability to work independently and meet deadlines
Work Details
- Flexible, project-based work- work on your own schedule
- Remote position - work from anywhere
- Variable hours based on project availability and your capacity
- Ongoing training and calibration provided
- Quality-focused environment with performance feedback
Ideal Candidate Profile
- Licensed architects, academic researchers, or recent architecture graduates
- Strong portfolio demonstrating design and technical expertise
- Experience in architectural practice, research, or teaching
- Published work or demonstrated excellence in architectural design
- Passion for advancing AI capabilities in architecture and design
How to Apply
Interested candidates should be prepared to:
- Submit CV/resume highlighting architectural qualifications
- Provide proof of advanced degree(s) and professional licensure (if applicable)
- Submit portfolio samples (optional but preferred)
- Complete a brief design evaluation assessment
- Participate in a qualification review
United States
AF, AL + 146 more
AR, BR + 5 more
CA, FR + 5 more