Kotlin Expert (SME) – Consultant Description
Purpose
We are seeking a highly experienced Kotlin Software Engineering professional to serve as a Subject Matter Expert (SME) on advanced software development and AI benchmarking projects. This role is pivotal in designing, documenting, and validating Kotlin-based tasks and functionalities that test and refine the coding capabilities of large language models (LLMs) — particularly within Android development environments.
Your work will define both the technical standard and the functional scaffolding of real-world coding benchmarks, ensuring all tasks meet the highest levels of authenticity, precision, and reproducibility. You will help assemble datasets and functional frameworks that mirror the complexity and reasoning required in professional Android engineering.
Core Components
1. Functional Design, Documentation Benchmark Definition
- Define, document, and validate Kotlin-based Android functionalities used in AI benchmarking and software simulation projects.
• Author comprehensive functional and technical documentation, including feature requirements, system behavior, and expected outcomes.
• Translate open-ended requirements into realistic, well-scoped Android tasks representing genuine engineering challenges.
• Ensure each benchmark task is complete, verifiable, and grounded in authentic developer workflows.
• Maintain structured repositories of Kotlin challenges, categorized by complexity, topic, and functional type.
2. Technical Standard Setting, QA Process Improvement
- Define Kotlin-specific quality metrics, benchmarking criteria, and rubrics aligned with Android production standards.
• Develop SOPs and QA frameworks enforcing stylistic consistency, idiomatic Kotlin use, and functional clarity.
• Conduct rigorous QA passes on deliverables — verifying code correctness, documentation completeness, and benchmark adherence.
• Apply quality principles to maintain dataset and code task evaluation standards.
• Curate gold-standard Kotlin examples representing benchmark-worthy implementations.
3. Talent Definition, Vetting Calibration
- Collaborate with recruitment and project leads to define role competencies for Kotlin contributors.
• Develop technical evaluation frameworks for vetting Kotlin developers, including practical code tasks and debugging exercises.
• Lead calibration sessions with contractors to ensure consistency and quality.
• Create skill matrices and capability documentation for Kotlin engineering talent aligned to benchmarking needs.
• Provide continuous feedback and training materials for quality improvement.
4. Benchmark Dataset Development Validation
- Collaborate with AI research teams to design and refine Android benchmarking datasets for evaluating LLM coding performance.
• Source, assess, and refine Kotlin-based Android tasks testing comprehension, reasoning, and problem-solving.
• Document evaluation criteria including accuracy, code structure, and maintainability.
• Contribute to post-project analysis, surfacing insights on performance trends and task design improvements.
• Recommend dataset refinements to enhance domain coverage.
5. Project Delivery Stakeholder Support
- Support project setup, scoping, and execution of Kotlin-oriented AI training and evaluation projects.
• Provide expert-level input on tooling, frameworks, and pipeline design (Ktor, Jetpack, Gradle, KSP).
• Collaborate closely with ML engineers, QA specialists, and data annotators to meet research-grade standards.
• Produce summary documentation and retrospective reports detailing lessons learned and recommendations.
Target Profile
- 5+ years of professional experience in Kotlin software engineering (Android, backend, or multiplatform).
• Mastery of Kotlin idioms, coroutines, Flow, Jetpack Compose, and asynchronous programming.
• Experience in technical documentation, benchmark dataset design, or QA of coding tasks preferred.
• Proven ability to define and enforce technical and stylistic standards across distributed teams.
• Strong collaboration and communication skills with the ability to articulate complex logic clearly.
• Exceptional attention to detail and documentation discipline.
• Fluent in English, with precise writing and communication abilities.
Example Documentation Benchmark Task Scope
Domain | Example SME Responsibilities |
Android Functionality Design | Define and document functional benchmarks such as ViewModel lifecycle management, asynchronous data fetching, and Compose state handling. |
Benchmark Dataset Creation | Source and curate Kotlin tasks that measure model comprehension and code accuracy, ensuring each is verifiable and complete. |
Code Review QA | Apply QA rubrics to assess correctness, structure, and maintainability of Kotlin-based benchmark submissions. |
Talent Calibration | Develop and refine role definitions and test exercises for Kotlin annotators or contributors. |
Documentation Ownership | Author clear, maintainable task documentation describing functionality, context, and test criteria for model evaluation. |
Continuous Improvement | Identify recurring code or comprehension defects and propose updated documentation or templates to address them. |
Summary
This Kotlin SME role merges engineering excellence, documentation rigor, and benchmark development expertise. You will help shape the foundation for evaluating AI models in real-world Android engineering, defining how Kotlin is used to measure and guide the next generation of intelligent software systems.
We offer a pay range of $25-to- $65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Job title: Kotlin Expert (SME)
Employment type: Contract
Workplace type: Remote
Seniority level: Senior Level
United States
Denmark only
France only
China only
