About the Role

We are looking for a Code Reviewer with expertise in Kotlin to join our AI training QA team. You will be responsible for auditing annotator evaluations of AI-generated responses written in Kotlin. Your role will be to ensure technical correctness, instruction adherence, proof-of-work validation, and consistent application of evaluation rubrics.

Responsibilities

• Audit annotator evaluations of AI-generated Kotlin responses
• Verify if responses follow prompt requirements regarding Kotlin syntax, null safety, and idiomatic structure.
• Evaluate Kotlin code for correctness, performance, security, and readability
• Run and validate proof-of-work code submitted by annotators to confirm functionality
• Review annotator-submitted Loom videos to assess evaluation and testing accuracy
• Ensure responses align with instruction-following expectations including style, tone, and clarity
• Identify and document errors, omissions, or rating inconsistencies
• Provide clear, constructive QA feedback based on rubric and guideline criteria
• Collaborate with internal teams for clarifications on complex or ambiguous items

Required Qualifications

• 5–7+ years of experience in Kotlin development, QA, or code review
• Strong understanding of core Kotlin concepts and development best practices
• Experience with debugging, testing tools, and code execution environments
• Strong analytical and critical thinking skills
• Excellent written communication for documenting evaluations and feedback
• English proficiency at B2, C1, C2, or Native level

Preferred Qualifications

• Experience with AI/LLM workflows, human-in-the-loop QA, or model evaluation
• Familiarity with structured code evaluation processes and rubrics
• Experience using QA/annotation platforms such as SuperAnnotate

Why Join Us

Join a forward-thinking team shaping how AI learns to understand and write Kotlin code. Your expertise will directly influence the quality, reliability, and instructional value of AI-generated content. This is a fully remote role offering flexible hours, milestone-based structure, and competitive compensation.