Join the Base10 family

Open opportunities with founders believing purpose is key
to profits and companies solving problems for the 99%

QA Engineer/Code Evaluator - AI Chatbot Response Evaluations (Excel)

SuperAnnotate

SuperAnnotate

Software Engineering, Data Science, Quality Assurance
Australia
Posted on Apr 15, 2025

Role Overview:

We are seeking a QA Specialist with deep expertise in Microsoft Excel to audit evaluations performed by Data Annotators reviewing AI-generated spreadsheet tasks. You will be responsible for verifying that annotators correctly assess instruction-following and data accuracy, test formula correctness, and validate proof-of-work outputs.

Responsibilities:

  • Audit annotator evaluations of AI-generated Excel responses, including formulas, functions, charts, and data transformations.
  • Validate code functionality and test cases provided by annotators for correctness and completeness.
  • Review instruction-following accuracy and proper rubric application in evaluations.
  • Identify incorrect or incomplete assessments, errors in logic, or flawed proof-of-work.
  • Provide constructive, concise feedback to annotators to uphold evaluation standards.
  • Collaborate with QA leads to align on rubric interpretation and process improvements.

Required Qualifications:

  • 7+ years of experience working with Microsoft Excel for data analysis, reporting, automation, or QA.
  • Proficient in advanced formulas (e.g., VLOOKUP, INDEX-MATCH, IF, nested logic), charts, data validation, pivot tables, and error handling.
  • Experience auditing Excel-based outputs, validating logic, and ensuring consistency.
  • Familiarity with spreadsheet auditing tools and Excel testing methods.
  • Strong written communication and analytical skills.
  • English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications:

  • Prior experience with QA of AI-generated content or Excel-based annotation workflows.
  • Understanding of LLM behavior in generating structured outputs.
  • Familiarity with macros/VBA or Excel integrations (optional but beneficial).

Contract Type: Freelance/Contract/Part-Time

Why Join Us?

Become part of an innovative team at the forefront of AI technology. Your QA expertise will play an essential role in creating accurate, reliable, and safe AI solutions.Fully remote with flexible hours and milestone-based structure. Competitive compensation based on project deliverables.

If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.

#Excel #QA #DataQA #Spreadsheet #AI #RemoteJobs #Automation #TechHiring #Freelance