All jobs
RemoteListed Jun 5, 2026

Conversational Speech AI Evaluator

CrowdGen by Appen

  • AI-Chatbot-Evaluator
  • AI-Evaluator
  • AI-Language-Evaluator
  • AI-Speech-Evaluation
  • AI-Voice-Evaluation
  • Conversational-AI-Evaluation
  • Conversational-AI-Tester
  • Speech-AI-Evaluator
  • Speech-Evaluator
  • Voice-AI-Model-Evaluator

Assessed from original listing evidence

The role

Job description

Role Overview

Join the Appen team as an Independent Contractor for Project Astra, evaluating real-time conversational AI performance across speech recognition, audio output quality, conversation flow, and content accuracy.

What You Will Do

Engage in conversations with a real-time speech-to-speech AI model, evaluating performance based on speech recognition, audio quality, conversation flow, and content accuracy.

Why It Might Be a Fit

Must be a native Mandarin Chinese speaker residing in Singapore, fluent in English with a strong understanding of grammar and localization, and have keen attention to detail.

Requirements

  • Native Mandarin Chinese speaker residing in Singapore
  • Fluent in English with a strong understanding of grammar and localization
  • Keen attention to detail
  • Access to a stable internet connection and a computer

Benefits

  • Hourly pay: $14 - $14

Originally posted on Himalayas

Keep exploring