Back to jobs

German - Voice AI Evaluator

$12-40/hrRemoteFreelanceLANGUAGE

About the Role

What if your voice could help teach AI how to handle a real phone call to a doctor's office? We're looking for native German speakers to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action.

You'll role-play as a patient (using fictional personas we provide), record short conversations, and grade the AI's performance. This is a fully remote, flexible contract role for people with clear speech, sharp attention to detail, and an ear for what sounds natural.

  • Organization: Alignerr
  • Type: Contract (task-based)
  • Location: Remote
  • Commitment: Flexible, work at your own pace

What You'll Do

  • Hold 4 to 5 minute spoken conversations in German with an AI front desk assistant, playing a fictional patient
  • Say natural "trigger phrases" to test whether the AI makes the correct function calls (for example, checking a patient record, booking an appointment, or checking insurance)
  • Review transcripts and classify how accurately the AI understood you and responded
  • Flag issues such as mispronunciations, cutoffs, interruptions, delays, and incorrect function calls, including timestamps
  • Test how the AI handles background noise, short replies ("ja," "nein," "okay"), long numbers, emotional moments, and sensitive or unsafe requests
  • Follow detailed labeling guidelines consistently and submit high-quality work

Who You Are

  • Native or near-native German speaker with a clear, natural speaking voice
  • Detail-oriented, with the patience to review recordings and transcripts closely
  • Comfortable role-playing a patient and sounding authentic
  • Able to follow multi-step instructions and apply them consistently
  • Reliable and self-directed when working independently
  • Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise
  • Comfortable using web-based tools

Nice to Have

  • Experience in voice AI evaluation, data annotation, or QA testing
  • Background in healthcare administration, customer service, or call center work
  • Familiarity with spoken German variants (Germany, Austria, Switzerland) and colloquial speech
  • Linguistics or language-focused studies
  • Familiarity with medical terminology in German

Why Join Us

  • Work on cutting-edge AI projects alongside leading research labs
  • Fully remote and flexible
  • Task-based work with real autonomy
  • Directly help make voice AI more accurate, natural, and safe in healthcare settings
  • Potential for ongoing work as new projects launch
    Note: New contributors complete a short unpaid qualification assessment. Contributors who pass are added to paid production work.