Back to jobs

Conversation Quality Analyst

$40-120/hrRemoteFreelanceGENERAL

About the Role

What if your instinct for natural conversation could directly shape how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they sound genuinely human, helpful, and on-point.

This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a sharp ear for how language flows. No linguistics degree or AI background required — just a thoughtful, detail-oriented mind and a reliable internet connection.

  • Organization: Alignerr
  • Type: Hourly Contract
  • Location: Remote
  • Commitment: 10–40 hours/week

What You'll Do

  • Read and evaluate AI-generated conversations across a wide range of topics and contexts
  • Rate responses for naturalness, helpfulness, tone, and conversational flow
  • Identify awkward phrasing, off-topic replies, logical inconsistencies, or unhelpful responses
  • Compare multiple conversation paths and rank them by overall quality
  • Submit clear, structured evaluations using provided rubrics and rating tools
  • Work independently and asynchronously on your own schedule

Who You Are

  • Strong reading comprehension and an intuitive sense for how natural conversation works
  • Able to assess quality objectively and explain your reasoning clearly
  • Detail-oriented and consistent — you apply the same standards across large volumes of content
  • Self-motivated and reliable when working independently
  • Comfortable processing and evaluating dialogue at scale
  • No AI, linguistics, or technical background required

Nice to Have

  • Experience in writing, editing, communications, or content evaluation
  • Background in customer service, teaching, or any field requiring strong communication skills
  • Familiarity with AI chatbots or conversational tools as an end user

Why Join Us

  • Work on cutting-edge AI projects alongside leading research labs
  • Fully remote and flexible — work when and where it suits you
  • Freelance autonomy with the structure of meaningful, task-based work
  • Contribute directly to AI development that shapes how technology communicates with the world
  • Potential for ongoing work and contract extension as new projects launch