About the Role
What if your instinct for natural conversation could directly shape how AI communicates with millions of people? We're looking for Conversation Quality Analysts to evaluate AI-generated dialogues and help ensure they feel genuinely human — clear, helpful, and natural.
This is a fully remote, flexible contract role open to anyone with strong reading comprehension and a sharp ear for how people actually talk. No AI or linguistics background required — if you can tell the difference between a great conversation and an awkward one, you're already qualified.
- Organization: Alignerr
- Type: Hourly Contract
- Location: Remote
- Commitment: 10–40 hours/week
What You'll Do
- Read and evaluate AI-generated conversations across a wide range of topics and scenarios
- Assess responses for naturalness, helpfulness, tone, and contextual relevance
- Identify awkward phrasing, logical errors, irrelevant replies, or unnatural flow
- Compare multiple conversation paths and rank them by overall quality
- Submit structured, detailed evaluations using provided rating rubrics
- Work independently and asynchronously on your own schedule
Who You Are
- Strong reading comprehension and an intuitive sense for natural language
- Able to assess conversation quality objectively and explain your reasoning clearly
- Detail-oriented and consistent — you apply the same standard across every evaluation
- Comfortable working through large volumes of dialogue efficiently
- Self-motivated and reliable when working independently
- No prior AI, linguistics, or NLP experience required
Nice to Have
- Background in writing, editing, communications, or content review
- Experience with quality assurance, research, or critical analysis
- Familiarity with AI chatbots or conversational tools as an end user
Why Join Us
- Work on cutting-edge AI projects alongside leading research labs
- Fully remote and flexible — work when and where it suits you
- Freelance autonomy with the structure of meaningful, task-based work
- Contribute directly to AI development that shapes how technology communicates with the world
- Potential for ongoing work and contract extension as new projects launch