AI Response Evaluator - Generalist

Job Description Ai Response Evaluator - Generalist YO IT CONSULTING Charleston, WV

• On-site, Remote

Contractor Posted 2 hours ago Job Description Ai Response Evaluator - Generalist

• Contract and Payment Terms

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.

About The Opportunity We are seeking highly skilled Generaliststo support a fast-moving initiative with one of the worlds leading AI labs. This project focuses on improving AI systems designed for therapeutic-style conversations by evaluating, comparing, and refining model-generated responses. If you have strong analytical thinking, emotional intelligence, and excellent written communication skills, this role offers a unique opportunity to contribute to the development of safe, supportive, and human-aligned AI systems. Role Overview In This Position, You Will

• Review and compare pairs of AI-generated responses
• Evaluate responses against structured criteria such as:

• Empathy
• Emotional insight
• Communication quality
• Appropriateness for supportive dialogue

• Provide clear reasoning for evaluations
• Rewrite responses to better align with therapeutic communication standards
• Support research teams in improving AI behavior in mental-health-oriented conversational settings

Your contributions will directly impact the refinement of AI systems designed for safe and supportive human interaction. Minimum Qualifications

• Bachelors degree (required)
• Strong written English communication skills
• High emotional intelligence and sound judgment
• Ability to follow structured evaluation frameworks
• Comfort working with sensitive or emotionally nuanced content
• Ability to start immediately after onboarding

Preferred Qualifications

• Background in psychology, counseling, social sciences, humanities, or communications
• Experience in content evaluation, moderation, research, or QA
• Experience working with AI systems or language models