Rubric Evaluation Specialist - Writing

Evaluates AI-generated written conversations using predefined rubrics to enhance performance. Drafts and refines evaluation rubrics for generalist writing tasks. Applies structured scoring criteria to assess clarity, coherence, accuracy, and style. Reviews edge cases and ambiguous outputs to ensure consistent grading standards.

Requirements

• Experience with rubric-based grading, editing, or content evaluation at Mercor
• Strong generalist writing skills across multiple domains
• Excellent attention to detail and consistency in applying guidelines
• Ability to interpret nuanced criteria and make sound judgment calls

Benefits

• Opportunities for expanded reviewer/lead responsibilities

Originally posted on Himalayas