Design Remote

Expert Talent Pool, Feedback and Alignment (Senior, 5+ Years)

Clera

  • $50 – $120 / hour
  • Anywhere in the world
  • Fulltime
  • 3 days ago
  • Open to UK residents
Apply for this role

About the role

About the Role

Join a remote expert network as a senior rater and reviewer, evaluating challenging AI model outputs and helping calibrate other graders. Your work supports the development of reliable, high-quality AI systems.

What You'll Do

  • Rank and rate expert-level model answers in your domain using detailed rubrics and written rationales.

  • Evaluate model reasoning step by step in specialized fields such as mathematics, code, law, medicine, or finance.

  • Fact-check detailed claims against primary sources and verify accuracy.

  • Assess answers against content policies, style guides, and edge cases.

  • Review other raters' work, calibrate standards, and develop or refine grading guidelines.

  • Assess search relevance and share feedback in live sessions.

What We're Looking For

  • At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or deep expertise in a relevant field.

  • Native or near-native written English proficiency.

  • Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.

  • Experience leading, reviewing, or mentoring other raters or reviewers.

  • An advanced degree, professional license, or deep working expertise in the domain you evaluate.

  • Hands-on experience with AI data annotation, preference ranking, rubric grading, process labeling, or search-quality rating is a plus.

Compensation & Benefits

Compensation is $50 to $120 per hour, depending on project, field, and expertise. Payment is for hours worked.

Location

Fully remote. Projects typically last from one week to several months.

Compensation Range: $104K - $249.6K

Originally posted on Himalayas

Before you start

Sorted before day one

Some links here earn us a commission. It costs you nothing and does not affect what we recommend.

Job alerts

New remote roles, weekly

Once a week, the new remote roles on the board. Tell us where you live and what you do so we can send the ones that fit.

One email a week, on Tuesdays: your jobs, plus a city guide, a new coworking space and one clearly marked sponsored item. Unsubscribe any time. Privacy

Same employer

More at Clera

All roles at Clera

Keep looking

Similar design roles

All design roles
For employers

Hiring remotely?

Every role on Work From Anywhere shows the countries it can be done from, so the people who apply are the people you can actually hire.

  • $49 per job, and your first one is free
  • Unlimited jobs for $99 a month
  • Matched to job seekers by country and role
Post a job