Remote Rater Jobs, LLM Evaluation & Data Annotation

Get Paid to
Train AI Models

An honest guide from a rater with years of firsthand experience working with some of the world’s leading AI companies.

10+Platforms
$10–$50Per Hour
100%Remote
GlobalHiring
01 · Job Platforms

Remote AI Job Platforms Hiring Now

Compare job platforms for remote AI training, LLM evaluation, search quality rating, data annotation, language work, audio recording, and coding. A few links are referral links; using them supports the site at no cost to you.

Outlier

Scale AI's evaluation platform

LLM EvaluationCodingMath

Largest platform by volume. Evaluate model responses across writing, coding, reasoning. Domain specialisms pay significantly more.

$15–$50/hrApply →
Mercor

AI talent matching and evaluation

Coding EvalDomain Expert

Matches skilled professionals to AI evaluation projects. Application includes a live interview.

$20–$50/hrApply →
DataAnnotation.tech

Chatbot evaluation and coding annotation

Chatbot EvalCodingFact-Check

Chat with AI models, rate responses, write better alternatives. Coding projects available.

$20–$40/hrApply →
Alignerr

Labelbox's expert annotation platform

RLHFExpert DomainsMultilingual

Subject-matter experts for RLHF and evaluation. Law, medicine, finance in demand. Highest-paying platform.

$30–$60/hrApply →
Telus International

Search quality rater and AI trainer

Search RatingAI TrainingMultilingual

Search evaluation and AI training. Longer application with exam, but steady work once accepted.

$14–$25/hrApply →
Appen

Data collection, annotation, evaluation

AnnotationVoice & ImageText Eval

One of the oldest platforms. Lower pay but reliable. Accepts many countries. Good entry point.

$5–$20/hrApply →
OneForma

Centific's multilingual annotation

TranslationAnnotationLLM Eval

Excels in multilingual tasks. If you speak two or more languages, this is a strong option.

$12–$30/hrApply →
Turing.ai

AI coding evaluation and developer platform

CodingCode Review

Connects developers to AI coding tasks. Rigorous vetting, excellent pay for engineers.

$30–$60/hrApply →
Mindrift

Toloka's expert writing and evaluation

WritingExpert EvalDomain

High-quality writing and expert evaluation. Craft prompts, evaluate outputs, write reference answers.

$20–$45/hrApply →
Prolific

Research participation and AI feedback

ResearchAI FeedbackSurveys

Academic and AI research studies. Short sessions, reliable pay. Great for supplementing income.

$10–$25/hrApply →
Welocalize

Translation and AI data services

TranslationSearch Rating

Translation and localization with search quality rating and AI evaluation.

$14–$25/hrApply →
RWS (TrainAI)

AI data platform by RWS Group

AnnotationRLHF

Annotation and RLHF tasks. Solid platform with consistent flow for multilingual contributors.

$10–$25/hrApply →
Meridial by Invisible

Expert network for frontier AI training

Domain ExpertAI EvaluationCoding & Linguistics

A vetted contractor network matching specialists with frontier AI training projects.

Project basedApply →
Babel Audio

Voice data and transcription for audio AI

Audio RecordingTranscriptionConversation

Remote speech recording and structured transcription projects for training audio AI systems.

Per recorded hourApply →
Role guide · 12 career paths

What Is a Rater?

A rater uses human judgment to improve search engines, advertisements, AI models, language data, and digital experiences. Explore remote search quality, LLM evaluation, data annotation, translation, transcription, audio recording, prompt, and coding roles, plus the job platforms where you can apply.

Explore All Rater Roles →
Search & Ads Quality LLM & AI Writing Evaluation Data & Language Annotation Coding & Prompt Design

Independent work: projects and availability can change, so apply to more than one platform and check the contractor and tax requirements in your country.

02 — Guide

Getting Started

From zero to first payment.

1

Pick 2–3 Platforms and Apply

Don't put all your eggs in one basket. Apply to Outlier and DataAnnotation as primary targets.

2

Pass the Assessment

Most platforms require an entrance test. Read the rubric carefully. Treat it like an exam.

3

Set Up Your Workspace

Reliable computer, stable internet (10+ Mbps), quiet environment. You'll also need to set up a payment method to get paid — see the payment methods here.

4

Do Your First Hours

Focus on accuracy first — speed comes naturally. After a while you'll get a feel for which tasks pay best.

5

Scale to Multiple Platforms

Once established, add a second platform. Many evaluators work 20–30 hrs/week across 2–3 platforms.

03 — Tips

Tips for Success

⚡ Speed Without Sloppiness

Many companies require at least 90% quality to keep you on a project. A high accuracy rating also unlocks better-paying tasks, one rushed hour can take ten good hours to recover from.

🎓 Claim Domain Specialisms

Degree in math, CS, law, medicine, or finance? Claim it immediately. Domain tasks pay 2–3x base rate.

💰 Track Your Earnings

Log hours and hourly rate per platform per week. Some "high-paying" tasks end up paying less than simpler ones.

🔒 Protect Your Account

Never share task content publicly. Don't use AI to generate evaluations. Account bans are how evaluators lose income.

⏰ Watch for Task Drops

Most platforms release tasks at specific times, often early morning (US time zone). The best ones go fast.

🌐 Leverage Languages

Two or more languages = massive advantage. Multilingual tasks are less competitive and pay more.

Common Questions

Not on every platform, many don't require a degree at all. It's better if you have particular skills: if you speak several languages or have specialisations, you can be paid far more than other raters.
Every platform has its own rules, but there are plenty of platforms hiring raters globally, so wherever you are there's usually a good option for you.
Most platforms pay via PayPal, Payoneer, or Wise. Check the Payments page for details.
Computer, 10+ Mbps internet, modern browser. Dual monitors recommended.
Your next move

Your first application can start today.

Choose two platforms that match your skills, apply while roles are open, and keep more than one option active.