Back to Jobs

[Remote] Remote AI Writing Evaluator

Remote, USA Full-time Posted 2025-11-24

Note: The job is a remote job and is open to candidates in USA. Outlier, a platform owned by Scale AI, is seeking English speakers to assist in training and refining AI systems. The role involves evaluating AI outputs and producing relevant data while contributing across various projects based on individual skillsets.


Responsibilities

  • Adopt a “user mindset” to produce natural data to meet the realistic needs you have or would use AI for
  • Evaluate AI outputs by reviewing and ranking responses from large language models
  • Contribute across projects depending on your specific skillset and experience

Skills

  • English speakers
  • Analytical and Problem-Solving Skills: Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning
  • Strong Writing: Clear, concise, and engaging writing to explain decisions or critique responses
  • Attention to Detail: Commitment to accuracy and ability to assess technical aspects of model outputs
  • Experience in fields like literature, creative writing, history, philosophy, theology, etc
  • Prior writing or editorial experience (content strategist, technical writer, editor, etc.)
  • Interest or background in AI, machine learning, or creative tech tools

Benefits

  • Bonuses: Additional pay available based on project performance.
  • Flexible hours — you choose when and how much to work.
  • Payouts: Weekly via our secure platform.

Company Overview

  • Owned by Scale AI (invested in by Amazon and Meta), Outlier is the world's largest platform that connect real-world experts and grads with AI training projects in Law, Computer Science, Web Development, Math, Science, Languages, and more. It was founded in 2023, and is headquartered in San Francisco, US, with a workforce of 10001+ employees. Its website is https://outlier.ai/.

  •   Apply To This Job

    Similar Jobs

    Mid-Level AI/ML/NLP Engineer

    Remote, USA Full-time

    PreventED – eLearning AI Powered App Development (Fixed Budget Project)

    Remote, USA Full-time

    Watch Netflix (Tagger): $12-$46

    Remote, USA Full-time

    Senior Analytics Engineer; DBT — Remote​/Hybrid Impact

    Remote, USA Full-time

    Senior Azure Infrastructure Architect

    Remote, USA Full-time

    Paid Entry-Level Typing Work - Remote

    Remote, USA Full-time

    Copy #2 of Medical Biller & Coder

    Remote, USA Full-time

    Compliance & Ethics Project Manager IV

    Remote, USA Full-time

    Youth Innovation Consultant, UNICEF – Generation Unlimited, NYHQ, remote. Req# 588512

    Remote, USA Full-time

    eServices Management Analyst 3 /Local Only/Mostly Remote/

    Remote, USA Full-time

    Amazon Careers At Home $25/Hour ? mysmartpros

    Remote, USA Full-time

    AD, Product Design - Design Systems & Content Design

    Remote, USA Full-time

    **Experienced Remote Pharmacy Data Entry Clerk - Healthcare Administration and Patient Services at Walgreens**

    Remote, USA Full-time

    CORPORATE TRAVEL CONSULTANT - AFTER HOURS/EVENING/WEEKENDS

    Remote, USA Full-time

    Delta Airlines (Remote Jobs) - Data Entry Positions Available

    Remote, USA Full-time

    Vidalytics: Sr PHP Developer – High load, MySQL, GCP, Laminas ?

    Remote, USA Full-time

    Part-Time Behavior Technician - ABA Therapy

    Remote, USA Full-time

    Entry-level Virtual Data Entry Clerk (Remote)

    Remote, USA Full-time

    Target – Product Development Scientist – Formulations and Absorbents (Full-Time Remote or Hybrid) – Minneapolis, MN

    Remote, USA Full-time

    Senior Data Analyst (Remote) - Unlock the Magic of Data-Driven Insights

    Remote, USA Full-time