All roles

Open role

AI Evaluator - Software Expert

Remote · South Africa Full-time

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Software / AI / IT / data Evaluator Type:Contract Compensation:$80–$120/hour Location:Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
  • Work independently and asynchronously to meet deadlines.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Software / AI / IT / data.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check:
  • For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Originally posted on

More open positions

Sales Director - Agentic AI-Solutions CX, Customer Lifetime Max. (m/w/d) | Remot

Work from home Full-time role

Senior Software Engineer - Ledger

Work from home Full-time role

Regulatory Law Expert - Compliance

Work from home Full-time role

Senior Software Engineer - Healthcare

Work from home Full-time role

Financial Advisor - Investment Services Group

Work from home Full-time role

Auto Claims Representative (Northern Michigan)

Work from home Full-time role

SALES|AGILE & OTHERS COMMUNITY

Work from home Full-time role

Retail Sales Associate

Work from home Full-time role

Wealth Coach - Sales

Work from home Full-time role

AI & Data Analytics Lead

Work from home Full-time role

Honeymoon & Romance Travel Planner

Work from home Full-time role

Director of Contact Center & Intake Operation

Work from home Full-time role

Remote Data Entry Specialist – Precision Data Management & Spreadsheet Mastery – Work From Home

Work from home Full-time role

Senior Director of Medical Economics

Work from home Full-time role

Spanish Technical and Legal Interpreters

Work from home Full-time role

Therapeutic Account Manager, Liver - San Antonio

Work from home Full-time role

Senior Director of AI Sign Translation Partnerships (* Canada Remote Only *)

Work from home Full-time role

Veeva Platform Specialist

Work from home Full-time role

Backroom Coordinator

Work from home Full-time role

Dynamic Remote Customer Experience Specialist – Live Chat & Messaging Support – Entry to Junior Level – Drive Customer Delight & Growth

Work from home Full-time role

Customer Success Analyst

Work from home Full-time role