All roles

Open role

[Remote] ML Engineer - Model Evaluation Expert

Remote · Ghana Full-time

Note: The job is a remote job and is open to candidates in USA. Mercor connects elite creative and technical talent with leading AI research labs. The company is seeking a Machine Learning Engineer to design research-based tasks, run and analyze training experiments, evaluate frontier models, and collaborate with researchers on rigorous and fair task development.

Responsibilities

  • Design tasks by transforming real ML research ideas into well-defined, multi-step tasks
  • Run experiments by implementing changes, executing training experiments, and analyzing results to define correct solutions
  • Explore reinforcement learning concepts such as reward functions and training behavior in task development
  • Evaluate frontier models' performance on tasks and identify areas of improvement
  • Collaborate with researchers to ensure tasks are consistent, rigorous, and fair

Skills

  • • MSc or PhD in machine learning, computer science, or a related STEM field
  • • 1+ years in a research or research-engineering role
  • • Experience in training and evaluating ML models and conducting end-to-end experiments
  • • Proficiency in Python and Git
  • • Strong understanding of large language models and their evaluation
  • • Basic knowledge of reinforcement learning
  • • Experience in AI training, model evaluation, or benchmark/task authoring

Benefits

  • Remote work
  • Paid weekly

Company Overview

  • Mercor is an AI-based hiring platform that improves the recruitment process by matching talent with opportunities tailored to their skills. It was founded in 2023, and is headquartered in San Francisco, California, USA, with a workforce of 201-500 employees. Its website is https://mercor.com.
  • Company H1B Sponsorship

  • Mercor has a track record of offering H1B sponsorships, with 19 in 2026, 7 in 2025. Please note that this does not guarantee sponsorship for this specific role.
  • More open positions

    [Remote] Higher Education Expert - Curriculum Design - AI Trainer

    Work from home Full-time role

    [Remote] Legal Professional - Fully Remote | Upto $90/hr Part-time

    Work from home Full-time role

    [Remote] Senior Data Engineer (m/w/d)

    Work from home Full-time role

    [Remote] Software Engineer – Data & Integration

    Work from home Full-time role

    [Remote] Senior Manager, Clinical Supply Chain

    Work from home Full-time role

    Sviluppatore Oracle APEX - Senior

    Work from home Full-time role

    Risk, Quality and Performance Analyst

    Work from home Full-time role

    Home Health Field RN

    Work from home Full-time role

    Clinical Assessment Coordinator - (Hybrid Remote) - 36619

    Work from home Full-time role

    Siemens Opcenter techno functional lead

    Work from home Full-time role

    [Remote] Business Development Manager

    Work from home Full-time role

    First-Person Video AI Trainer

    Work from home Full-time role

    Sr. Account Executive - Healthcare Cloud Sales (West Coast)

    Work from home Full-time role

    [Remote] Federal Account Manager

    Work from home Full-time role

    Solution Architect

    Work from home Full-time role

    Tele-Triage Registered Nurse - RN

    Work from home Full-time role

    [Remote] Plumbing Engineer/Designer - Las Vegas, NV

    Work from home Full-time role

    CAD Drafter - Sporting Goods

    Work from home Full-time role

    Junior Systems Engineer - Part Time

    Work from home Full-time role

    Business Development Manager, National and Strategic Accounts - West Coast

    Work from home Full-time role

    Delivery Manager II

    Work from home Full-time role