All roles

Open role

[Remote] Domain Expert, AI Evaluation Task Writer: Sales (Contract, Remote)

Remote · Qatar Full-time

Note: The job is a remote job and is open to candidates in USA. Patronus AI is hiring a Sales Domain Expert to create realistic sales tasks used as evaluation and training data for frontier AI models. The contractor will build scenario-based evidence files, write and solve tasks, define scoring criteria, test tasks against models, and review work for quality.

Responsibilities

  • Build realistic evidence files from a provided scenario: CRM opportunity and activity exports, pipeline and forecast reports, lead lists and routing rules, prospect email threads and call notes, proposals and pricing sheets, quotes and order forms, discount approval requests, renewal schedules and usage reports, territory maps, quota plans and commission statements
  • Write clear task requests that state what the deliverable is and how uncertainty and justified assumptions should be handled
  • Solve each task end to end and document a reference solution with the reasoning behind every step
  • Write explicit scoring criteria that let two independent graders reach the same verdict, including acceptable alternative answers and the limits of what the solver is authorized to offer or approve
  • Run tasks against current models, find where and why they fail, and adjust difficulty
  • Check your own and peers' tasks for ambiguity, errors, answers exposed in the materials and shortcuts that skip the intended reasoning
  • Incorporate reviewer feedback within agreed turnaround times and flag guideline gaps or edge cases you run into

Skills

  • 3+ years of hands-on experience in one or more of the four areas above, as an SDR or BDR, account executive, account manager or customer success manager, or a sales, revenue or deal desk operations analyst or manager. You need to have carried the number or run the process yourself, not only managed people who did
  • Working command of the methods, rules and systems in your area (for example a qualification framework such as MEDDICC or SPICED, forecast categories and stage exit criteria, discount approval matrices and non-standard terms, commission plan mechanics and territory rules)
  • Strong spreadsheet skills, and the habit of reconciling pipeline, quota and commission figures to their source
  • Clear, precise writing in professional English
  • Ability to work independently and asynchronously against deadlines
  • Experience in B2B SaaS, enterprise or mid-market selling, across more than one motion (inbound, outbound, partner or product-led)
  • Experience with the systems used in your area, such as Salesforce or HubSpot, Outreach or Salesloft, Gong or Chorus, Clari, Salesforce CPQ or DealHub, and CaptivateIQ or Xactly
  • Sales enablement, training or onboarding experience, or having written playbooks, call scorecards or certification exams
  • Prior experience writing or reviewing AI evaluation tasks, exam questions, case studies or training material
  • Familiarity with how AI models fail (invented customer facts, miscalculated discounts or commissions, overconfident forecasts, generic objection handling)

Benefits

  • Potential bonus for each accepted task
  • Strong performers move up within that range or onto productivity-based pay
  • The trial task is paid
  • Independent contractor, fully remote, asynchronous

Company Overview

  • Patronus AI develops training data and simulated environments for frontier AI. It was founded in 2023, and is headquartered in San Francisco, California, USA, with a workforce of 51-200 employees. Its website is https://www.patronus.ai.
  • Company H1B Sponsorship

  • Patronus AI has a track record of offering H1B sponsorships, with 4 in 2026, 1 in 2025. Please note that this does not guarantee sponsorship for this specific role.
  • More open positions

    [Remote] Domain Expert, AI Evaluation Task Writer: Healthcare (Contract, Remote)

    Work from home Full-time role

    [Remote] Domain Expert, AI Evaluation Task Writer: Legal (Contract, Remote)

    Work from home Full-time role

    [Remote] IRB Senior Analyst

    Work from home Full-time role

    [Remote] Midwest Regional Sales Manager

    Work from home Full-time role

    [Remote] Staff Analyst

    Work from home Full-time role

    Deputy Chief Information Security Officer

    Work from home Full-time role

    Epic Ambulatory Analyst - Behavioral Health - Remote - San Mateo, CA

    Work from home Full-time role

    Part-Time Social Media & Community VA — Parenting Podcast (US Eastern Hrs., 10–15 hrs/week, ongoing)

    Work from home Full-time role

    Commission-Based Insurance Producer (1099 Independent Contractor) Remote

    Work from home Full-time role

    [Remote] Senior Application Developer/DevOps Engineer #11785

    Work from home Full-time role

    Inside Sales Manager – B2B Akquise, 20 – 25 Stunden (100% Remote) (m/w/d)

    Work from home Full-time role

    Assistant Store Manager

    Work from home Full-time role

    MGR IT DATA SERVICES, FCH - IT EDI (6605440001)

    Work from home Full-time role

    Cell Culture Sales Specialist

    Work from home Full-time role

    Donor Lifecycle Marketing Manager

    Work from home Full-time role

    Security Systems Solutions Engineer

    Work from home Full-time role

    Tiktok content creator - app start-up (unpaid) - remote US

    Work from home Full-time role

    VP, Global Talent Acquisition

    Work from home Full-time role

    Senior Remote Customer Service Representative – CX Innovation Champion, Digital Experience Specialist, Remote Service Excellence Leader, Global Customer Success & Support at brighthush

    Work from home Full-time role

    Client Services- Vacation Planning | Fully Remote

    Work from home Full-time role

    Remote Outbound Call Center Agent

    Work from home Full-time role