All roles

Open role

[Remote] Clinical AI Evaluation

Remote · New Zealand Full-time

Note: The job is a remote job and is open to candidates in USA. MyRemoteTeam Inc is seeking actively practicing US physicians to evaluate AI-generated clinical answers for accuracy, reasoning, completeness, relevance, and alignment with safe medical practice. Physicians will provide structured feedback to support the evaluation and improvement of AI systems.

Responsibilities

  • Review AI-generated clinical answers for medical accuracy and completeness
  • Evaluate clinical reasoning, differential diagnoses, and treatment recommendations
  • Identify factual errors, unsupported conclusions, omissions, and potential patient-safety concerns
  • Assess whether responses align with evidence-based medical practice
  • Provide structured feedback and explain clinical inaccuracies when necessary
  • Maintain consistent evaluation quality throughout the project

Skills

  • MD or DO degree
  • Active, unrestricted US medical license
  • Completed residency training or board certification
  • Currently practicing with recent, direct patient-care experience
  • Strong written English and the ability to communicate clinical judgments clearly
  • Broad experience with diagnosis and treatment across multiple medical conditions and systems
  • Applicants must confirm their current state of residence and hold an active, unrestricted medical license in an eligible US state
  • Attending physicians are preferred
  • Approximately 3–6 years of post-residency clinical experience
  • Internal Medicine
  • Family Medicine
  • Emergency Medicine
  • Hospital Medicine
  • Experience with medical AI evaluation, clinical content review, medical question writing, annotation, or quality assurance

Benefits

  • Fully remote work arrangement

Company Overview

  • MyRemoteTeam.com is a quick & easy way for Businesses to Pay Remote Teams, Employees, Consultants & Freelancers. It was founded in 2017, and is headquartered in Walnut Creek, California, USA, with a workforce of 11-50 employees. Its website is https://www.myremoteteam.com.
  • More open positions

    [Remote] Growth Manager, Government Sales

    Work from home Full-time role

    [Remote] Staff Product Manager, Platform

    Work from home Full-time role

    [Remote] UKG Pro Tester / UKG Pro QA Analyst

    Work from home Full-time role

    [Remote] Manual QA Engineer

    Work from home Full-time role

    [Remote] State and Local Account Director — Massachusetts (5474)

    Work from home Full-time role

    Senior Account Executive

    Work from home Full-time role

    Supply Chain Co-Founder / CPO (100 % remote) (m/f/d)

    Work from home Full-time role

    Senior Oracle Database Administrator

    Work from home Full-time role

    Account Manager

    Work from home Full-time role

    Field Clinical Specialist PT Chicago, IL (Client Success)

    Work from home Full-time role

    Hospital Support Executive

    Work from home Full-time role

    Product Tester

    Work from home Full-time role

    Business Immigration Attorney

    Work from home Full-time role

    Remote Customer Service Trainee – Flexible Schedule, Structured Career Path, Full Remote Work, Health & Financial Wellness Support at brighthush

    Work from home Full-time role

    Life Insurance Specialist

    Work from home Full-time role

    Senior React & Java Full Stack Engineer | Open Telemetry(must) | React | Spring Boot | Microservices | Kubernetes | Kafka | AWS || Remote role

    Work from home Full-time role

    Paid Product Tester

    Work from home Full-time role

    FinOps Specialist – Databricks and Cloud

    Work from home Full-time role

    Senior Oncology Account Manager, Baltimore

    Work from home Full-time role

    Frontend Desktop Engineer (100% remote - Worldwide)

    Work from home Full-time role

    Financial Representative Trainee (Sales) - Milwaukee, WI

    Work from home Full-time role