Open role
[Remote] Clinical AI Evaluation
Note: The job is a remote job and is open to candidates in USA. MyRemoteTeam Inc seeks actively practicing U.S. physicians to evaluate AI-generated clinical answers. The role involves assessing accuracy, clinical reasoning, completeness, relevance, and safety, and providing structured feedback to support AI system improvement.
Responsibilities
- Review AI-generated clinical answers for medical accuracy and completeness
- Evaluate clinical reasoning, differential diagnoses, and treatment recommendations
- Identify factual errors, unsupported conclusions, omissions, and potential patient-safety concerns
- Assess whether responses align with evidence-based medical practice
- Provide structured feedback and explain clinical inaccuracies when necessary
- Maintain consistent evaluation quality throughout the project
Skills
- MD or DO degree
- Active, unrestricted US medical license
- Completed residency training or board certification
- Currently practicing with recent, direct patient-care experience
- Strong written English and the ability to communicate clinical judgments clearly
- Broad experience with diagnosis and treatment across multiple medical conditions and systems
- Internal Medicine
- Family Medicine
- Emergency Medicine
- Hospital Medicine
- Physicians currently residing in the following states are not eligible: Alaska, Arkansas, California, Connecticut, Delaware, Georgia, Hawaii, Illinois, Indiana, Kansas, Louisiana, Maine, Maryland, Massachusetts, Nebraska, Nevada, New Hampshire, New Jersey, New Mexico, Ohio, Oregon, Tennessee, Utah, Vermont, Washington, and West Virginia
- Applicants must confirm their current state of residence and hold an active, unrestricted medical license in an eligible US state
- Attending physicians are preferred
- Approximately 3–6 years of post-residency clinical experience preferred
- Experience with medical AI evaluation, clinical content review, medical question writing, annotation, or quality assurance is an advantage but is not required
Benefits
- Fully remote work arrangement
Company Overview