Open role
[Remote] Clinical AI Evaluation
Note: The job is a remote job and is open to candidates in USA. MyRemoteTeam Inc is seeking actively practicing US physicians to evaluate AI-generated clinical answers for accuracy, reasoning, completeness, relevance, and alignment with safe medical practice. Physicians will provide structured feedback to support the evaluation and improvement of AI systems.
Responsibilities
- Review AI-generated clinical answers for medical accuracy and completeness
- Evaluate clinical reasoning, differential diagnoses, and treatment recommendations
- Identify factual errors, unsupported conclusions, omissions, and potential patient-safety concerns
- Assess whether responses align with evidence-based medical practice
- Provide structured feedback and explain clinical inaccuracies when necessary
- Maintain consistent evaluation quality throughout the project
Skills
- MD or DO degree
- Active, unrestricted US medical license
- Completed residency training or board certification
- Currently practicing with recent, direct patient-care experience
- Strong written English and the ability to communicate clinical judgments clearly
- Broad experience with diagnosis and treatment across multiple medical conditions and systems
- Applicants must confirm their current state of residence and hold an active, unrestricted medical license in an eligible US state
- Attending physicians are preferred
- Approximately 3–6 years of post-residency clinical experience
- Internal Medicine
- Family Medicine
- Emergency Medicine
- Hospital Medicine
- Experience with medical AI evaluation, clinical content review, medical question writing, annotation, or quality assurance
Benefits
- Fully remote work arrangement
Company Overview