Open role
JavaScript and TypeScript AI Model Evaluation Developer
The Work You will combine software development with hands-on AI model training and evaluation. Your work will help assess model quality, improve responses, and prepare code and datasets used to train AI systems.
- Design, develop, and maintain readable, reusable, secure, and stable JavaScript or TypeScript code.
- Evaluate model responses and rank them against defined criteria across different subject areas.
- Benchmark model performance, analyze results, and recommend improvements.
- Write clear explanations for evaluation decisions and improve responses for clarity, relevance, and technical accuracy.
- Create and maintain datasets for supervised fine-tuning, where examples are used to teach a model.
- Support reinforcement learning with human feedback and help refine reward models.
- Review code and documentation, then provide constructive feedback.
What It Pays and Takes The listing does not specify a pay rate. This is a remote contractor assignment with a one-month contract duration.
- Hours: At least four hours per day and 20 hours per week.
- Weekly options: 20, 30, or 40 hours.
- Schedule: Four hours of overlap with Pacific Time.
- Location: Remote and open worldwide.
- Language: Excellent spoken and written English.
- Experience: Extensive JavaScript or TypeScript experience, including strong knowledge of ES6 syntax and conventions.
- Web development: Experience with modular web applications and scalable architectures, using at least one of Node.js, Nest.js, React, Angular, or Vue.
- Code quality: Ability to write correct, readable, maintainable, secure, well-tested, and clearly annotated code.
- AI evaluation: Ability to rank model responses, write technical rationales, create supervised fine-tuning datasets, and support human feedback training.
- Education: An engineering or computer science degree, or equivalent experience.
- Valued experience: Docker and software quality assurance or test planning.
How It Works Apply on OpenTrain with your resume and then complete the application on the hiring site. About AI Training Work AI training is the human work behind modern AI systems, including writing and rating model responses, preparing code, and reviewing examples used for training. OpenTrain helps people find and build careers in this field by connecting them with projects, profile-building tools, and applications.