About the Company

DataAnnotation works with more than 100,000 experts to train leading AI models. The company provides contributors with opportunities to evaluate and improve AI systems through practical tasks, with a focus on helping models produce more reliable and useful results.

About the Role

DataAnnotation is seeking contributors to evaluate AI-generated code using real-world software engineering tasks. In this role, you will work with advanced AI coding models, assess the quality of their output, and identify issues that could affect software reliability, security, and functionality. The position involves running AI-assisted coding sessions, reviewing generated solutions against production standards, and testing models to uncover weaknesses. Your findings and written explanations will help improve future coding agents. Candidates should have experience shipping production-quality code through professional work or serious open-source contributions. A formal degree is not required.

Key Responsibilities

Use advanced AI coding models to work on real software engineering tasks, including fixing bugs, extending APIs, and implementing features. Evaluate AI-generated code against production standards and identify defects, incomplete solutions, and other technical issues. Analyze model reasoning and explain why a generated solution succeeds or fails. Test AI-generated code to uncover unsafe implementations, misleading test results, and incorrect solutions. Document findings clearly so they can be used to improve the performance and reliability of future AI coding models. Challenge AI models with practical engineering scenarios to identify limitations and failure patterns.

Required Qualifications

Professional software engineering experience or substantial open-source experience demonstrating the ability to ship production code. Strong written English skills, with the ability to explain technical findings and code quality issues clearly. Ability to assess AI-generated code critically and identify problems that may affect functionality, reliability, or security. Education Requirements A formal degree is not required. DataAnnotation prioritizes practical coding ability and demonstrated experience over educational background.

Compensation

Compensation is up to $150 or more per hour, depending on task difficulty and specialization. The company states that many contributors earn an additional $100,000–$200,000 annually, while some make this work their full-time income. Actual earnings may vary based on available tasks, completed work, and individual specialization. Work Arrangement The role offers remote work and flexible participation, with project availability described by DataAnnotation as ongoing. About DataAnnotation DataAnnotation reports having paid more than $150 million to contributors to date and states that the average contributor stays with the platform for more than five years.