All roles

Open role

Graphic Designer - AI Image Evaluation (Remote)

Remote · Vietnam Full-time

About the Company

Outlier is an AI training platform owned and operated by Scale AI. The platform connects experts with projects that help train and evaluate advanced AI models. Outlier Experts contribute to improving AI systems by generating training data, reviewing model outputs, and providing detailed feedback.

About the Role

Outlier is seeking detail-oriented English speakers to evaluate AI-generated images, videos, and audio. This remote freelance opportunity involves interacting with AI voice models, comparing generated media, identifying quality issues, and providing clear written explanations of evaluation decisions. Contributors can work from anywhere within the currently accepted countries and set their own schedules, with no minimum weekly hours. The work is project-based, and tasks may vary depending on expertise, skills assessments, location, and project requirements.

Key Responsibilities

Conduct live, scenario-based conversations in English with AI voice models and evaluate how natural, useful, and clear their responses sound Compare AI-generated images and videos against text prompts to determine which output follows the instructions more accurately Evaluate edited images and videos against their original versions Inspect generated media closely, including zooming in on images and replaying audio or video, to identify quality issues Identify visual problems such as distorted anatomy, AI-generated artifacts, text errors, flickering, and unnatural motion Evaluate audio quality, pronunciation, naturalness, and consistency between audio and video Rate outputs based on prompt adherence, quality, realism, and other evaluation criteria Write specific, evidence-based explanations in English describing observed issues and supporting evaluation decisions Label first-person videos showing people or robots performing hands-on tasks Break video clips into individual actions and create accurate captions by reviewing and correcting AI-generated drafts Record short voice explanations when required by specific evaluation tasks Common Project Tasks Image Evaluation: Compare AI-generated images created from the same text prompt and assess instruction adherence, visual quality, and visible AI artifacts. Some tasks involve comparing edited images with their original versions. Video Evaluation: Evaluate AI-generated videos against text prompts or compare edited videos with their source clips. Video Caption Labeling: Review first-person videos of people or robots performing practical tasks, divide clips into individual actions, and write precise captions based on the footage. Audio and Voice Evaluation: Assess AI-generated speech for naturalness, pronunciation, and similarity to a target voice. Some projects may require recording a short spoken explanation.

Required Qualifications

Fluent English communication skills, including strong written communication and natural conversational ability Strong attention to detail and patience when reviewing visual and audio content Ability to identify subtle errors by carefully inspecting, zooming in on, or replaying media Comfort with realistic, scenario-based conversations and thinking on your feet Experience writing concise, evidence-based explanations or reviews Ability to make clear evaluation decisions when both available options have flaws

Preferred Qualifications

Currently pursuing or holding a Bachelor's degree or higher Requirements to Sign Up Valid identification and a mobile phone from your country of residence An up-to-date resume highlighting relevant expertise A LinkedIn profile showing educational background and work experience Compensation and Payment Project-based earnings of up to USD $15 per hour Additional incentives through Missions, Outlier's surge-pricing program Contributors earn an average of 7.5% in additional earnings through Missions, while top-quartile contributors increase their earnings by an average of 11% Payments are processed weekly on Tuesdays for tasks completed during the previous pay period, which runs from Tuesday to Monday at midnight UTC Available payment methods include PayPal, AirTM, and ACH transfer Rates vary according to expertise, skills assessment, location, and project requirements Higher rates may be available for advanced qualifications, including PhD-level expertise Lower rates may apply to non-core work, including initial project onboarding and project overtime phases Certain projects may offer additional incentive payments, subject to their individual payment terms Additional incentive figures are based on payments made during the previous six months and are updated quarterly. Benefits and Work Flexibility Work remotely from anywhere within the currently accepted countries Set your own schedule with no minimum weekly hours Choose to work five, 40, or another number of hours per week based on availability Free access to leading large language models valued at $200 per month Opportunity to collaborate with experts across different fields Contribute to the evaluation and improvement of pre-release AI models

How to Apply

Create an account on the Outlier platform Upload your resume Submit valid identification Complete the required onboarding and project tasks to begin earning Eligible Countries Currently accepting applicants from Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States. Employment Type and Work Authorization 1099 freelance contract opportunity through the Outlier.ai platform Contributors join as independent contractors, not employees Internships, employment, and visa sponsorship are not offered Applicants must be authorized to work in their country of residence International students may be eligible to sign up depending on their visa status. They should consult a tax or immigration advisor regarding their individual circumstances.

More open positions

Practice Manager - Surgical Specialties Service Line

Work from home Full-time role

Territory Sales Manager

Work from home Full-time role

Partner Sales Manager (Cloud & AI)

Work from home Full-time role

QA Engineer (Remote)

Work from home Full-time role

Staff Engineer - Developer Productivity

Work from home Full-time role

Licensed Mental Health Professional (LPC/LMFT/LCSW/LMHC) - Miramar, FL

Work from home Full-time role

MRI Patient Services Specialist - Tower at Parkwest

Work from home Full-time role

Field Application Specialist

Work from home Full-time role

Speech Language Pathologist

Work from home Full-time role

F.T-Medical Records Abstractor

Work from home Full-time role

Team Lead: Functional Consultants

Work from home Full-time role

IT - Enterprise Platforms Servicing Applications - Business Systems Analyst I

Work from home Full-time role

District Sales Manager - Bone Health - Cleveland, OH

Work from home Full-time role

[Remote] Director, Project Management Talent & Delivery Excellence - EDS

Work from home Full-time role

Employment Litigation Paralegal (OR, WA) - Remote

Work from home Full-time role

AI Conversation Recording Contributor - Tswana

Work from home Full-time role

eCOA Account Management Director, Client Services

Work from home Full-time role

Seasonal Remote Customer Outreach & Marketing Associate – High‑Impact Outbound Sales & Customer Success Specialist at brighthush – Drive Holiday Sales, Build Relationships, Accelerate Career Growth

Work from home Full-time role

Senior DevSecOps Engineer (Contract)

Work from home Full-time role

Senior Product Manager, Salesforce and Digital platforms

Work from home Full-time role

Dynamic Remote Customer Service & Receptionist – Flexible Hours, Virtual First‑Contact Specialist for brighthush

Work from home Full-time role