RemoteJobsOne
AI Product Evaluator – Remote (Worldwide)
Charlotte, California, US
Role snapshot
RemoteJobsOne is hiring a AI Product Evaluator – Remote (Worldwide) on a full-time basis. This is a remote role open to candidates in US.
- Company
- RemoteJobsOne
- Location
- Charlotte, California, US
- Work mode
- Remote
- Job type
- Full-time
- Posted
- Oct 27, 2026
Who this role suits
The listing does not state a required experience level here. Read the requirements in the description below and apply if they match your background.
How to prepare your application
- Match your résumé to the requirements in the description, using the same wording where it is honest to do so.
- Prepare a short example for each requirement you meet, and be ready to explain any you only partly meet.
- Read what RemoteJobsOne publishes about its product or team, so you can say clearly why this role and this company.
- For remote roles, show that you communicate clearly in writing and can work without close supervision.
Apply only on RemoteJobsOne's own site. A genuine employer never asks candidates for money, deposits or bank details to apply, interview or “secure” a job. If something looks wrong, use Report a problem with this listing and we will review it. Read how we check listings.
About the role
IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder.
This is a fully remote position, open to candidates based in 55 countries, including United States, United Kingdom, Canada, Germany, India, France, Netherlands, Singapore.
Pay: $14–$36/hr
Role Title: AI Product Evaluator
Role Type: Contractor
Location: India, Japan or United Kingdom, Remote
We are engaging expert AI Product Evaluators to contribute directly to a customer's high-impact AI project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. This operationally intensive engagement involves handling AI model and agent evaluations, often within strict timeframes and usage limit resets. The project benefits greatly from contributions of multiple specialists, each bringing a meticulous approach to instruction-following and quality assurance.
Scope of Work
- Evaluate AI models and agents according to detailed, pre-defined scenarios and guidelines.
- Execute a series of operational tasks designed to test model accuracy, reasoning, and responsiveness.
- Document findings, observations, and any anomalies in structured written reports.
- Reset usage limits and repeat evaluations as required by project protocols.
- Record findings and submit evaluation datasets on AI training platforms in line with project standards and milestones.
- Maintain a high standard of attention to detail and rigor across all evaluation tasks.
Preferred Qualifications
- Experience with AI products, AI models, or AI agent evaluation and testing.
- Demonstrated ability to follow complex instructions with precision and consistency.
- Exceptional attention to detail and operational thoroughness.
- Someone who already uses AI in daily life.
- Comfort working with repetitive or high-volume operational tasks within strict timeframes.
- Prior participation in digital product, software QA, or AI research projects is a plus.
- Detail-oriented, great at following instructions and documenting each step.
How to apply
Apply here with your profile. We will then email you a link to complete your application on the hiring platform — your application is only considered once that final step is done.