Our existing scam red flags guide covers the most common platform-level scams. This piece covers a more sophisticated and increasingly common pattern specifically: companies using the structure of a legitimate job application to extract unpaid labor through "skills assessment" tasks.
How the Pattern Works
According to Digital Biz Talk's July 2026 analysis of AI training job scams, the pattern follows a consistent structure: a job listing promises $20-50/hr, total flexibility, and zero prerequisites; you apply and receive a response within hours (too fast for real screening); you're asked to complete a "skills assessment"; the assessment involves creating, labeling, or evaluating real, usable AI training data; after completing the assessment, you receive a generic rejection or simply no response.
The company gets valuable training data. You get nothing.
The Key Diagnostic Question
One question cuts through most uncertainty: Is the "assessment" task identical to the actual paid work the job description advertises? A legitimate platform uses assessments to verify skill — these are typically synthetic tasks with known correct answers, not tasks that produce commercially valuable output. An assessment that produces genuinely usable AI training data is not an assessment; it is unpaid labor dressed as a screening process.
Assessments that take longer than 30-45 minutes for entry-level roles are suspect. Tasks that involve creating or evaluating real data that a company could directly use are a red flag. Legitimate platforms use assessment tasks with known answers to verify skills, not open-ended tasks that produce commercial value.
Specific Red Flags for This Pattern
- Assessment over 45 minutes for an entry-level role — our DataAnnotation assessment guide describes what legitimate assessments look like; 1-3 hours is not normal for initial screening
- No interview, no human contact before the assessment — legitimate platforms may automate early screening but generally have some human involvement before sending you substantial work
- Generic job titles with vague task descriptions — "AI Tutor," "Digital Data Trainer" with no specifics about what you'll actually evaluate
- The company has no verifiable presence — apply our platform verification checklist before investing any time in an assessment
How to Protect Yourself
- Stick to platforms with established track records — every platform in our top 7 ranking has verified payment history
- Time-box your assessment — if a legitimate platform's assessment takes you more than 45 minutes, the problem may be your approach; if a platform explicitly requires several hours of assessment work, that is a red flag
- Search for platform reviews before starting — our verification guide gives the exact steps
- Never complete assessment tasks that feel identical to the actual paid work — a legitimate assessment tests that you can do the work; it does not ask you to do the work first
The Legitimate Comparison
Every platform in our top 7 uses assessment tasks with known correct answers for their initial screening. DataAnnotation.tech's assessment is described in detail in our starter assessment guide. Mercor's AI video interview is described in our full Mercor review. These are structured, time-bounded screening processes — not open-ended data collection disguised as hiring.
How to Verify Any AI Training Platform
Independent signals of legitimacy: documented company registration (look for a registered company number, not just a website), verifiable investor or corporate backing, active contractor community on Reddit (r/beermoney, r/slavelabour) with consistent payment confirmations, and a functional payment setup with a known processor (Stripe, PayPal, Wise, Payoneer). Red flags: upfront fees to access work, vague payment terms, no verifiable company identity, and requests for sensitive personal documentation before any work is offered.
The Most Reliable Signal
The most reliable legitimacy signal is contractor payment confirmation on independent communities — not the platform's own testimonials. Search "[platform name] payment reddit" before investing significant time in any new platform. Every legitimate platform we review on this site has documented, consistent payment histories on external communities. We do not review or recommend platforms with significant payment dispute patterns, regardless of their stated rates.
Ready to Start?
Apply directly or explore our top-ranked platforms.