Crossing Hurdles
Visual QA Analyst | $3/task Remote
Job Description
Commitment: 40 hours/week with 6 hours overlap with PST
Duration: 4 Weeks
Role Responsibilities
- Evaluate AI-generated and real-world visual media content using structured guidelines and predefined rating frameworks
- Review videos and identify hallucinations/anomalies such as object morphing, disappearing objects, unrealistic movements, and visual inconsistencies
- Provide clear, structured written justifications to support evaluation decisions
- Ensure consistency, accuracy, and attention to detail across high-volume annotation tasks
- Assess media quality based on realism, motion, lighting, composition, camera movement, and overall production standards
- Collaborate with teams to improve AI model evaluation quality and benchmark reliability
- Incorporate feedback from LLM performance metrics into training data creation
- Apply analytical reasoning and visual judgment to chall...