← Back to opportunities
About the Role
About the job
Position: AI Evaluation Specialist
Type: Contract
Pay Rate: $25 - $35/hour
Location: Remote
Working Hours Commitment: 10-40 hrs/week
Key Responsibilities:
- Design and implement self-contained evaluation tasks, including prompts, supporting files, and detailed grading rubrics to assess AI performance on practical computer-based workflows.
- Define clear, unambiguous written criteria for what constitutes successful and unsuccessful task completion across diverse administrative and workflow scenarios.
- Meticulously observe and document AI agent behaviors, producing crisp, precise summaries and reports in high-quality English.
- Iterate and refine evaluation tasks and rubrics based on feedback and team collaboration...
Ready to Join Through a Referral?
Apply now and get connected directly with the hiring team
Apply for this Position