Content Specialist III | AI Evaluation & Prompting

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Content Specialist III | AI Evaluation & Prompting based in United States. This remote contract role offers the opportunity to directly influence the quality and behavior of advanced AI systems.

You’ll evaluate model responses across diverse topics, conversation types, and real-world use cases. Your work will help identify strengths, uncover failure patterns, and improve how AI systems communicate with users. You’ll combine expert writing, analytical judgment, prompt engineering, and structured quality assessment to shape model performance.

The role involves close, hands-on experimentation with evolving AI products in a fast-moving environment. You’ll translate detailed observations into actionable feedback, stronger prompts, and more effective evaluation frameworks. Success requires balancing quality, speed, consistency, and independent judgment while adapting to changing product priorities.