Outlier is a platform owned and operated by Scale AI and believes AI can only perform as well as the data it’s trained on.That’s why we work with contributors from all over the world, who help improve AI models by providing expert human feedback.This data has led to AI advancements for the world's leading AI labs and large language model builders.
We’ve built a best-in-class remote work platform for our freelance contributors to provide valuable, specialized skills, and we in turn strive to provide them with a positive experience based on our core pillars of reliability, transparency, and flexibility.
What you will be doing
Create a challenging prompt that the model fails to answer correctly.
Create a grading rubric on what a good answer would be.
Write the correct answer that scores 100% on the rubric.
Provide clear, constructive feedback to improve AI-generated responses.
What we’re looking for
PhD or Master's Degree in Industrial engineering or related field. Can be currently enrolled.
Deep subject matter expertise with the ability to create complex, graduate-level problems that challenge AI reasoning.
Strong analytical and problem-solving skills, with experience in crafting rigorous, high-quality questions and solutions.
Attention to detail to accurately assess AI capabilities and evaluate peer submissions.
Fluency/High proficiency in English.
What You'll Do
Create a challenging prompt that the model fails to answer correctly.
Create a grading rubric on what a good answer would be.
Write the correct answer that scores 100% on the rubric.
Provide clear, constructive feedback to improve AI-generated responses.
PhD or Master's Degree in Industrial engineering or related field. Can be currently enrolled.
Deep subject matter expertise with the ability to create complex, graduate-level problems that challenge AI reasoning.
