What is rubric?
A rubric is a written set of criteria that tells reviewers how to score or compare a model output.
Last reviewed
rubric in AI data
Clear rubrics raise agreement between reviewers and make a dataset auditable.
Type: quality control tool. Also written: rubrics.
Where rubric applies on this site
- Data type: RLHF and preference data
- Data type: Expert demonstration data
- Data type: Legal training data
- Data type: Evaluation sets
- Mechanism: Reverse auction
- Guide: What is an AI data auction?
- Guide: RLHF vs SFT: what is the difference?
- Guide: How to evaluate an AI data vendor
- Guide: How to buy AI training data
- Guide: How AI training data is priced
- Guide: Designing an AI data pilot
- Guide: AI data RFP template
Quick answers
What is rubric?
A rubric is a written set of criteria that tells reviewers how to score or compare a model output.
Why does rubric matter in AI data?
Clear rubrics raise agreement between reviewers and make a dataset auditable.