What is reviewer calibration?
Reviewer calibration is the process of aligning reviewers' judgments with a gold standard through examples, feedback and checks.
Last reviewed
reviewer calibration in AI data
Calibration is why two vendors with the same hourly rate can deliver very different data.
Type: quality control process.
Where reviewer calibration applies on this site
- Data type: Expert demonstration data
- Guide: RLHF vs SFT: what is the difference?
- Guide: How to buy AI training data
- Guide: How AI training data is priced
Quick answers
What is reviewer calibration?
Reviewer calibration is the process of aligning reviewers' judgments with a gold standard through examples, feedback and checks.
Why does reviewer calibration matter in AI data?
Calibration is why two vendors with the same hourly rate can deliver very different data.