Skip to content
AI Data Auction

AI data glossary

This glossary defines 35 terms used in AI training data and data auctions. Each entry opens with a one-sentence definition and links to related terms and deeper guides.

Last reviewed
AI data auction
An AI data auction is a competitive sale in which buyers bid, or sellers undercut, to set the price and terms for training or evaluation data used by AI models.
annotation
Annotation is the process of adding labels, ratings or structure to raw data so a model can learn from it.
data broker
A data broker is a business that collects data from many sources and sells or licenses it to others.
data card
A data card is a short document that describes a dataset's contents, collection method, limits and intended use.
data clean room
A data clean room is a controlled environment in which parties analyze or train on combined data without exposing the raw records.
data exchange
A data exchange is a marketplace built into a cloud or data platform so customers can access third-party data within their own accounts.
data licensing
Data licensing is the grant of rights to use a dataset for stated purposes, in return for payment or other terms.
data marketplace
A data marketplace is an online platform where data owners list datasets and buyers search, compare and license them.
data provenance
Data provenance is the documented history of where data came from, who created it and what rights attach to it.
evaluation set
An evaluation set is a collection of tasks used to measure a model, kept separate from training data.
expert demonstration
An expert demonstration is a recording of a skilled professional performing a task step by step, used to teach a model the process.
fair use
Fair use is a US copyright doctrine that permits some uses of copyrighted work without permission.
fine-tuning
Fine-tuning is the further training of a pretrained model on a smaller dataset to adapt it to a task or style.
foundation model
A foundation model is a large model trained on broad data that can be adapted to many tasks.
frontier lab
A frontier lab is an organization that trains the most capable general-purpose AI models.
held-out set
A held-out set is a portion of data deliberately excluded from training so it can test the model fairly.
inter-annotator agreement
Inter-annotator agreement is a measure of how often different reviewers give the same label to the same item.
neolab
A neolab is a newly founded, well-funded AI research company that is not one of the established frontier labs.
opt-out
An opt-out is a signal or process by which a rights holder tells AI developers not to use their content for training.
PII
PII, or personally identifiable information, is any data that can identify a specific person.
post-training
Post-training is the set of steps after pretraining, such as supervised fine-tuning and reinforcement learning, that shape a model's behavior.
preference data
Preference data is a collection of human choices between model outputs that records which response people prefer.
pretraining
Pretraining is the first and largest stage of training a model, in which it learns general patterns from a very large body of text, code or media.
reserve price
A reserve price is the minimum price at which a seller will complete an auction.
revenue share
Revenue share is a payment model in which a data owner receives a percentage of the revenue generated from using the data.
reviewer calibration
Reviewer calibration is the process of aligning reviewers' judgments with a gold standard through examples, feedback and checks.
reward hacking
Reward hacking is a failure in which a model finds a shortcut that earns reward without doing the intended task.
RL environment
An RL environment is a simulated task with tools and an automatic grader in which a model practices and earns rewards.
RLHF
RLHF, or reinforcement learning from human feedback, is a training method in which human preference judgments are used to train a reward model that then guides a language model.
rubric
A rubric is a written set of criteria that tells reviewers how to score or compare a model output.
SFT
SFT, or supervised fine-tuning, is a post-training method in which a pretrained model learns from prompt and ideal-response pairs.
synthetic data
Synthetic data is data generated by a model or simulator instead of collected from real people or events.
training data
Training data is the set of examples a machine learning model learns from.
Vickrey auction
A Vickrey auction is a sealed-bid auction in which the highest bidder wins and pays the second-highest bid.
winner's curse
The winner's curse is the tendency of the winning bidder in an auction to overpay because they had the highest, and often most optimistic, estimate.