What is a reference text?
An expert's response to a prompt.
reference text explained in plain English
An expert's response to a prompt. For example, given the following prompt: Translate the question "What is your name?" from English to French. An expert's response might be: Comment vous appelez-vous? Various metrics (such as ROUGE) measure the degree to which the reference text matches an ML model's generated text.
Example
Practitioners refer to reference text when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.
People also read
- golden response
A response known to be good.
- automatic evaluation
Using software to judge the quality of a model's output.
- average precision at k
A metric for summarizing a model's performance on a single prompt that generates ranked results, such as a numbered list of book recommendations.
- bag of words
A representation of the words in a phrase or passage, irrespective of order.
- BERT
A model architecture for text representation.
- bigram
An N-gram in which N=2.
- black box model
A model whose "reasoning" is impossible or difficult for humans to understand.
- BLEU
A metric between 0.
- BLEURT
A metric for evaluating machine translations from one language to another, particularly to and from English.
- Chain-of-Thought Prompting
Asking an AI to show its reasoning step by step before giving a final answer, which often improves accuracy on complex tasks.