What is an experimenter's bias?
See confirmation bias.
experimenter's bias explained in plain English
See confirmation bias.
Example
Practitioners refer to experimenter's bias when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.
People also read
- attribute
Synonym for feature.
- automation bias
When a human decision maker favors recommendations made by an automated decision-making system over information made without automation, even when the automated decision-making system makes errors.
- bias
1.
- bias (math) or bias term
An intercept or offset from an origin.
- calibration layer
A post-prediction adjustment, typically to account for prediction bias.
- Confabulation
When an AI produces a confident, fluent answer that sounds true but is factually wrong — generating plausible language without a reliable link to reality.
- confirmation bias
The tendency to search for, interpret, favor, and recall information in a way that confirms one's pre-existing beliefs or hypotheses.
- counterfactual fairness
A fairness metric that checks whether a classification model produces the same result for one individual as it does for another individual who is identical to the first, except with respect to one or more sensitive attributes.
- coverage bias
See selection bias.
- demographic parity
A fairness metric that is satisfied if the results of a model's classification are not dependent on a given sensitive attribute.