What is an out-group homogeneity bias?
The tendency to see out-group members as more alike than in-group members when comparing attitudes, values, personality traits, and other characteristics.
out-group homogeneity bias explained in plain English
The tendency to see out-group members as more alike than in-group members when comparing attitudes, values, personality traits, and other characteristics. In-group refers to people you interact with regularly; out-group refers to people you don't interact with regularly. If you create a dataset by asking people to provide attributes about out-groups, those attributes may be less nuanced and more stereotyped than attributes that participants list for people in their in-group. For example, Lilliputians might describe the houses of other Lilliputians in great detail, citing small differences in architectural styles, windows, doors, and sizes. However, the same Lilliputians might simply declare that Brobdingnagians all live in identical houses. Out-group homogeneity bias is a form of group attribution bias. See also in-group bias.
Example
Practitioners refer to out-group homogeneity bias when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.
People also read
- attribute
Synonym for feature.
- automation bias
When a human decision maker favors recommendations made by an automated decision-making system over information made without automation, even when the automated decision-making system makes errors.
- bias
1.
- bias (math) or bias term
An intercept or offset from an origin.
- calibration layer
A post-prediction adjustment, typically to account for prediction bias.
- Confabulation
When an AI produces a confident, fluent answer that sounds true but is factually wrong — generating plausible language without a reliable link to reality.
- confirmation bias
The tendency to search for, interpret, favor, and recall information in a way that confirms one's pre-existing beliefs or hypotheses.
- counterfactual fairness
A fairness metric that checks whether a classification model produces the same result for one individual as it does for another individual who is identical to the first, except with respect to one or more sensitive attributes.
- coverage bias
See selection bias.
- demographic parity
A fairness metric that is satisfied if the results of a model's classification are not dependent on a given sensitive attribute.