What is an unawareness?
A situation in which sensitive attributes are present, but not included in the training data.
unawareness explained in plain English
A situation in which sensitive attributes are present, but not included in the training data. Because sensitive attributes are often correlated with other attributes of one's data, a model trained with unawareness about a sensitive attribute could still have disparate impact with respect to that attribute, or violate other fairness constraints.
Example
Practitioners refer to unawareness when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.
People also read
- attribute
Synonym for feature.
- automation bias
When a human decision maker favors recommendations made by an automated decision-making system over information made without automation, even when the automated decision-making system makes errors.
- bias
1.
- bias (math) or bias term
An intercept or offset from an origin.
- calibration layer
A post-prediction adjustment, typically to account for prediction bias.
- Confabulation
When an AI produces a confident, fluent answer that sounds true but is factually wrong — generating plausible language without a reliable link to reality.
- confirmation bias
The tendency to search for, interpret, favor, and recall information in a way that confirms one's pre-existing beliefs or hypotheses.
- counterfactual fairness
A fairness metric that checks whether a classification model produces the same result for one individual as it does for another individual who is identical to the first, except with respect to one or more sensitive attributes.
- coverage bias
See selection bias.
- demographic parity
A fairness metric that is satisfied if the results of a model's classification are not dependent on a given sensitive attribute.