What is a historical bias?
A type of bias that already exists in the world and has made its way into a dataset.
historical bias explained in plain English
A type of bias that already exists in the world and has made its way into a dataset. These biases have a tendency to reflect existing cultural stereotypes, demographic inequalities, and prejudices against certain social groups. For example, consider a classification model that predicts whether or not a loan applicant will default on their loan, which was trained on historical loan-default data from the 1980s from local banks in two different communities. If past applicants from Community A were six times more likely to default on their loans than applicants from Community B, the model might learn a historical bias resulting in the model being less likely to approve loans in Community A, even if the historical conditions that resulted in that community's higher default rates were no longer relevant. See Fairness: Types of bias in Machine Learning Crash Course for more information.
Example
Practitioners refer to historical bias when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.
People also read
- bias
1.
- bias (math) or bias term
An intercept or offset from an origin.
- confirmation bias
The tendency to search for, interpret, favor, and recall information in a way that confirms one's pre-existing beliefs or hypotheses.
- counterfactual fairness
A fairness metric that checks whether a classification model produces the same result for one individual as it does for another individual who is identical to the first, except with respect to one or more sensitive attributes.
- demographic parity
A fairness metric that is satisfied if the results of a model's classification are not dependent on a given sensitive attribute.
- discriminative model
A model that predicts labels from a set of one or more features.
- equality of opportunity
A fairness metric to assess whether a model is predicting the desirable outcome equally well for all values of a sensitive attribute.
- equalized odds
A fairness metric to assess whether a model is predicting outcomes equally well for all values of a sensitive attribute with respect to both the positive class and negative class—not just one class or the other exclusively.
- evaluation
The process of measuring a model's quality or comparing different models against each other.
- fairness metric
A mathematical definition of "fairness" that is measurable.