What is a linear model?
A model that assigns one weight per feature to make predictions.
linear model explained in plain English
A model that assigns one weight per feature to make predictions. (Linear models also incorporate a bias.) In contrast, the relationship of features to predictions in deep models is generally nonlinear. Linear models are usually easier to train and more interpretable than deep models. However, deep models can learn complex relationships between features. Linear regression and logistic regression are two types of linear models.
where: - y' is the raw prediction. (In certain kinds of linear models, this raw prediction will be further modified. For example, see logistic regression.) - b is the bias. - w is a weight, so w1 is the weight of the first feature, w2 is the weight of the second feature, and so on. - x is a feature, so x1 is the value of the first feature, x2 is the value of the second feature, and so on. For example, suppose a linear model for three features learns the following bias and weights: - b = 7 - w1 = -2.5 - w2 = -1.2 - w3 = 1.4 Therefore, given three features (x1, x2, and x3), the linear model uses the following equation to generate each prediction:
Suppose a particular example contains the following values: - x1 = 4 - x2 = -10 - x3 = 5 Plugging those values into the formula yields a prediction for this example:
Example
Linear models include not only models that use only a linear equation to make predictions but also a broader set of models that use a linear equation as just one component of the formula that makes predictions. For example, logistic regression post-processes the raw prediction (y') to produce a final prediction value between 0 and 1, exclusively. ---
People also read
- bias
1.
- bias (math) or bias term
An intercept or offset from an origin.
- confirmation bias
The tendency to search for, interpret, favor, and recall information in a way that confirms one's pre-existing beliefs or hypotheses.
- counterfactual fairness
A fairness metric that checks whether a classification model produces the same result for one individual as it does for another individual who is identical to the first, except with respect to one or more sensitive attributes.
- demographic parity
A fairness metric that is satisfied if the results of a model's classification are not dependent on a given sensitive attribute.
- discriminative model
A model that predicts labels from a set of one or more features.
- equality of opportunity
A fairness metric to assess whether a model is predicting the desirable outcome equally well for all values of a sensitive attribute.
- equalized odds
A fairness metric to assess whether a model is predicting outcomes equally well for all values of a sensitive attribute with respect to both the positive class and negative class—not just one class or the other exclusively.
- evaluation
The process of measuring a model's quality or comparing different models against each other.
- fairness metric
A mathematical definition of "fairness" that is measurable.