What is underfitting?
When a machine learning model is too simple to capture the underlying patterns in the data
underfitting explained in plain English
Underfitting occurs when a model is not complex enough to learn from the training data, resulting in poor performance on both the training and test data
Analogy
Imagine trying to draw a simple straight line to fit a complex curve - the line will not be able to capture the nuances of the curve, just like an underfitting model cannot capture the patterns in the data
Example
A company trying to predict customer churn using only a single feature, such as age, may experience underfitting because the relationship between age and churn is complex and influenced by many other factors
How is underfitting used?
Underfitting is often identified by high error rates on both the training and test data, and can be addressed by increasing the complexity of the model or adding more features to the data
Common misconceptions about underfitting
Underfitting is often confused with overfitting, but while overfitting occurs when a model is too complex, underfitting occurs when a model is too simple
History
The concept of underfitting has been around since the early days of machine learning, but it has become more prominent with the increasing use of complex models and large datasets
People also read
- activation function
A mathematical function that introduces non-linearity into a neural network model
- Backpropagation
The process that tells a neural network which internal settings caused an error and how to adjust them, working backwards through layers.
- batch
A group of data or tasks processed together
- batch normalization
A technique to normalize the input data for each layer in a neural network
- batch size
The number of data samples used to train a model at one time
- Bayesian neural network
A type of neural network that uses Bayesian inference to make predictions
- co-adaptation
The process where two or more systems adapt to each other, leading to a change in their behavior or performance
- convergence
The process of reaching a stable solution or point where changes become minimal
- deep model
A type of artificial neural network with multiple layers
- depth
The number of layers in a neural network