What is an ablation?
A technique for evaluating the importance of a feature or component by temporarily removing it from a model.
ablation explained in plain English
A technique for evaluating the importance of a feature or component by temporarily removing it from a model. You then retrain the model without that feature or component, and if the retrained model performs significantly worse, then the removed feature or component was likely important. For example, suppose you train a classification model on 10 features and achieve 88% precision on the test set. To check the importance of the first feature, you can retrain the model using only the nine other features. If the retrained model performs significantly worse (for instance, 55% precision), then the removed feature was probably important. Conversely, if the retrained model performs equally well, then that feature was probably not that important. Ablation can also help determine the importance of: - Larger components, such as an entire subsystem of a larger ML system - Processes or techniques, such as a data preprocessing step In both cases, you would observe how the system's performance changes (or doesn't change) after you've removed the component.
Example
Practitioners refer to ablation when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.
People also read
- A/B testing
A statistical way of comparing two (or more) techniques—the A and the B.
- accuracy
The number of correct classification predictions divided by the total number of predictions.
- activation function
A function that enables neural networks to learn nonlinear (complex) relationships between features and the label.
- active learning
A training approach in which the algorithm chooses some of the data it learns from.
- adaptation
Synonym for tuning or fine-tuning.
- agglomerative clustering
See hierarchical clustering.
- anomaly detection
The process of identifying outliers.
- area under the PR curve
See PR AUC (Area under the PR Curve).
- area under the ROC curve
See AUC (Area under the ROC curve).
- Artificial Intelligence
Any system that performs tasks requiring human judgment — understanding language, recognising images, making decisions, or solving problems — by finding patterns in data rather than thinking or feeling.