What is a foundation model?
A very large pre-trained model trained on an enormous and diverse training set.
foundation model explained in plain English
A very large pre-trained model trained on an enormous and diverse training set. A foundation model can do both of the following: - Respond well to a wide range of requests. - Serve as a base model for additional fine-tuning or other customization. In other words, a foundation model is already very capable in a general sense but can be further customized to become even more useful for a specific task.
Example
Practitioners refer to foundation model when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.
People also read
- clipping
A technique for handling outliers by doing either or both of the following: - Reducing feature values that are greater than a maximum threshold down to that maximum threshold.
- retrieval-augmented generation
A technique for improving the quality of large language model (LLM) output by grounding it with sources of knowledge retrieved after the model was trained.
- A/B testing
A statistical way of comparing two (or more) techniques—the A and the B.
- ablation
A technique for evaluating the importance of a feature or component by temporarily removing it from a model.
- accuracy
The number of correct classification predictions divided by the total number of predictions.
- activation function
A function that enables neural networks to learn nonlinear (complex) relationships between features and the label.
- active learning
A training approach in which the algorithm chooses some of the data it learns from.
- adaptation
Synonym for tuning or fine-tuning.
- agglomerative clustering
See hierarchical clustering.
- anomaly detection
The process of identifying outliers.