Machine Learning Intermediate
serving
The process of making a trained model available to provide predictions through online inference or offline inference.
Plain English Explanation
The process of making a trained model available to provide predictions through online inference or offline inference.
How is it used?
Practitioners refer to serving when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.