Large Language Models Intermediate
semantic memory
The information that an LLM has when training ends.
Plain English Explanation
The information that an LLM has when training ends. For example, semantic memory includes an excellent knowledge of grammar, vocabulary, and the facts it was explicitly trained on. Semantic memory does not include information gathered from retrieval-augmented generation. Contrast semantic memory with episodic memory.
How is it used?
Practitioners refer to semantic memory when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.