black box model
A model whose "reasoning" is impossible or difficult for humans to understand.
Plain English Explanation
A model whose "reasoning" is impossible or difficult for humans to understand. That is, although humans can see how prompts affect responses, humans can't determine exactly how a black box model determines the response. In other words, a black box model is lacking interpretability. Most deep models and large language models are black boxes.
How is it used?
Practitioners refer to black box model when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.