parameter-efficient tuning

A set of techniques to fine-tune a large pre-trained language model (PLM) more efficiently than full fine-tuning. Parameter-efficient tuning typically fine-tunes far fewer parameters than full fine-tuning, yet generally produces a large language model that performs as well (or almost as well) as a large language model built from full fine-tuning. Compare and contrast parameter-efficient tuning with: - instruction tuning - prompt tuning Parameter-efficient tuning is also known as parameter-efficient fine-tuning.

Practitioners refer to parameter-efficient tuning when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.