Topic hub

Natural Language Processing

AI techniques for understanding and generating human language.

45 dictionary entries in this topic

All terms A–Z

45 terms · A–Z

A

automatic evaluation

B

bag of words
BERT
bigram
BLEU
BLEURT

C

Character N-gram F-score
constituency parsing
crash blossom

D

decoder
dense feature

E

Embedding
encoder

G

generated text
generative AI
golden response

H

human evaluation

L

language model
Long Short-Term Memory

M

machine translation
mixture of experts

N

N-gram
natural language processing
natural language understanding
Neural Architecture Search

P

pooling
preprocessing

R

recommendation system
reference text
reporting bias
rotational invariance
ROUGE
ROUGE-L
ROUGE-N
ROUGE-S

S

sentiment analysis
size invariance
skip-gram
sparse feature
sparse representation
sparse vector

T

tokenizer
translational invariance

W

wide model
word embedding

Key Natural Language Processing concepts

automatic evaluation

The use of algorithms and statistical models to assess the performance of AI systems

bag of words

A representation of text as a collection of individual words, ignoring grammar and word order

BERT

A pre-trained language model developed by Google

bigram

A sequence of two items from a string of tokens

BLEU

A metric for evaluating the quality of machine translation

BLEURT

A metric used to evaluate the quality of text generated by language models

Character N-gram F-score

A measure of the accuracy of text generation models

constituency parsing

A process in natural language processing to analyze the syntactic structure of sentences