What is bigram?
A sequence of two items from a string of tokens
bigram explained in plain English
Analogy
Bigrams are like looking at pairs of words in a sentence, like 'hello world', to see how often they appear together, just like how you might look at pairs of friends who always sit together in a classroom.
Example
A search engine might use bigrams to predict the next word in a search query, so if you type 'hello', it might suggest 'world' as the next word.
How is bigram used?
Bigrams are used in natural language processing and machine learning to analyze text data, predict the next word in a sequence, and improve language models.
Common misconceptions about bigram
Some people think bigrams are only used for language processing, but they can also be applied to other types of sequences, such as music or genetic data.
History
The concept of bigrams has been around since the 1950s, but it wasn't until the development of modern natural language processing techniques that they became widely used.
People also read
- automatic evaluation
The use of algorithms and statistical models to assess the performance of AI systems
- bag of words
A representation of text as a collection of individual words, ignoring grammar and word order
- BERT
A pre-trained language model developed by Google
- BLEU
A metric for evaluating the quality of machine translation
- BLEURT
A metric used to evaluate the quality of text generated by language models
- Character N-gram F-score
A measure of the accuracy of text generation models
- constituency parsing
A process in natural language processing to analyze the syntactic structure of sentences
- crash blossom
A phrase or sentence that is ambiguous or open to multiple interpretations due to its grammatical structure
- decoder
A component of a neural network that generates output from encoded input
- Embedding
A numerical representation of text, images, or other data that captures semantic meaning.