What is a generative AI?
An emerging transformative field with no formal definition.
generative AI explained in plain English
An emerging transformative field with no formal definition. That said, most experts agree that generative AI models can create ("generate") content that is all of the following: - complex - coherent - original Examples of generative AI include: - Large language models, which can generate sophisticated original text and answer questions. - Image generation model, which can produce unique images. - Audio and music generation models, which can compose original music or generate realistic speech. - Video generation models, which can generate original videos. Some earlier technologies, including LSTMs and RNNs, can also generate original and coherent content. Some experts view these earlier technologies as generative AI, while others feel that true generative AI requires more complex output than those earlier technologies can produce. Contrast with predictive ML.
Example
Practitioners refer to generative ai when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.
People also read
- Embedding
A numerical representation of text, images, or other data that captures semantic meaning.
- GPT
A family of large language models developed by OpenAI that generate human-like text.
- Long Short-Term Memory
A type of cell in a recurrent neural network used to process sequences of data in applications such as handwriting recognition, machine translation, and image captioning.
- mixture of experts
A scheme to increase neural network efficiency by using only a subset of its parameters (known as an expert) to process a given input token or example.
- Neural Architecture Search
A technique for automatically designing the architecture of a neural network.
- pooling
Reducing a matrix (or matrixes) created by an earlier convolutional layer to a smaller matrix.
- Transformer
The neural network architecture that revolutionised AI by enabling models to process entire sequences at once.
- AI slop
Output from a generative AI system that favors quantity over quality.
- Attention
A mechanism that lets a model focus on the most relevant parts of its input when producing an output, weighting what matters most in context.
- auto-regressive model
A model that infers a prediction based on its own previous predictions.