statistical modelling. Terminology is inconsistent, but three major types can be distinguished: A generative model is a statistical model of the joint...

A generative pre-trained transformer (GPT) is a type of large language model (LLM) and a prominent framework for generative artificial intelligence. It...

Generative artificial intelligence (Generative AI, GenAI, or GAI) is a subfield of artificial intelligence that uses generative models to produce text...

diffusion models, also known as diffusion-based generative models or score-based generative models, are a class of latent variable generative models. A diffusion...

largest and most capable LLMs are generative pretrained transformers (GPTs), which are largely used in generative chatbots such as ChatGPT, Gemini or...

A flow-based generative model is a generative model used in machine learning that explicitly models a probability distribution by leveraging normalizing...

realistic characteristics. Though originally proposed as a form of generative model for unsupervised learning, GANs have also proved useful for semi-supervised...

language by formulating and testing explicit models of humans' subconscious grammatical knowledge. Generative linguists, or generativists (/ˈdʒɛnərətɪvɪsts/)...

Generative Modelling Language (GML) in computer graphics and generative computer programming is a very simple programming language for the concise description...

datasets with a similar distribution. Energy-based generative neural networks is a class of generative models, which aim to learn explicit probability distributions...

classifiers, Gaussian mixture models, variational autoencoders, generative adversarial networks and others. Unlike generative modelling, which studies the joint...

development of language Generative model, a model for randomly generating observable data in probability and statistics Generative artificial intelligence...

AI algorithms. These algorithms, including Generative adversarial network (GANs) and text-to-image models, generate lifelike images, videos, or animations...

failure mode observed in generative models, originally noted in Generative Adversarial Networks (GANs). It occurs when the model produces outputs that are...

a discriminative model in place of the generative model of standard HMMs. This type of model directly models the conditional distribution of the hidden...

time t {\displaystyle t} . The generative model is the specification of the following density functions: A sensory model, p S : S × Ψ × A → R {\displaystyle...

researchers and commentators on model collapse warn that the phenomenon could fundamentally threaten future generative AI development: As AI-generated...

simply/alternatively, Veo, is a text-to-video model developed by Google DeepMind and announced in May 2024. As a generative AI model, it creates videos based on user...

explicit model trivially yields a generative model through sampling from the distributions, and repeated application of a generative model yields an...

the quality of images created by a generative model, like a generative adversarial network (GAN) or a diffusion model. The FID compares the distribution...

require a shrinking neighborhood or a decreasing step size. It is a generative model: the data is assumed to arise by first probabilistically picking a...

perform generative training, because f {\displaystyle f} can be regarded as a generative model that explains how the data were generated. Generative training...

Generative Pre-trained Transformer 4 (GPT-4) is a multimodal large language model trained and created by OpenAI and the fourth in its series of GPT foundation...

propositional formulas or latent variables organized layer-wise in deep generative models such as the nodes in deep belief networks and deep Boltzmann machines...

A variational autoencoder is a generative model with a prior and noise distribution respectively. Usually such models are trained using the expectation-maximization...

ChatGPT is a generative artificial intelligence chatbot developed by OpenAI and released on November 30, 2022. It uses large language models (LLMs) such...

shown to be a statistically inevitable byproduct of any imperfect generative model that is trained to maximize training likelihood, such as GPT-3, and...

field is a discriminative model specified over an undirected graph. A restricted Boltzmann machine is a bipartite generative model specified over an undirected...

p(\mathbf {x} _{t}){\rm {d}}t+{\sqrt {2\epsilon }}{\rm {d}}W_{t}} A generative model aims to generate samples that follow (unknown data distribution) p...

until it generates a final image. See the diffusion model page for details. Diffusion model Generative adversarial network Variational autoencoder Stable...