A residual neural network (also referred to as a residual network or ResNet) is a deep learning architecture in which the layers learn residual functions...
28 KB (3,042 words) - 20:18, 1 August 2025
with ℓ being the ℓ-th layer of this residual neural network. While the forward propagation of a residual neural network is done by applying a sequence of...
7 KB (850 words) - 15:36, 10 June 2025
techniques were developed to train such networks: the Highway Network (published in May), and the residual neural network, or ResNet (December). ResNet behaves...
11 KB (1,316 words) - 20:57, 10 June 2025
Scientist at Google DeepMind. He is known as one of the creators of residual neural network (ResNet). He attended the public Guangzhou Zhixin High School in...
6 KB (441 words) - 02:51, 17 July 2025
Deep learning (redirect from Deep neural network)
machine learning, deep learning focuses on utilizing multilayered neural networks to perform tasks such as classification, regression, and representation...
183 KB (18,116 words) - 11:29, 31 July 2025
Graph neural networks (GNN) are specialized artificial neural networks that are designed for tasks whose inputs are graphs. One prominent example is molecular...
43 KB (4,802 words) - 03:26, 17 July 2025
In machine learning, a neural network (also artificial neural network or neural net, abbreviated ANN or NN) is a computational model inspired by the structure...
168 KB (17,613 words) - 12:10, 26 July 2025
Physics-informed neural networks (PINNs), also referred to as Theory-Trained Neural Networks (TTNs), are a type of universal function approximators that...
39 KB (4,952 words) - 14:47, 29 July 2025
(2017). "Enhanced Deep Residual Networks for Single Image Super-Resolution". arXiv:1707.02921 [cs.CV]. "Generative Adversarial Network and Super Resolution...
12 KB (293 words) - 15:05, 24 May 2025
Artificial neural networks (ANNs) are models created using machine learning to perform a number of tasks. Their creation was inspired by biological neural circuitry...
85 KB (8,625 words) - 20:54, 10 June 2025
Universal approximation theorem (category Artificial neural networks)
feed-forward neural networks with ReLU as activation functions. Similar results that can be directly applied to residual neural networks were also obtained...
39 KB (5,230 words) - 15:20, 27 July 2025
A convolutional neural network (CNN) is a type of feedforward neural network that learns features via filter (or kernel) optimization. This type of deep...
138 KB (15,555 words) - 03:37, 31 July 2025
In machine learning, a neural scaling law is an empirical scaling law that describes how neural network performance changes as key factors are scaled up...
44 KB (5,854 words) - 22:47, 13 July 2025
machine learning, a neural field (also known as implicit neural representation, neural implicit, or coordinate-based neural network), is a mathematical...
21 KB (2,336 words) - 12:11, 19 July 2025
extensive mass of rock or land surface Inselberg Mesa Monadnock Residual neural network Residual volume, the amount of air left in the lungs after a maximal...
2 KB (272 words) - 09:33, 25 July 2024
highway network, a feedforward neural network with hundreds of layers, much deeper than previous networks. In Dec 2015, the residual neural network (ResNet)...
34 KB (3,148 words) - 20:51, 10 June 2025
Leela Chess Zero (section Neural network)
evaluation. These neural networks are designed to run on GPU, unlike traditional engines. It originally used residual neural networks, but in 2022 switched...
48 KB (3,543 words) - 20:25, 13 July 2025
ResNet most prominently refers to residual neural network, a type of artificial neural network characterized by introducing additional connections that...
507 bytes (93 words) - 14:14, 29 January 2025
Transformer (deep learning architecture) (redirect from Transformer (neural network))
decoder layers have a feed-forward neural network for additional processing of their outputs and contain residual connections and layer normalization...
106 KB (13,107 words) - 01:38, 26 July 2025
Weight initialization (category Artificial neural networks)
parameter initialization describes the initial step in creating a neural network. A neural network contains trainable parameters that are modified during training:...
25 KB (2,919 words) - 23:16, 20 June 2025
represents a scene as a radiance field parametrized by a deep neural network (DNN). The network predicts a volume density and view-dependent emitted radiance...
21 KB (2,616 words) - 15:20, 10 July 2025
Vanishing gradient problem (category Artificial neural networks)
later layers encountered when training neural networks with backpropagation. In such methods, neural network weights are updated proportional to their...
24 KB (3,711 words) - 14:28, 9 July 2025
developed by Ian Goodfellow and his colleagues in June 2014. In a GAN, two neural networks compete with each other in the form of a zero-sum game, where one agent's...
95 KB (13,885 words) - 07:21, 28 June 2025
Neural architecture search (NAS) is a technique for automating the design of artificial neural networks (ANN), a widely used model in the field of machine...
26 KB (2,980 words) - 15:27, 18 November 2024
VGGNet (category Neural network architectures)
The VGGNets are a series of convolutional neural networks (CNNs) developed by the Visual Geometry Group (VGG) at the University of Oxford. The VGG family...
9 KB (988 words) - 21:39, 22 July 2025
Recurrent Neural Networks, in Bengio, Yoshua; Schuurmans, Dale; Lafferty, John; Williams, Chris K. I.; and Culotta, Aron (eds.), Advances in Neural Information...
124 KB (4,803 words) - 18:56, 30 July 2025
Mixture of experts (section Meta-pi network)
trained 6 experts, each being a "time-delayed neural network" (essentially a multilayered convolution network over the mel spectrogram). They found that...
44 KB (5,634 words) - 08:30, 12 July 2025
Variational autoencoder (category Neural network architectures)
machine learning, a variational autoencoder (VAE) is an artificial neural network architecture introduced by Diederik P. Kingma and Max Welling. It is...
27 KB (3,967 words) - 14:55, 25 May 2025
Nikos (2016-05-23). "Wide Residual Networks". arXiv:1605.07146 [cs.CV]. Zoph, Barret; Le, Quoc V. (2016-11-04). "Neural Architecture Search with Reinforcement...
9 KB (855 words) - 01:17, 29 October 2024
Inception (deep learning architecture) (category Artificial neural networks)
Inception is a family of convolutional neural network (CNN) for computer vision, introduced by researchers at Google in 2014 as GoogLeNet (later renamed...
10 KB (1,144 words) - 11:39, 17 July 2025