What is a layer?
A set of neurons in a neural network.
layer explained in plain English
A set of neurons in a neural network. Three common types of layers are as follows: - The input layer, which provides values for all the features. - One or more hidden layers, which find nonlinear relationships between the features and the label. - The output layer, which provides the prediction. For example, the following illustration shows a neural network with one input layer, two hidden layers, and one output layer: In TensorFlow, layers are also Python functions that take Tensors and configuration options as input and produce other tensors as output.
Example
Practitioners refer to layer when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.
People also read
- Backpropagation
The process that tells a neural network which internal settings caused an error and how to adjust them, working backwards through layers.
- activation function
A function that enables neural networks to learn nonlinear (complex) relationships between features and the label.
- batch
The set of examples used in one training iteration.
- batch normalization
Normalizing the input or output of the activation functions in a hidden layer.
- batch size
The number of examples in a batch.
- Bayesian neural network
A probabilistic neural network that accounts for uncertainty in weights and outputs.
- co-adaptation
An undesirable behavior in which neurons predict patterns in training data by relying almost exclusively on outputs of specific other neurons instead of relying on the network's behavior as a whole.
- convergence
A state reached when loss values change very little or not at all with each iteration.
- deep model
A neural network containing more than one hidden layer.
- depth
The sum of the following in a neural network: - the number of hidden layers - the number of output layers, which is typically 1 - the number of any embedding layers For example, a neural network with five hidden layers and one output layer has a depth of 6.