Feedforward neural network
| Part of a series on |
| Machine learning and data mining |
|---|
A feedforward neural network is an artificial neural network in which information flows in a single direction – inputs are multiplied by weights to obtain outputs (inputs-to-output). It contrasts with a recurrent neural network, in which loops allow information from later processing stages to feed back to earlier stages. Feedforward multiplication is essential for backpropagation, because feedback, where the outputs feed back to the very same inputs and modify them, forms an infinite loop which is not possible to differentiate through backpropagation. This nomenclature appears to be a point of confusion between some computer scientists and scientists in other fields studying brain networks.
- Simplified example of training a feedforward neural network in object detection: The network is trained by multiple images known to depict starfish and sea urchins, which are correlated with "nodes" representing visual features. Starfish match with a ringed texture and star outline, whereas most sea urchins match with a striped texture and oval shape.
- The resulting model contains weighted associations between visual features and output categories. Because one training image depicts a ring-textured sea urchin, the model also develops a weak association between ringed texture and sea urchin.
- Subsequent run of the model on an input image (left): The network correctly detects the starfish. However, the weak association between ringed texture and sea urchin also gives a weak signal to the latter from one of two intermediate nodes. In addition, a shell not included in the training gives a weak signal for the oval shape, also resulting in a weak signal for the sea urchin output. These weak signals may result in a false positive result for sea urchin.
In reality, such textures and outlines would not be represented by single nodes, but rather by associated weight patterns of multiple nodes.