rectified linear unit

English

Graph of the rectified linear unit.

Etymology

Coined by Vinod Nair and Geoffrey Hinton in 2010 after linear units used earlier. Displaced earlier term "analog threshold element" which hasn't caught on in 1969

Noun

rectified linear unit (plural rectified linear units)

  1. A unit (artificial neuron) in an artificial neural network that employs a rectifier.
  2. The rectifier function itself.

Synonyms

Derived terms

This page is issued from Wiktionary. The text is available under Creative Commons Attribution-Share Alike 4.0 unless otherwise noted. Additional terms may apply for the media files.