Hebb Rule

A Hebb Rule is a heuristic for when the neurons on either side of the synapse (input and output) have highly correlated outputs.

• See: Hebbian Learning Algorithm, Synaptic Plasticity; Spike Timing Dependent Plasticity; Reinforcement Learning; Self-Organizing Maps.

---

---

References

2015

• http://penta.ufrgs.br/edu/telelab/3/hebbian_.htm
  • QUOTE: The Hebbian Learning Rule is a learning rule that specifies how much the weight of the connection between two units should be increased or decreased in proportion to the product of their activation. The rule builds on Hebbs's 1949 learning rule which states that the connections between two neurons might be strengthened if the neurons fire simultaneously. The Hebbian Rule works well as long as all the input patterns are orthogonal or uncorrelated. The requirement of orthogonality places serious limitations on the Hebbian Learning Rule. A more powerful learning rule is the delta rule, which utilizes the discrepancy between the desired and actual output of each output unit to change the weights feeding into it.

2011

• (Sammut & Webb, 2011) ⇒ Claude Sammut, and Geoffrey I. Webb. (2011). “Hebb Rule.” In: (Sammut & Webb, 2011) p.493

2008

• (Caporale & Dan, 2008) ⇒ Natalia Caporale, and Yang Dan. (2008). “Spike Timing-dependent Plasticity: A Hebbian Learning Rule." Annu. Rev. Neurosci. 31
  • QUOTE: Spike timing–dependent plasticity (STDP) as a Hebbian synaptic learning rule has been demonstrated in various neural circuits over a wide spectrum of species, from insects to humans.

1949

• (Hebb, 1949) ⇒ D.O. Hebb. (1949). “The Organization of Behavior." New York: Wiley.

---