Gating Mechanism

A Gating Mechanism is a Neural Network Memory Cell that is composed of a gated recurrent unit.

• Context:
  • It can be a layer in a Gated Recurrent Neural Network.
• Example(s):
  • a Gated Recurrent Unit (GRU),
  • …
• Counter-Example(s):
  • Attention Mechanism,
  • Coverage Mechanism.
• See: Memory-Augmented Neural Network (MANN), Internal Memory-based Neural Network.

---

---

References

2014a

• (Cho et al., 2014) ⇒ Kyunghyun Cho, Bart van Merrienboer, Dzmitry Bahdanau, and Yoshua Bengio. (2014). "On the Properties of Neural Machine Translation: Encoder-Decoder Approaches". In: Proceedings of Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation (SSST@EMNLP 2014). DOI:10.3115/v1/W14-4012

2014b

• (Chung et al., 2014) ⇒ Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. (2014). “Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling.” In: eprint arXiv:1412.3555.

---