Recurrent Highway Neural Network Layer

A Recurrent Highway Neural Network Layer is a Neural Network Hidden Layer in a Recurrent Highway Neural Network.

• Example(s):
  • Zilly et al.(2017) RHN layer illustration:

     .

  • …
• Counter-Example(s):
  • a Neural Network Projection Layer,
  • a Neural Network Feature-Extraction Layer,
  • a Neural Network Classification Layer,
  • a Neural Network Convolution Layer,
  • a Neural Network Pooling Layer,
• See: Artificial Neural Network, Artificial Neuron, Fully-Connected Neural Network Layer, Neuron Activation Function, Neural Network Weight, Neural Network Connection, Neural Network Topology, Multi Hidden Layer NNet.

---

---

References

2017

• (Zilly et al., 2017) ⇒ Julian Georg Zilly, Rupesh Kumar Srivastava, Jan Koutník, and Jurgen Schmidhuber. (2017). “Recurrent Highway Networks.” In: Proceedings of the 34th International Conference on Machine Learning - Volume 70. arXiv:1607.03474

2015

• (Srivastava et al., 2015) ⇒ Rupesh Kumar Srivastava, Klaus Greff, and Jurgen Schmidhuber. (2015). “Training Very Deep Networks.” In: Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015.

---