Transformer Block Stack
(Redirected from Stacked Transformer block)
Jump to navigation
Jump to search
A Transformer Block Stack is a stack of transformer blocks.
- Context:
- It can range from being an Encoder Transformer Block Stack to being a Decoder Transformer Block Stack.
- ...
- See: Stacked Encoders, Stacked Decoders.
References
2019
- https://jalammar.github.io/illustrated-transformer/
- QUOTE: ... The encoding component is a stack of encoders (the paper stacks six of them on top of each other – there’s nothing magical about the number six, one can definitely experiment with other arrangements). The decoding component is a stack of decoders of the same number. ...
- ... This goes for the sub-layers of the decoder as well. If we’re to think of a Transformer of 2 stacked encoders and decoders, it would look something like this:
- QUOTE: ... The encoding component is a stack of encoders (the paper stacks six of them on top of each other – there’s nothing magical about the number six, one can definitely experiment with other arrangements). The decoding component is a stack of decoders of the same number. ...