Understanding Transformers Part 10: Final Step in Encoding

In the previous article , we explored the use of self-attention layers, now we will dive into the final step of encoding and start moving into decoders As the final step, we take the positional encoded values and add them to the self-attention values . These connections are called residual connections . They make it easier to train complex neural networks by allowing the self-attention layer to focus on learning relationships between words, without needing to preserve the original word embedding