Understanding Transformers Part 18: Completing the Decoding Process

In the previous article , we generated the first output word from the transformer. So far, the translation is correct. However, the decoder does not stop until it produces an token . Feeding the Output Back into the Decoder Now, we take the translated word “vamos” and feed it back into a copy of the decoder’s embedding layer to continue the process. Just like before, we repeat the same steps: Get the word embeddings for vamos Add positional encoding Calculate self-attention values using the same