Transformer from Scratch in PyTorch

Input Embeddings

Positional encoding part

Layer norm