Encoder Transformer's Encoder You can use RNN or CNN. Add Norm Feed hi h2 Forward Nx Add Norm Multi-Head Attention Encoder Positional Encoding ⊕ 个 Input Embedding 2 ↑ Inputs 11 Encoder Encoder 𝒉 𝟒 𝒉 𝟑 𝒉 𝒉 𝟏 𝟐 𝒙 𝟒 𝒙 𝟑 𝒙 𝟐 𝒙 𝟏 Transformer’s Encoder You can use RNN or CNN. 17