1. An encoder that accepts an input sequence, x n 1 , and generates a corresponding sequence of contextualized representations, h n 1 . LSTMs, GRUs, convolutional networks, and Transformers can all be employed as encoders. 2. A context vector, c, which is a function of h n 1 , and conveys the essence of the input to the decoder.