Bidirectional Transformer Encoder NNP MD VB DT NN Figure 11 .9 Sequence labeling for part-of-speech tagging with a bidirectional transformer encoder. The output vector for each input token is passed to a simple k-way classifier.