Given these matrices we can compute all the requisite query-key comparisons simultaneously by multiplying Q and K in a single operation. Fig. 11 .3 illustrates the result of this operation for an input with length 5.