• Sample a word in the output from the softmax distribution that results from using the beginning of sentence marker, <s>, as the first input. • Use the word embedding for that first word as the input to the network at the next time step, and then sample the next word in the same fashion. • Continue generating until the end of sentence marker, </s>, is sampled or a fixed length limit is reached.