ost likely thing, and beam search tends to give quite degenerate output outside of short translation tasks. Intended more for generative models, <a href="https://arxiv.org/pdf/1805.04833.pdf">top-k sampling with temperature (Fan, Lewis &amp; Dauphin, 2018)</a> and <a href="https://arxiv.org/pdf/1904.09751.pdf">nucleus sampling (top-p) (Holtzman, Buys, Du, Forbes &amp; Choi, 2020)</a> achieve much higher quality writing, especially for longer passages. These techniques have found success in state-of-the-art 