 likely closely tied to the context of chess commentary, specific dataset used, and sub-word vocabulary size of 8,000. However, the scheme of low top-p and high temperature may be equally useful in other contexts. I tried other schemes, including one I have just realized Google has tried, named <a href="https://arxiv.org/pdf/2001.09977.pdf">sample-and-rank (Adiwardana et al., 2020)</a>, but without their SSA metric, but did not get good results. There are likely much better ideas to come that will gradually