Nah, too cold. It stopped moving and the computer can’t generate any more random numbers to pick from the LLM’s weighted suggestions. Similarly, some LLMs have a setting called “heat”: too cold and the output is repetitive, unimaginative and overly copying input (like sentences written by first autocomplete suggestions), too hot and it is chaos: 98% nonsense, 1% repeat of input, 1% something useful.
Nah, too cold. It stopped moving and the computer can’t generate any more random numbers to pick from the LLM’s weighted suggestions. Similarly, some LLMs have a setting called “heat”: too cold and the output is repetitive, unimaginative and overly copying input (like sentences written by first autocomplete suggestions), too hot and it is chaos: 98% nonsense, 1% repeat of input, 1% something useful.