Eric CarrollEricCarroll@cosocial.ca
Feb 21, 2024, 12:40 PMStephan Wolfram has the wonderful sentence “statistics of conventional wisdom” to describe #LLM trained on the Internet in a wonderful article everyone should read:
https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work
@pluralistic calls #LLM "plausible sentence generators".
Merge these two wonderfully clear explanatory sentences and you have the perfect description:
"Plausible conventional wisdom generators"
It captures the constraints of LLMs very nicely.