Almost every day I see someone on Mastodon expressing the belief that LLMs work by "regurgitating their training data"*.
Besides this being provably false by just looking at the size of a model file vs what it then would contain, it's also a dated view. It could sort of be seen to have been true pre-2023, but not since.
For those actually interested in knowing what revolution happened (by accident!) that made models able to _understand_ this is a very good technical yet simplified enough video: https://www.youtube.com/watch?v=D8GOeCFFby4
*) Mostly they seem to have misunderstood Bender et. al's "stochastic parrots".