I use those quotation marks because IMO they’re better described as large token models than large language models. They have rather good morphology and syntax, but once you look at the higher layers (semantics and specially pragmatics) they drop the ball really hard. Even if those layers are way more important than the lower ones.

For a rough analogy, it’s like a taxidermised cat - some layers (the skin and fur) are practically identical to the real thing, but it’s missing what makes a cat a cat, you know? It’s still useful if you want some creepy deco, but don’t expect the taxidermised critter to ruin your furniture or to use your belly as sleeping pad.