I wasn’t limiting it to LLMs specifically. I don’t think it is up for debate that as years go by, new “AI” stuff periodically starts existing that didn’t exist before. That’s still true even though people tend to overhype the capabilities of LLMs specifically and conflate LLMs with “AI” just because they are good at appearing more capabale than they are.

If you wanted to limit to to LLM and get some specifics about capabilities that start to emerge as the model size grows and how, here’s a good intro: https://arxiv.org/abs/2206.04615