As usual a critic of novel tech gets some things right and some things wrong, but overall not bad. Trying to build a critic of LLMs where your understanding is based on a cartoon representation skipping the technical details about what is novel about the approach and only judging based on how commercial products are using it can be an overly narrow lens to what it can be, but isn’t too far off from what it is.

I suspect LLMs or something like them will be a part of something approaching AGI, and the good part is once the tech exists you don’t have to reinvent it and can test it’s boundaries and how it would integrate with other systems, but if that is 1%, 5%, or 80% of an overall solution is unknown.