Are there any fundamental critiques of GUIs, in general/fundamentally and in practice?

This isn’t a tech bro “everyone should use CLIs” thing. I’m wondering if the trade offs, whatever they are, have been thought through.

One thing I’ve noticed recently is that speaking about GUIs is basically broken. It always seems to devolve into meaningless “No, the other thingy that’s purple, three to the left, then open the menu from the side, then …”. Ie, the collaborative aspect seems forgotten. And amidst the design process, it also seems forgotten that everyone ends up developing their own mental model for how the interface works.

And whatever you think about CLIs, I’m wondering if they can be an illustrative counterexample. They kinda use natural language, depending. You can literally speak what to do. Or record it verbatim in a document. And the essential interface is very simple: command > effect, … .

Is there a theory of all this?