@jonny okay I have been reading your "goggling at LLM trainwreck" posts and thinking about this off and on for a while. I don't know a lot about programming but like. would it not be possible to make "coding assistant"-type things vastly better and more reliable by simply not coding them with LLMs, or even not coding them with LLMs as much
like, have the bones of the system be actual deterministic normal code that deals with sending things to the API, logging messages, sending code to a build/CI system or whatever, and the LLM is just used to "translate" machine-esque output into chatty natural language and vice versa. it still wouldn't be perfect but it would be a little more functional…right?
like i don't mean to Design A Better Torment Nexus but i feel like "a standard installation wizard/website template/etc. but the front end is a chatbot that walks you through it" could be actually useful for people who are scared of tech. IF it wasn't itself LLM spaghetti code.