The more I think of it the less likely I think it is that "all code written via LLM" will happen at all.

I use LLMs to generate systems that interpret code that I use to express my wishes, but I don't think is would be desirable to express those wishes in natural language all of the time.