I disagree, a compiler is a deterministic tool while LLMs are not, you can be 100% sure that if you write "if a>b then c" the compiler will produce exactly that same statement in machine code, with LLMs not so sure, maybe it will give you that, maybe it will give a different validation, maybe it will hallucinate and do something completely different, and the worst part is that if you run it again with the same prompt you'll get a different answer, how can you build a solid building if your can't be sure that your workers are just making shit up with confidence, even worse somethings the do fine so is a russian roulette
I mean you can never be sure your workers aren't just making shit up with confidence. Like, the humans who work for you. And yet somehow, we've built all this software.
How to produce systems that work reliably out of a collaboration of large group with one person at the head who ultimately has responsibility is more or less the study of most human endeavors, this does not seem like an insurmountable problem.