I dont have any unreasonable trust in software. I just understand that nothing LLM sphew out actually runs on either GPU or hardware that GPU plugged into.
Neither LLM weights aware of any of the code it runs on.
I'm sorry to prolong this thread, but what I mean is: networks are just software layers, the operational systems, the driver code, the firewalls, switches, the other server, the sandboxes, the TPM. That and all security policies we put on them. All software layers waiting to suffer a buffer overflow.