The technical deficit of such an operation would be staggering, and the curtain would soon fall on the fraud. However, our legal system is not prepared to find this activity fraudulent.
There are companies that want to do exactly this and set up an entire virtual c-suite with zero accountability. A company so constituted is patently not a person, but this is not a matter of settled law.
You know, it occurs to me… it might be interesting (and funny) to setup some kind of LLM hive mind consisting of agents assigned various asinine corporate roles (“you are hr bot”, “you are cto”, etc…). Feed random problems into it and see what it attempts to do.
Your trust in the big labs may be misplaced. What do they rent you? A black box that cannot be inspected.
If you actually start looking inspecting what the boxes do, it is a scary place. The Chinese models are open source open weights and are trained on lies. This much can be proven. But the frontier labs have made it impossible to determine the provenance of their models. They have been fed with copyrighted works, but good luck proving that your copyrighted work lives in their weights.
In short, the frontier labs are operating opaquely, and that's very good reason not to trust them.
reply