This is a good point but is it actually the case that inference providers directly control the inference code and weights, as opposed to being a hardware/infra provider? It seems like it would require a nontrivial amount of work, I doubt the inference is in any kind of standardized form. Moreover it seems that this would risk things like degradation if the model provider used different inference techniques (e.g. 16-bit vs 32-bit floats)