Then this whole comment thread was a diversion though, as it was specifically about the hardware parts and not model training.

Well, the entire context is Nvidia acquiring HF, which is very much in the "lab" side of things, so it's in my opinion slightly blurrier than that.

But it is a good example of people talking past one another and not communicating well, I would think.