I think you are missing the "idle capacity" information. The GPUs are not running 24/7, there may be minutes of time in a day where there is not an active job running, the author simply located these inactive GPUs during the downtime and utilized it until another job was queued.
Yeah it's a bit ambiguous, but in any case I'd think simply using that idle capacity to generate tokens would be more valuable than finding a basically meaningless number.
Except customer demand doesn't follow the fixed supply of GPU compute that any company has, so they either a) rent compute on demand, b) sell their excess compute, c) let it sit idle and maybe an employee claims it.
