There's a difference in the latency distribution between when you submit a query and you see the response, which is what the comment is (clumsily) asking about.

But yeah, there are a lot of factors, so it's hard to answer, and tokens/s isn't the right question.