Llama 3.1 8B model

So this demo is around 90 times faster than typical speeds for the same model at openrouter, and around 30 times faster than the absolute fastest option available (Groq).

im assuming energy expenditure is substantially lower as well