usually it’s just “small”. In current state, any model that range between 100B to 600B, but it used to be 27B a 2 years back ( Gemini-1 .5 I think )

Some interesting findings from the chat template designs:

1. The template name is Onyx ATEM as found in the tool call exception message

2. It appears to be following a harmony-style chat template. But the tool use seems to be a xml like : / /

3. atem: a internal joke of meta in reverse?

https://huggingface.co/meta-models/Muse-Glimmer-30B/blob/mai...

The XML tags are similar to , which is obviously Anthropic ML (or ANTrophic xML).

I think it’s likely 3; meta in reverse. While tokenisers and preprocessing can catch it, you want your special tokens to be unique and not present in the original corpus.

Likely inverted "meta" to avoid collision with HTMLs meta tags

> atem

also perhaps taking some small joy from the lexical similarity to aten[0] namespace that lies at the heart of pytorch

[0]: https://github.com/pytorch/pytorch/blob/main/aten/src/README...

atem also means breath in German