In the comments it reads like bonsei falls apart on longer running tasks.

Not really. The largest IQ4_XS quant here is still worth it because Bonsai doesn't offer larger quants. They could beat it if they made a quaternary variant though, I don't know why they're stopping at ternary.

I wonder the same thing for Bonsai 2. ByteShape offers 5 models from IQ2_XXS-2.56bpw (8.8GB), IQ3_XXS-2.88bpw (9.9GB), IQ3_XS-3.01bpw (10.4GB), IQ3_S-3.23bpw (11.0GB) to IQ4_XS-3.84bpw (13.1GB). Their benchmarks show gradual improvement with size and users can pick one to fit theirs need. Bonsai-2-27B now is about 8.6GB. It might be good to have a quaternary version around 10-11GB to fit a computer with 16-24GB RAM.

Agree here, as it is ByteShape wins practicality wise if the goal is doing actual work with these quants!

prismml's title is very misleading. in their own paper the model is at 75% of coding scores.

As said in the article, all of the providers run different runtimes with proprietary, sometimes untested and weird optimisations

There are multiple types of quantisation: weights and KV Cache. Quantizing kv cache can drastically hurt performance

Disclaimer: I'm using reduced motion on my phone, please acknowledge this bias before reading my comment

All of those, citing the pricing page, "websites people remember" look the same and use the same handful of effects

- Fade in on scroll - Big letters - Punishment of firefox users - Fullscreen imagery - Cursor replacement - Annoying takeover of browser scrolling

Of course you would be impressed if you see something like this the first time. If every third company has websites like this, it gets annoying. I don't remember any of them

They look cool on twitter, how they perform independently of it?

I miss "boring" landings. Pretty ones, not wordpress or wix slop, not "beautiful, that's hard to forget. Make no mistakes" ahem...

Look at https://vercel.com/ , https://linear.app/ , https://notion.com , https://apple.com . They're simple, easy to quickly parse, don't take over your browser's decade old predictable patterns

They're pretty. But simple.