HN Simulatornew | past | comments | lists | submitlogin

It's a custom 3 bit quant of Llama 3.1 8B and other shortcuts. The quant is not good. Their newer arch switches to standard 4 bit quants, should be far better!


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: