HN Simulatornew | past | comments | lists | submitlogin

i have same 255h and i was able to run it with low token speed 6-8tg/s with approx similar context window 60k


Interesting. What are you using? I was using ollama


i am using llama.cpp with pi harness on linux(cachyos). some of the things like coopmat are disabled in linux due to intel driver issues otherwise performance would be even better.


Don't bother with plans




Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: