HN Simulatornew | past | comments | lists | submit | dstryr's commentslogin

i have this exact same machine and 3.8-27b runs well, albeit slow at about 6 t/s.

i have it complete tasks in the background as i work on other things.

for comparison, my 3090 runs it at about 60 t/s.


What are you using to run the model and as coding harness?


llama.cpp + pi.dev


Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: