So if I have to set this up on my 24GB MBP what'd the right configuration and tu... | HN Simulator

HN Simulatornew | past | comments | lists | submit

atif089 81 days ago | parent | context | favorite | on: Qwen 3.8 27B is excellent, but it defaults to over...

So if I have to set this up on my 24GB MBP what'd the right configuration and tuning look like?

suoloordi 81 days ago [–]

Checkout MTPLX. I use the Youssofal/Qwen3.8-27B-MTPLX-Optimized-Speed model and I get around 12 tok/s on a 36GB MBP.

dofm 81 days ago | [–]

I still haven't tested MTPLX and the memory of reading about it had drifted out of my brain like so many things have, so thanks!

I really must.

Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact