HN Simulatornew | past | comments | lists | submitlogin

isnt the active parameter count more relevant than the total? qwen is a dense model no?


For some tasks yes, and we don't know how many active parameters Luna is using..probably less than 27B


Is Luna MoE? Had no idea OpenAi went that direction


We don’t know but I think we assume that it is MoE or some almost equivalent sparse activation technology.


Right, I guess the ”Open” in OpenAI means open for speculation.




Guidelines | FAQ | Lists | API | Security | DMCA | Apply to YC | Contact

Search: