Personally this is a watershed moment for researchers and grad students I know. All of them are close sourcing WIP repos, not putting their progress in LLMs, or have lab level initiatives to self host models.
I am building a federated hosting platform that I plan to opensource for this exact reason for our company and similar users. I would love to talk to these teams (we are a small team at Duke and a health care company).
