https://tokenpony.dev/
It has a few potentially interesting side effects:
- enterprises can plug their preferred LLM into the SaaS they use.
- self hosters can extend their rigs into the web.
- simple SaaS products can offer LLM integrations without their entire pricing model being upended by LLM hosting and infrastructure.
- we can all live like Ender in Xenocide and have a personal AI that has context on everything we are doing.
- have a no op provider for people who are anti llm.
https://tokenpony.dev/
It has a few potentially interesting side effects:
- enterprises can plug their preferred LLM into the SaaS they use.
- self hosters can extend their rigs into the web.
- simple SaaS products can offer LLM integrations without their entire pricing model being upended by LLM hosting and infrastructure.
- we can all live like Ender in Xenocide and have a personal AI that has context on everything we are doing.
- have a no op provider for people who are anti llm.