The code currently supports Anthropic, OpenAI, Gemini, Workers AI, and ollama as AI providers.
It additionally optionally supports sending all requests through Cloudflare AI Gateway as a proxy. The same set of providers is supported either way, but when you configure AI Gateway, we assume you intend to install side-wide API keys into the gateway. The idea here is that you're setting up the gateway for your entire company, and you want all users to use the same keys. So we no longer let individual users configure their own keys in this mode -- instead they can choose from among the providers you have configured site-wide.
I can't get an AI Gateway custom provider to work within CFOS (deployed to my CF account). No matter what custom model path I use in the cfos admin add provider mechanism, I get a model not found error when attempting to use the model in a conversation...
How does the cloudflare-based deployment of cfos get updated? If I "redeploy" will it get updates from cfos upstream? Eg, for when you add new stuff like this upstream..
It additionally optionally supports sending all requests through Cloudflare AI Gateway as a proxy. The same set of providers is supported either way, but when you configure AI Gateway, we assume you intend to install side-wide API keys into the gateway. The idea here is that you're setting up the gateway for your entire company, and you want all users to use the same keys. So we no longer let individual users configure their own keys in this mode -- instead they can choose from among the providers you have configured site-wide.
We will expand the provider list soon.