Observability

Observe and proxy LLM requests and responses.

Choose an observability provider

Choose one of the following providers in Settings > Extensions > Observability:

• Cloudflare AI Gateway

Cloudflare AI Gateway

Create an AI gateway in Cloudflare: Cloudflare Dashboard > AI > AI Gateway > Create Gateway.

Configure it in ChatWise settings:

You can find out your Cloudflare account ID by going to the Cloudflare dashboard https://dash.cloudflare.com/ and you'll be redirect to https://dash.cloudflare.com/{YOUR_ACCOUNT_ID}

Now supported providers will display the observability status:

WARNING

Make sure the API Base URL for respective provider is empty, otherwise observability will not be enabled.

API Keys

You can store the API keys for respective providers in the Provider Keys feature of Cloudflare AI Gateway, so you don't need to manually input the API keys in ChatWise. If you also input the API keys in ChatWise, the API keys stored in Cloudflare AI Gateway will not be used.

Known issues

• Cloudflare AI Gateway + Google AI Studio doesn't support streaming, issue
• Cloudflare AI Gateway + Google AI Studio will respond with an error when storing API keys in Provider Keys, issue