Skip to content

Choose the available models

Control which AI models are offered to your tenant's users, and which one is used by default.

Configuration: Tenant Admin → Models tab.

Concepts

Models are grouped by type:

  • Language models (LLMs) — used by assistants and conversations.
  • Embeddings — used to index files and knowledge bases. Only one embeddings model can be active at a time.
  • Image generation, Video generation, Audio transcription, Speech, Realtime — specialized models.

If no model is selected in a type, users have access to all available models of that type by default. Selecting models therefore has the effect of restricting the list.

Select the available models

  1. Models tab.
  2. Click Add a model. The panel lists all models available from the providers configured for your tenant (OpenAI, Anthropic, Google, Azure, etc.).
  3. Check the models to offer to users.
  4. To reorder — the order is reflected in users' model-selection menus — drag and drop the models in the list.
  5. Click Save in the action bar at the bottom.

To add a provider or a model that does not appear in the list, contact the Forra team.

Set the default model

The default model is used when a user (or an assistant) does not specify a model.

  1. In the list of selected LLMs, open a model's menu and click Set as default.
  2. The change applies immediately.

The default model cannot be removed until another model has been designated as the default.

Required capabilities

Selected LLMs must collectively cover certain capabilities that Forra requires for everything to work (for example: Tools, Reasoning, Code, Summarization).

If a required capability is no longer covered when saving, an error message indicates the missing capabilities. Add a model that covers the missing capability so you can save.

Change the embeddings model

The embeddings model is used to index files and knowledge bases. Changing this model after use breaks existing indexes: semantic searches over already-indexed knowledge bases will no longer work.

  • For a new tenant, choose the embeddings model before any use.
  • For an existing tenant, only change this model in coordination with the Forra team, who can schedule a reindex.

When you try to remove the active embeddings model, Forra shows an explicit warning to confirm.

Notes

  • Users will only see the checked models. If they do not see an expected model, check that it is in the selected list and that you did save.
  • To use your own API key for a provider (instead of Forra's shared key), see Use your own API keys.