Skip to main content

AI Hub

Share models and agents with your organization. Show developers what's available without needing to rebuild them.

This feature is available in v1.74.3-stable and above.

Overview

Admin can select models/agents to expose on public AI hub → Users go to the public url and see what's available.

Models

How to use

1. Go to the Admin UI

Navigate to the Model Hub page in the Admin UI (PROXY_BASE_URL/ui/?login=success&page=model-hub-table)

2. Select the models you want to expose

Click on Select Models to Make Public and select the models you want to expose.

3. Confirm the changes

4. Success!

Go to the public url (PROXY_BASE_URL/ui/model_hub_table) and see available models.

API Endpoints

  • GET /public/model_hub – returns the list of public model groups. Requires a valid user API key.
  • GET /public/model_hub/info – returns metadata (docs title, version, useful links) for the public model hub.

Agents

info

Agents are only available in v1.79.4-stable and above.

Share pre-built agents (A2A spec) across your organization. Users can discover and use agents without rebuilding them.

Demo Video

1. Create an agent

Create an agent that follows the A2A spec.

2. Make agent public

Make the agent discoverable on the AI Hub.

Navigate to the Agents Tab on the AI Hub page

Select the agents you want to make public and click on Make Public button.

3. View public agents

Users can now discover the agent via the public endpoint.

MCP Servers

How to use

1. Add MCP Server

Go here for instructions: MCP Overview

2. Make MCP server public

Navigate to AI Hub page, and select the MCP tab (PROXY_BASE_URL/ui/?login=success&page=mcp-server-table)

3. View public MCP servers

Users can now discover the MCP server via the public endpoint (PROXY_BASE_URL/ui/model_hub_table)