Use Toolport with Open WebUI
In Toolport: Settings → Integrations → Open WebUI / HTTP endpoint. Copy the URL (http://localhost:8765) and the token. From a terminal, toolport-gateway --http 8765 does the same with TOOLPORT_HTTP_TOKEN set.
Settings → Tools, add an OpenAPI tool server at http://localhost:8765, and paste the token as its API key. The toolport_* tools appear.
In the chat's Controls → Advanced Params, set Function Calling to Native. Default often never fires the tools.
Lazy discovery needs a model that can search, then call. Frontier APIs and strong local models in the 14B+ range handle it; a 7B tends to struggle.
Function Calling can reset to Default on each new chat, and setting it at the model level does not reliably carry over. If tools stop firing, set it in the chat again.
Open WebUI in Docker#
The gateway binds 127.0.0.1 by default. Set TOOLPORT_HTTP_HOST=0.0.0.0 and point the tool server at http://host.docker.internal:8765. Only expose a non-loopback bind on a trusted network.
Weaker local model?#
Set TOOLPORT_DISCOVERY=full with a small profile, so the model gets tools directly without a search step. See Discovery modes.