AISBF Logo AISBF

AI Service Broker Framework — AI Should Be Free

AISBF tutorial

Build Rotations and Autoselect Routes

Create stable routes for failover, then add autoselect rules so AISBF can pick the right route per workload.

Rotation configuration with multiple stable backend groups.
Rotation configuration with multiple stable backend groups.

Rotation first

Use rotations for reliability and quota distribution.

model: user-rotation/coding-fast
Autoselect configuration with task-oriented route names.
Autoselect configuration with task-oriented route names.

Then autoselect

available_models:
  - model_id: coding-fast
    description: low-latency coding fixes
  - model_id: coding-deep
    description: complex debugging and architecture

Call it

curl -X POST -H "Authorization: Bearer $AISBF_API_TOKEN" -H "Content-Type: application/json" \
  -d '{"model":"user-autoselect/coding","messages":[{"role":"user","content":"Fix this failing test."}]}' \
  "https://aisbf.cloud/api/u/$AISBF_USERNAME/chat/completions"

Try AISBF

AISBF is open source and also available as a hosted service. During the current testing period, hosted Pro is temporarily available as unlimited access for €2/month.