Rotation vs Autoselect: AISBF Routing Concepts

AISBF concepts

Rotation vs Autoselect: AISBF Routing Concepts

Detailed routing tutorial explaining providers, rotations, autoselect policy, weighted failover, privacy classification, and step-by-step route construction.

Start Free More tutorials

The mental model

AISBF has three routing layers. Keep them separate or the system gets messy in six months.

Provider = a wire

One backend endpoint plus credentials and model names.

Rotation = reliability

A weighted pool of equivalent model candidates for failover, quota spreading, and cooldown after errors.

Autoselect = policy

A semantic decision layer for private/local, cheap/fast, deep/GPU, or hosted fallback routes.

Build the route step by step

Create direct providers first

Dashboard → User Providers: create stable IDs like coderai-local, runpod-gpu-a, and openai-prod. Test model listing before building rotations.

Create a rotation for equivalent capacity

{"rotations":{"coding-production":{"model_name":"coding-production","providers":[{"provider_id":"coderai-local","model":"qwen2.5-coder:32b","weight":6,"error_cooldown":60},{"provider_id":"runpod-gpu-a","model":"deepseek-coder-v2","weight":3,"error_cooldown":120},{"provider_id":"openai-prod","model":"gpt-4.1-mini","weight":1,"error_cooldown":300}],"privacy":true,"capabilities":["chat","coding","tool_use"]}}}

Create autoselect on top

{"engineering":{"model_name":"engineering","selection_model":"general","fallback":"user-rotation/coding-production","classify_privacy":true,"classify_semantic":true,"available_models":[{"model_id":"user-rotation/coding-production","description":"Private code, logs, secrets, customer data.","privacy":true},{"model_id":"user-provider/runpod-gpu-a/deepseek-coder-v2","description":"Long refactors and GPU-heavy coding when data is not secret."},{"model_id":"user-provider/openai-prod/gpt-4.1-mini","description":"Fast hosted fallback for non-private tasks."}]}}

Call only the policy route from applications

curl -X POST "https://aisbf.cloud/api/u/$AISBF_USERNAME/chat/completions" -H "Authorization: Bearer $AISBF_API_TOKEN" -H "Content-Type: application/json" -d '{"model":"user-autoselect/engineering","messages":[{"role":"user","content":"Fix this failing private test."}]}'

Debugging route choices

If a provider fails three times, cooldown prevents it from poisoning every request.
If a route chooses hosted when it should choose local, tighten the autoselect description and enable privacy classification.
If RunPod cold starts hurt latency, reduce its weight or make autoselect choose it only for deep/long-context tasks.

Try AISBF

AISBF is open source and also available as a hosted service. During the current testing period, hosted Pro is temporarily available as unlimited access for €2/month.

See the €2 Pro test plan View source code