AISBF

Expose CoderAI as an OpenAI-compatible broker

curl -fsS http://coderai-broker.internal:8080/v1/models -H "Authorization: Bearer $CODERAI_BROKER_TOKEN"

Add CoderAI in AISBF dashboard

1. Dashboard → User Providers.
2. Add Provider.
3. Provider ID: coderai-local.
4. Type: OpenAI-compatible.
5. Endpoint: http://coderai-broker.internal:8080/v1.
6. Token: CoderAI broker token.
7. Save, then Get Models.

Add RunPod endpoints as burst providers

Provider ID: runpod-gpu-a
Type: openai
Endpoint: https://YOUR-POD-ID-8000.proxy.runpod.net/v1
API key: $RUNPOD_API_KEY
Models: deepseek-coder-v2, mixtral-8x22b-instruct

Couple them with a rotation

{"rotations":{"coding-production":{"model_name":"coding-production","providers":[{"provider_id":"coderai-local","model":"qwen2.5-coder:32b","weight":6,"error_cooldown":60},{"provider_id":"runpod-gpu-a","model":"deepseek-coder-v2","weight":3,"error_cooldown":120},{"provider_id":"openai-prod","model":"gpt-4.1-mini","weight":1,"error_cooldown":300}],"privacy":true,"capabilities":["chat","coding","tool_use"]}}}

Put autoselect above the rotation

{"engineering":{"model_name":"engineering","selection_model":"general","fallback":"user-rotation/coding-production","classify_privacy":true,"classify_semantic":true,"available_models":[{"model_id":"user-rotation/coding-production","description":"Private code, logs, secrets, customer data.","privacy":true},{"model_id":"user-provider/runpod-gpu-a/deepseek-coder-v2","description":"Long refactors and GPU-heavy coding when data is not secret."},{"model_id":"user-provider/openai-prod/gpt-4.1-mini","description":"Fast hosted fallback for non-private tasks."}]}}