AISBF

AI Service Broker Framework — AI Should Be Free

AISBF tutorial

Run AISBF in a Cluster with CoderAI Broker Sessions

Use shared cache plus broker-aware CoderAI providers so requests can reach model workers connected to any AISBF node.

Provider list showing a CoderAI provider with online broker status and GPU metadata.

Architecture

client/app → AISBF node A → shared Redis broker queue → AISBF node B → model worker

Requirements

Shared MySQL config database.
Shared Redis cache for broker session metadata and queues.
Each node keeps a unique runtime node ID.
Reverse proxy/load balancer in front.

CoderAI provider shape

{"type":"coderai","endpoint":"http://127.0.0.1:11437","api_key_required":false,"coderai_config":{"transport":"broker","broker_enabled":true,"broker_mode":true,"broker_preferred":true,"client_id":"zeiss-nvidia","registration_path":"/coderai/register","bridge_path":"/coderai/ws"},"models":[]}

Try AISBF

AISBF is open source and also available as a hosted service. During the current testing period, hosted Pro is temporarily available as unlimited access for €2/month.

See the €2 Pro test plan View source code