AISBF Logo AISBF

AI Service Broker Framework — AI Should Be Free

CoderAI documentation · source-backed from Nexlab/coderai

CoderAI Documentation

Complete documentation area for CoderAI: installation, Docker / OCI deployment, bundled tool apps, API routes, multimodal workflows, AISBF broker mode, operations, and reverse proxy deployment.

What CoderAI is

CoderAI is a multimodal and multi-backend local model orchestrator with an OpenAI-compatible API server. It runs models on local GPUs and supports NVIDIA CUDA, AMD Vulkan, Intel Vulkan, macOS Metal paths, plus CPU fallback where appropriate.

Local server

OpenAI-compatible API

Expose /v1/models, /v1/chat/completions, completions, embeddings, media generation, and generated file routes from your own machine.

Studio

Browser generation UI

Use the Web Studio and admin UI for chat, image, video, audio, pipelines, archives, models, settings, users, and tokens.

AISBF-ready

Broker worker mode

CoderAI can connect outward to AISBF over WSS, register capabilities and hardware, then receive routed work without opening inbound firewall ports.

Documentation map

CoderAI does not require AISBF

CoderAI can run standalone with its own browser UI and OpenAI-compatible API. AISBF is an optional routing, metering, clustering, and provider-management layer when you want to sell or share CoderAI capacity through a broker.

Install CoderAI standalone →
Use the CoderAI API directly →
AISBF and CoderAI tutorials →
Optional AISBF broker tutorial →

Download the Docker install bundle

coderai-docker-dist.tar contains install.sh, the coderai-docker runner, coderai-dist.tar.gz Docker image, and README files — everything needed to load and run the all-in-one CoderAI container.

Install and run

Build scripts, platform support, default ports, admin login, config files, package outputs, and driver expectations.

API reference

Base URL, authentication, OpenAI-style text routes, image/video/audio endpoints, archives, profiles, and pipelines.

Multimodal capabilities

Text, image, video, audio, 2D/3D, profiles, pipelines, model capability badges, common workflows, and bundled tools such as the video editor, VideoGen Studio, and Township Fighters demo.

Demo/example tools

CoderAI ships three demo apps under tools/: video_editor.py for timeline editing, videogen.py for profile-driven short movies, and gen_township_fighters.py for an MMA-style generated video workflow.

AISBF broker integration

Provider identity, user/global scopes, WebSocket endpoints, registration envelopes, heartbeats, and routing gotchas.

Operations

Frontend/engine split, multi-engine routing, VRAM/RAM offload, queues, thermal protection, tokens, archives, and troubleshooting.

Docker / OCI image

Build or run the provided OCI image with coderai-docker, persistent volumes, GPU modes, external storage, logs, AISBF broker config, and bundled tool routes /editor/, /videogen/, and /township/.

Reverse proxy

nginx root/subdomain and sub-path configurations, large upload settings, SSE streaming, and forwarded headers.