What CoderAI is
CoderAI is a multimodal and multi-backend local model orchestrator with an OpenAI-compatible API server. It runs models on local GPUs and supports NVIDIA CUDA, AMD Vulkan, Intel Vulkan, macOS Metal paths, plus CPU fallback where appropriate.
OpenAI-compatible API
Expose /v1/models, /v1/chat/completions, completions, embeddings, media generation, and generated file routes from your own machine.
Browser generation UI
Use the Web Studio and admin UI for chat, image, video, audio, pipelines, archives, models, settings, users, and tokens.
Broker worker mode
CoderAI can connect outward to AISBF over WSS, register capabilities and hardware, then receive routed work without opening inbound firewall ports.
Documentation map
CoderAI does not require AISBF
CoderAI can run standalone with its own browser UI and OpenAI-compatible API. AISBF is an optional routing, metering, clustering, and provider-management layer when you want to sell or share CoderAI capacity through a broker.
Install CoderAI standalone →
Use the CoderAI API directly →
AISBF and CoderAI tutorials →
Optional AISBF broker tutorial →
Download the Docker install bundle
coderai-docker-dist.tar contains install.sh, the coderai-docker runner, coderai-dist.tar.gz Docker image, and README files — everything needed to load and run the all-in-one CoderAI container.
Install and run
Build scripts, platform support, default ports, admin login, config files, package outputs, and driver expectations.
API reference
Base URL, authentication, OpenAI-style text routes, image/video/audio endpoints, archives, profiles, and pipelines.
Multimodal capabilities
Text, image, video, audio, 2D/3D, profiles, pipelines, model capability badges, common workflows, and bundled tools such as the video editor, VideoGen Studio, and Township Fighters demo.
Demo/example tools
CoderAI ships three demo apps under tools/: video_editor.py for timeline editing, videogen.py for profile-driven short movies, and gen_township_fighters.py for an MMA-style generated video workflow.
AISBF broker integration
Provider identity, user/global scopes, WebSocket endpoints, registration envelopes, heartbeats, and routing gotchas.
Operations
Frontend/engine split, multi-engine routing, VRAM/RAM offload, queues, thermal protection, tokens, archives, and troubleshooting.
Docker / OCI image
Build or run the provided OCI image with coderai-docker, persistent volumes, GPU modes, external storage, logs, AISBF broker config, and bundled tool routes /editor/, /videogen/, and /township/.
Reverse proxy
nginx root/subdomain and sub-path configurations, large upload settings, SSE streaming, and forwarded headers.
AISBF