Open source inference server that runs the best local models for your hardware, plugged into the agent you already use. Works with Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline.
About the project
Magnitude is an open-source inference server, meaning software that runs language models and answers requests on a user's own computer. It profiles available hardware, recommends suitable local models, and connects them to coding agents for private and offline use on macOS, Linux, or Windows through WSL. Its catalogue entries help agents set up and use Magnitude.
Set up and operate Magnitude local inference through its CLI, recommend hardware-fit local models, monitor acquisition and loading, and connect an agent harness. Use for Magnitude service, model, catalog, setup, or harness requests.