magnitudedev/magnitude

Open source inference server that runs the best local models for your hardware, plugged into the agent you already use. Works with Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline.

About the project

Magnitude is an open-source inference server, meaning software that runs language models and answers requests on a user's own computer. It profiles available hardware, recommends suitable local models, and connects them to coding agents for private and offline use on macOS, Linux, or Windows through WSL. Its catalogue entries help agents set up and use Magnitude.

This repository also configures its own agents. See what magnitude tells them →

3.8kStars on the repository
4Mods indexed here, across every type
todayLast push, which is what freshness is scored on
Apache-2.0Licence, which decides whether bodies are shown

magnitude

01

magnitudedev/magnitude

Skill Claude CodeCodex

Set up and operate Magnitude local inference through its CLI, recommend hardware-fit local models, monitor acquisition and loading, and connect an agent harness. Use for Magnitude service, model, catalog, setup, or harness requests.

not rated 3.8k +1.7k today A 48 tokens original Apache-2.0