What is local-llm-setup?

An interactive setup guide for connecting the local-llm plugin to AnythingLLM Desktop, an app for running and using language models locally. It asks for an AnythingLLM API key, saves it for the user, checks the connection, and can create a workspace.

Use it when first connecting the local LLM, fixing a failed connection, or configuring it again.

It removes the manual steps and uncertainty involved in configuring the local connection. It also reports whether setup succeeded or authentication failed.

local-llm-setup — Skill for Claude Code by Jerry0022/dotclaude

Install

Getting it into your agent

This one installs as part of its plugin. Adding the marketplace and installing the plugin brings it with everything else the plugin ships.

Claude Code

/plugin marketplace add Jerry0022/dotclaude

Claude Code

/plugin install local-llm

Made for: Claude Code.

Or install local-llm, the plugin that ships this one along with the rest of its 1 skill.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

README.md

[![agentmods](https://agentmods.dev/badge/skills/jerry0022/dotclaude/local-llm-setup/github.svg)](https://agentmods.dev/skills/jerry0022/dotclaude/local-llm-setup)

Your own site

<a href="https://agentmods.dev/skills/jerry0022/dotclaude/local-llm-setup"><img src="https://agentmods.dev/badge/skills/jerry0022/dotclaude/local-llm-setup/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

Your own site · 80×15

<a href="https://agentmods.dev/skills/jerry0022/dotclaude/local-llm-setup"><img src="https://agentmods.dev/badge/skills/jerry0022/dotclaude/local-llm-setup.svg" alt="Reviewed on agentmods" width="80" height="20"></a>

Per session 96 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.

When invoked 915 The whole file, excluding the scripts and references it only reads on demand.

Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.

Origin original No closer match found in the catalogue.

Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

Model	Per session	Once invoked
Fable 5.1	$0.00096	$0.00915
Opus 5.5	$0.00038	$0.00366
Sonnet 5.5	$0.00019	$0.00183
Haiku 4.5	$0.00010	$0.00092

Measured 2mo ago against content hash c8827852623c, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

local-llm-setup scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

plugins/local-llm/skills/local-llm-setup/SKILL.md · 74 lines

How it starts

The opening of the file, as written. The whole thing — 74 lines — stays where its author put it; the contents beside it link to each section on GitHub.

local-llm-setup

Guided flow to connect this plugin to a running AnythingLLM Desktop instance.

What this skill does

Confirms the user has installed AnythingLLM Desktop and generated an API key.
Asks the user to paste the API key.
Saves the key to ~/.claude/local-llm/config.json (user-global, outside any git repo).
Verifies the key against GET /api/v1/auth.
Auto-creates the claude-code workspace if missing.
Reports the resulting phase.

Step 1 — Precondition check

Before asking for the key, tell the user what they need:

AnythingLLM Desktop must be installed and running. If not yet installed: https://anythingllm.com/download After install:

Open AnythingLLM.

Settings → Developer API → Generate API Key.

Copy the key.

(Recommended) Configure the LLM provider to Ollama with Gemma 4 E4B:

HuggingFace page: https://huggingface.co/bartowski/google_gemma-4-E4B-it-GGUF

Ollama pull tag: hf.co/bartowski/google_gemma-4-e4b-it-gguf:bf16 (HuggingFace GGUF — supported by Ollama ≥ v0.3.13; pull via the AnythingLLM UI or ollama pull). If Ollama is not installed, AnythingLLM can download it during the provider setup. Any other model configured in AnythingLLM will also work — the plugin uses whatever the workspace is set to.

Step 2 — Ask for the key

Ask the user in chat (not via AskUserQuestion — the key is free-form text, not a multiple choice):

Paste your AnythingLLM API key here (or type cancel to abort).

Wait for the user's next message. If the response is cancel, stop and report that no changes were made.

Otherwise, treat the user's message as the API key. Do not echo the key back in chat.

Step 3 — Save and verify

Run the save-and-verify script, passing the key via argv:

node "${CLAUDE_PLUGIN_ROOT}/scripts/save-api-key.js" "<paste-the-key-here>"

The script writes to ~/.claude/local-llm/config.json and probes AnythingLLM. It prints a single-line JSON result to stdout with these shapes:

Read the full file on GitHub · 74 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

2mo ago First seen · 74 lines · 96 tokens per session scan A c8827852623c

Subscribe to this mod's changes

local-llm-setup is a skill published in the GitHub repository Jerry0022/dotclaude (6 stars, last pushed 11d ago), licensed MIT. It adds 96 tokens to every session and 915 once invoked, about $0.0004 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Data and AI

local-llm-setup next to 6 skills from other repositories
Mod	Type	Stars	Last push	Licence	Scan	Tokens	Works with
local-llm-setupJerry0022/dotclaude	Skill	6	11d ago	MIT	A	96	Claude Code
agent-platform-model-registrygoogle/skills	Skill	22k	yesterday	Apache-2.0	A	60	Claude Code, Codex
foundry-config-setupmicrosoft/agent-framework	Skill	15k	yesterday	MIT	A	65	Claude Code, Codex
google-cloud-solution-agentic-analytics-spark-knowledge-cataloggoogle/skills	Skill	22k	yesterday	Apache-2.0	A	132	Claude Code, Codex
training-checkwanshuiyin/Auto-claude-code-research-in-sleep	Skill	19k	3d ago	MIT	A	35	Claude Code
nemo-automodel-launcher-configNVIDIA/skills	Skill	3.9k	yesterday	Apache-2.0	A	30	Claude Code
finetuningmicrosoft/skills	Skill	3.2k	yesterday	MIT	A	132	Claude Code

local-llm-setup

Getting it into your agent

Wrote this? Show the measurements

What it costs to keep this loaded

Grade A, and why

Nothing flagged

How it starts

local-llm-setup

What this skill does

Step 1 — Precondition check

Step 2 — Ask for the key

Step 3 — Save and verify

What this file has done since we first saw it

local-llm-setup compared with skills from other repositories