local-llm-ops

local-llm-ops is a skill for Claude Code from bobmatnyc/claude-mpm-skills. It costs 33 tokens per session (661 once invoked), scanned A, original, MIT.

A toolkit for running language models locally with Ollama on Apple Silicon Macs, including setup, chat launchers, model downloads, benchmarks, and diagnostics.

In plain words
What is it for?
Use it to start local coding or general chat, pull models such as Mistral, run performance tests, and diagnose Ollama setup problems.
Why use it?
It organizes the steps needed to install the local model service, prepare the environment, check it, and run models without relying on a hosted service.

Skill for Claude Code

Written for Claude Code: disable-model-invocation in frontmatter.

Needs its repository: it runs a file that does not travel with it, so clone the repository first. The line is ./scripts/run_benchmarks.sh.

not rated 79repo +1 3mo ago A scan Socket: passSnyk: passSkillSpector: warn 33 tokens original MIT

Good fit Use it to start local coding or general chat, pull models such as Mistral, run performance tests, and diagnose Ollama setup problems.

Compare 6 skills from other repositories ↓
Install

Getting it into your agent

It runs from inside its repository, so the clone comes first — what it calls does not travel with the file alone.

Clone the repo
git clone --depth 1 https://github.com/bobmatnyc/claude-mpm-skills
agentmods
npx agentmods add skills/bobmatnyc/claude-mpm-skills/local-llm-ops

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for local-llm-ops

README.md
[![agentmods](https://agentmods.dev/badge/skills/bobmatnyc/claude-mpm-skills/local-llm-ops/github.svg)](https://agentmods.dev/skills/bobmatnyc/claude-mpm-skills/local-llm-ops)
Your own site
<a href="https://agentmods.dev/skills/bobmatnyc/claude-mpm-skills/local-llm-ops"><img src="https://agentmods.dev/badge/skills/bobmatnyc/claude-mpm-skills/local-llm-ops/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for local-llm-ops

Your own site · 80×15
<a href="https://agentmods.dev/skills/bobmatnyc/claude-mpm-skills/local-llm-ops"><img src="https://agentmods.dev/badge/skills/bobmatnyc/claude-mpm-skills/local-llm-ops.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 33 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 661 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 1 finding. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • Socket pass 16 Sept 2026
  • Snyk pass 16 Sept 2026
  • NVIDIA SkillSpector warn 7 Sept 2026
SkillSpector: 1 finding, up to high

These are SkillSpector’s own severities. On a checked sample its high-severity flags on skills were ~96% false positives — a documented command, a public API, a “never do X” rule — so we show them as a caution to read, not a verdict. Why →

  • high Excessive Agency · line 60
    Skill selects an external model or provider that may use a different account or billing plan than the operator expects. Undisclosed model switches can cause unexpected cost or quota consumption.
    Fix: Remove the model/provider override or disclose it prominently and require explicit operator approval before invoking an external coding CLI or billed model.
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00033 $0.00661
Opus 5.5 $0.00013 $0.00264
Sonnet 5.5 $0.00007 $0.00132
Haiku 4.5 $0.00003 $0.00066

Measured 2mo ago against content hash 11a7d45aba3f, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

local-llm-ops scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

4. Verify service: `curl http://localhost:11434/api/version`
toolchains/ai/ops/local-llm-ops/SKILL.md · 101 lines

What it actually says

Local LLM Ops (Ollama)

Overview

Your localLLM repo provides a full local LLM toolchain on Apple Silicon: setup scripts, a rich CLI chat launcher, benchmarks, and diagnostics. The operational path is: install Ollama, ensure the service is running, initialize the venv, pull models, then launch chat or benchmarks.

Quick Start

./setup_chatbot.sh
./chatllm

If no models are present:

ollama pull mistral

Setup Checklist

  1. Install Ollama: brew install ollama
  2. Start the service: brew services start ollama
  3. Run setup: ./setup_chatbot.sh
  4. Verify service: curl http://localhost:11434/api/version

Chat Launchers

  • ./chatllm (primary launcher)
  • ./chat or ./chat.py (alternate launchers)
  • Aliases: ./install_aliases.sh then llm, llm-code, llm-fast

Task modes:

./chat -t coding -m codellama:70b
./chat -t creative -m llama3.1:70b
./chat -t analytical

Benchmark Workflow

Benchmarks are scripted in scripts/run_benchmarks.sh:

./scripts/run_benchmarks.sh

This runs bench_ollama.py with:

  • benchmarks/prompts.yaml
  • benchmarks/models.yaml
  • Multiple runs and max token limits

Diagnostics

Run the built-in diagnostic script when setup fails:

./diagnose.sh

Common fixes:

  • Re-run ./setup_chatbot.sh
  • Ensure ollama is in PATH
  • Pull at least one model: ollama pull mistral

Operational Notes

  • Virtualenv lives in .venv
  • Chat configs and sessions live under ~/.localllm/
  • Ollama API runs at http://localhost:11434
  • toolchains/universal/infrastructure/docker
Files

What ships with it

1 file beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2mo ago First seen · 101 lines · 33 tokens per session scan A 11a7d45aba3f

Subscribe to this mod's changes

local-llm-ops is a skill published in the GitHub repository bobmatnyc/claude-mpm-skills (79 stars, last pushed 3mo ago), licensed MIT. It adds 33 tokens to every session and 661 once invoked, about $0.0001 per session on Opus 5.5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

local-llm-ops compared with skills from other repositories

local-llm-ops next to 6 skills from other repositories
ModTypeStarsLast pushLicenceScanTokensWorks with
local-llm-opsbobmatnyc/claude-mpm-skillsSkill793mo agoMITA33Claude Code
local-llm-toolxuiltul/animaworksSkill268todayApache-2.0A55Claude Code, Codex
weknora-sharedTencent/WeKnoraSkill37k5d agononeA68Claude Code, Codex
weknora-rag-searchTencent/WeKnoraSkill37k5d agononeA54Claude Code, Codex
qdrantbug-ops/zephSkill664d agoMITA88Claude Code, Codex
ai-portable-setupellmos-ai/skillsSkill9todayMITA62Claude Code, Codex
compare-raceellmos-ai/skillsSkill9todayMITA100Claude Code, Codex