lsp-bench

lsp-bench is a plugin for Claude Code from asyncswap/skills. Its manifest loads nothing; the 12 skills it bundles cost 584 tokens per session together, scanned A, original, MIT.

A YAML-based tool for testing, validating, and measuring LSP servers, which provide editor features such as diagnostics and code navigation.

In plain words
What is it for?
Use it to create LSP benchmarks, assert responses, test file-edit sequences, compare versions, and measure cold or warm sessions.
Why use it?
It lets teams describe repeatable correctness and performance checks in configuration files, including tests for multiple files, edits, versions, and server startup.

Plugin for Claude Code

Written for Claude Code: a Claude Code plugin manifest.

Good fit Use it to create LSP benchmarks, assert responses, test file-edit sequences, compare versions, and measure cold or warm sessions.

Compare 6 plugins from other repositories ↓
Install in Claude Code
/plugin marketplace add asyncswap/skills
/plugin install lsp-bench
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Clone the repo
git clone --depth 1 https://github.com/asyncswap/skills

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for lsp-bench

README.md
[![agentmods](https://agentmods.dev/badge/plugins/asyncswap/skills/lsp-bench/github.svg)](https://agentmods.dev/plugins/asyncswap/skills/lsp-bench)
Your own site
<a href="https://agentmods.dev/plugins/asyncswap/skills/lsp-bench"><img src="https://agentmods.dev/badge/plugins/asyncswap/skills/lsp-bench/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for lsp-bench

Your own site · 80×15
<a href="https://agentmods.dev/plugins/asyncswap/skills/lsp-bench"><img src="https://agentmods.dev/badge/plugins/asyncswap/skills/lsp-bench.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session not measured What this adds to a session before it is invoked.
When invoked not measured The manifest loads nothing itself; its 12 skills cost 584 tokens a session between them.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Security

Grade A, and why

lsp-bench scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

plugins/lsp-bench/.claude-plugin/plugin.json · 23 lines

What it actually says

{
  "name": "lsp-bench",
  "version": "0.1.0",
  "description": "Test, validate, and benchmark performance of LSP servers using only YAML. Configs for benchmarks, response assertions, multi-file consistency checks, file-edit sequences, lifecycle tests, version comparisons, and LSP session management — restart per benchmark (cold) or reuse one initialized session across steps (warm).",
  "author": {
    "name": "Asyncswap Labs",
    "email": "[email protected]",
    "url": "https://github.com/asyncswap"
  },
  "homepage": "https://github.com/asyncswap/lsp-bench",
  "repository": "https://github.com/asyncswap/lsp-bench",
  "license": "MIT",
  "keywords": [
    "lsp",
    "language-server",
    "benchmark",
    "solidity",
    "performance",
    "regression",
    "correctness"
  ]
}
Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 1mo ago First seen · 23 lines scan A 23f0133f65c0

Subscribe to this mod's changes

lsp-bench is a plugin published in the GitHub repository asyncswap/skills (1 stars, last pushed 3d ago), licensed MIT. Its token cost is not measured: this kind of file is read by the harness, not the model. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other plugins, from other repositories

python-lsp

Claude Code plugin for Python development with Pyright LSP integration, 15 automated hooks for type checking, linting (ruff), formatting (black), testing (pytest), and security scanning.

zircote/python-lsp · not measured

crap-analyzer

Analyze recently-changed code for Change Risk Anti-Patterns. Computes CRAP per changed function across TypeScript, JavaScript, Python, Java, Kotlin, Go, Ruby, C#, Rust, and PHP. Auto-discovers how the repo generates coverage and proposes refactors + test stubs.

swingerman/engineer · not measured

fuse-react

Expert React 19 with hooks, TanStack Router, TanStack Form, Zustand, Testing Library, shadcn/ui, and SOLID principles.

fusengine/agents · not measured

dev-loop

Multi-agent orchestration grounded in an LLM wiki. /dev-loop:orchestrate splits one goal into a dependency graph of parallel Claude Code sessions, each in its own worktree, and supervises them natively on Orca (a tracked Task + Dispatch per phase, pushed workerdone / question / escalation events instead of polling, st.

choiyounggi/dev-loop · not measured

polygraph

A polygraph for your state machine. The agent does the hard part for you: it instruments your code, builds any test doubles needed to run it, and captures real execution traces — then has an LLM derive a transition-function spec from the source (default: a SAM v2 strict-profile module with named…

cognitive-fab/polygraph · not measured

superpowers-orchestrator

Agentic development framework for Claude Code — disciplined workflow routing, TDD enforcement, safety hooks, systematic debugging, and code review.

brunob54/superpowers-orchestrator · not measured