LangBot is an open-source platform for connecting language models to instant-messaging services so developers can build chatbots that converse, use tools, and execute tasks. It supports bot management, knowledge bases, plugins, and multiple chat platforms, and the catalogue entries provide skills, MCP tools, and instructions for working with it.
Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx skills add langbot-app/LangBot --skill langbot-testinggit clone --depth 1 https://github.com/langbot-app/LangBotWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/langbot-app/langbot/langbot-testing)<a href="https://agentmods.dev/skills/langbot-app/langbot/langbot-testing"><img src="https://agentmods.dev/badge/skills/langbot-app/langbot/langbot-testing/github.svg" alt="Measured on agentmods" height="20"></a>Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.
<a href="https://agentmods.dev/skills/langbot-app/langbot/langbot-testing"><img src="https://agentmods.dev/badge/skills/langbot-app/langbot/langbot-testing.svg" alt="Reviewed on agentmods" width="80" height="20"></a>- NVIDIA SkillSpector pass
What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.00058 | $0.00923 |
| Opus 5.5 | $0.00023 | $0.00369 |
| Sonnet 5.5 | $0.00012 | $0.00185 |
| Haiku 4.5 | $0.00006 | $0.00092 |
Grade A, and why
langbot-testing scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 23d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
How it starts
The opening of the file, as written. The whole thing — 46 lines — stays where its author put it; the contents beside it link to each section on GitHub.
LangBot Testing
Use this skill when an agent needs to verify LangBot behavior through the WebUI instead of only reading code.
Routing
- General WebUI testing: read
references/web-ui-testing.md. - Pipeline Debug Chat: read
references/pipeline-debug-chat.md. - Dify Runner: read
references/dify-agent-runner.md. - Model provider setup or test button: read
references/model-provider-testing.md. - Plugin install/runtime/tool/page smoke: read
references/plugin-e2e-smoke.md. - Local Runner: read
references/local-agent-runner.md. - Local Runner path coverage: read
references/local-agent-runner-coverage.md. - Diff-aware Runner QA after code changes: read
references/agent-runner-qa-workflow.md. - Runner release gate: read
references/agent-runner-release-gate.md. - Sandbox-backed skill authoring: read
references/sandbox-skill-authoring.md. - LangRAG knowledge bases: read
references/langrag-knowledge-base.md. - MCP stdio tool testing: read
references/mcp-stdio-testing.md. - Performance, reliability, or chaos probes: read
references/performance-reliability-testing.md. - Cross-repository workspace and release gates: read
references/workspace-release-testing.md. - Drive a live instance over MCP (not raw HTTP): use the
langbot-mcp-opsskill — the instance exposes an MCP server athttp://<host>:5300/mcp(reuses API keys). Useful for setting up bots/pipelines/models as test fixtures programmatically. - Known failures and fixes: read
references/troubleshooting.md. - Reusable test groups: run
bin/lbs suite listandbin/lbs suite plan <suite-id>before manually assembling a case set.
Rules
- Read
../.envfirst and useLANGBOT_FRONTEND_URLandLANGBOT_BACKEND_URLinstead of hardcoded ports. - If a standalone frontend dev server is running,
LANGBOT_FRONTEND_URLmay point toLANGBOT_DEV_FRONTEND_URL; otherwise it may point to the backend WebUI. - Confirm the backend and frontend are actually running before testing.
- Run
bin/lbs fixture checkbefore fixture-heavy MCP, RAG, multimodal, or plugin smoke tests. - For runner externalization release checks, run
bin/lbs test run agent-runner-release-preflightbefore the fullagent-runner-release-gatesuite so configuration blockers are separated from product failures. - Read
Manual Readinessinbin/lbs test plan <case-id>;manual_checkmeans the declared preconditions or setup still need operator confirmation for this run. - Use an authenticated browser profile prepared by
langbot-env-setup. - Do not expose API keys, OAuth secrets, tokens, or localStorage token values in output.
- A WebUI test is not complete until the visible UI result is checked against backend logs or network behavior.
- A performance result is not complete without
metricsevidence and a clear split between LangBot overhead and external provider/tool/network time. - A chaos or reliability result is not complete until the fault scope, cleanup, and recovery checks are recorded.
- For a suite, use
bin/lbs suite start <suite-id>to create the suite evidence root, per-case directories, andsuite-start.json/suite-start.mdhandoff files; usebin/lbs test result <case-id>to write final per-caseresult.json, then runbin/lbs suite report <suite-id> --evidence-dir <dir>. - Do not mark a case
passuntiltest result --evidencecovers every value in the case'sevidence_required. - For runner-specific Debug Chat cases, use the case-specific pipeline env declared by
automation_pipeline_url_env/automation_pipeline_name_env; do not silently reuse a genericLANGBOT_PIPELINE_URL.
What ships with it
60 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.
- cases/acp-agent-runner-debug-chat.yaml 3.1 KB
- cases/agent-run-ledger-audit.yaml 2.1 KB
- cases/agent-runner-async-db-readiness.yaml 1.2 KB
- cases/agent-runner-behavior-matrix.yaml 1.1 KB
- cases/agent-runner-fixture-contract.yaml 1.2 KB
- cases/agent-runner-health-visibility.yaml 2.0 KB
- cases/agent-runner-ledger-concurrency.yaml 1.6 KB
- cases/agent-runner-ledger-contention.yaml 1.1 KB
- cases/agent-runner-ledger-invariants.yaml 1.3 KB
- cases/agent-runner-ledger-stress.yaml 1.0 KB
- cases/agent-runner-live-install.yaml 1.7 KB
- cases/agent-runner-qa-debug-chat.yaml 2.3 KB
- cases/agent-runner-release-preflight.yaml 3.5 KB
- cases/agent-runner-runtime-chaos.yaml 1.5 KB
- cases/bot-event-routing-product-flow.yaml 2.9 KB
- cases/box-mcp-heartbeat-recovery.yaml 4.2 KB
- cases/claude-code-agent-debug-chat.yaml 3.6 KB
- cases/codex-agent-debug-chat.yaml 3.3 KB
- cases/dify-agent-debug-chat.yaml 2.1 KB
- cases/langbot-fake-provider-debug-chat-cross-pipeline-isolation.yaml 3.8 KB
- cases/langbot-fake-provider-debug-chat-fault-recovery.yaml 4.4 KB
- cases/langbot-fake-provider-debug-chat-load.yaml 3.4 KB
- cases/langbot-fake-provider-debug-chat-slow-load.yaml 3.7 KB
- cases/langbot-fault-taxonomy-contract.yaml 1.5 KB
- cases/langbot-live-backend-latency.yaml 1.6 KB
- cases/langbot-live-backend-log-health.yaml 2.0 KB
- cases/langbot-live-control-plane-api.yaml 2.0 KB
- cases/langbot-overhead-accounting-contract.yaml 1.7 KB
- cases/langbot-space-debug-chat-concurrency-smoke.yaml 3.4 KB
- cases/langrag-kb-retrieve.yaml 2.2 KB
- cases/langrag-parser-golden-e2e.yaml 3.5 KB
- cases/langrag-sentinel-kb-discover.yaml 1.4 KB
- cases/local-agent-basic-debug-chat.yaml 2.6 KB
- cases/local-agent-combo-rag-compaction-tool-debug-chat.yaml 7.4 KB
- cases/local-agent-complex-coding-task-debug-chat.yaml 5.4 KB
- cases/local-agent-context-compaction-debug-chat.yaml 7.7 KB
- cases/local-agent-effective-prompt-debug-chat.yaml 3.0 KB
- cases/local-agent-model-fallback-before-first-chunk-debug-chat.yaml 3.5 KB
- cases/local-agent-multimodal-debug-chat.yaml 3.0 KB
- cases/local-agent-multitool-rag-compaction-debug-chat.yaml 7.2 KB
- cases/local-agent-nonstreaming-debug-chat.yaml 2.5 KB
- cases/local-agent-parallel-tools-rag-compaction-debug-chat.yaml 7.4 KB
- cases/local-agent-plugin-tool-call-debug-chat.yaml 3.6 KB
- cases/local-agent-rag-debug-chat.yaml 3.6 KB
- cases/local-agent-rag-multimodal-debug-chat.yaml 3.1 KB
- cases/local-agent-steering-debug-chat.yaml 3.7 KB
- cases/local-agent-streaming-post-commit-failure-debug-chat.yaml 3.9 KB
- cases/local-agent-tool-error-recovery-debug-chat.yaml 4.4 KB
- cases/local-agent-tool-loop-limit-debug-chat.yaml 4.2 KB
- cases/mcp-stdio-register.yaml 2.4 KB
- cases/mcp-stdio-tool-call.yaml 4.8 KB
- cases/pipeline-debug-chat-performance.yaml 2.9 KB
- cases/pipeline-debug-chat.yaml 2.2 KB
- cases/plugin-e2e-smoke.yaml 2.9 KB
- cases/provider-deepseek.yaml 1.5 KB
- cases/qa-plugin-smoke-live-install.yaml 1.7 KB
- cases/sandbox-skill-authoring-e2e.yaml 2.4 KB
- cases/sandbox-skill-authoring-edit-existing-e2e.yaml 6.3 KB
- cases/skill-discovery-via-mcp-gateway.yaml 3.0 KB
- cases/webui-login-state.yaml 1.3 KB
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 23d ago Changed · +1 lines d5567b5006de
- 1mo ago First seen · 45 lines · 58 tokens per session scan A becdd878b0ee
langbot-testing is a skill published in the GitHub repository langbot-app/LangBot (18,213 stars, last pushed today), licensed Apache-2.0. It adds 58 tokens to every session and 923 once invoked, about $0.0002 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.
Other skills, from other repositories
web-gui-tester
Use the browser automation tooling available in the session to test web frontends interactively in a purely GUI-based, black-box manner: simulate real user clicks, text input, scrolling, and other actions; use screenshots for visual verification and read-only DOM inspection for cross-validation; and produce a final…
web-ui-test
Test the IronClaw web UI using the Claude for Chrome browser extension.
webqa
Use WebQA to test websites, web pages, URLs, login flows, search flows, forms, navigation, and core user journeys with an AI browser QA agent.
using-win
Use when invoking win-device MCP tools to drive a Windows test machine (agent-fleet project) -- screenshot-and-click UI testing, long-running shell commands, file or process operations, or coordinating exclusive device use across multiple agents.
webapp-testing
Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing browser screenshots, and viewing browser logs.
browser-testing-with-devtools
Tests in real browsers. Use when building or debugging anything that runs in a browser. Use when you need to inspect the DOM, capture console errors, analyze network requests, profile performance, or verify visual output with real runtime data via Chrome DevTools MCP.