unlimited-mcp-selftest

Skill: unlimited-mcp-selftest

Claude-Code wrapper that executes the project's regression battery and returns a single pass/fail report. The canonical test definitions live in AGENTS.md → "Regression suite"; this file only adds the execution flow.

Abort as soon as any tier fails — do not proceed to the next one.

Safety rule: never use the user's repos as test targets. All coding agent tests (B2, B4, B6b) use throwaway git repos created in /tmp and deleted immediately after.

---

Preparation (before Tier B)

Create two throwaway git repos — one local, one on the remote:

# local throwaway repo
mkdir -p /tmp/umcp-selftest
cd /tmp/umcp-selftest
git init
echo 'def hello():\n    pass' > hello.py
git add hello.py
git commit -m "init"

# remote throwaway repo (via run_command on mcp_localhost)
run_command(["git", "init", "/tmp/umcp-selftest"], exec_host="mcp_localhost")
run_command(["git", "-C", "/tmp/umcp-selftest", "commit", "--allow-empty", "-m", "init"],
            exec_host="mcp_localhost")
# write hello.py on remote via a small echo chain or sftp

Also: add_allowed_root("/tmp/umcp-selftest") so the agent can access it.

---

Flow

0. Tier 0 — Lint & types (headless, always)

Run from the unlimited-mcp repo root (not the throwaway repo):

uv run ruff check src tests
uv run ruff format --check src tests
uv run mypy

All green → continue. Any failure → stop, report output.

1. Tier A — Automated (always)

uv run pytest tests/integration/test_smoke.py -q

All green → continue. Any failure → stop, report failing test + assertion.

2. Tier B — Live end-to-end

B1 — Sysops remote

r = run_command(["echo", "b-remote"], exec_host="mcp_localhost")
r = await_job(r["job_id"])

Pass: status == "completed" and stdout contains b-remote.

B2 — Agent local + worktree (uses /tmp/umcp-selftest)

r = delegate_to_agent(
    "opencode_flash",
    prompt='Add a one-line docstring to the hello() function in hello.py. Only change that file.',
    cwd="/tmp/umcp-selftest",
    workspace="safe_dev",
    timeout_seconds=180,
)
r = await_job(r["job_id"])

Pass: status == "completed", branch non-null, changed_files non-empty.