cli-anything-web:test

CLI-Anything-Web: Test Runner

Skills used: testing (Phase 3)

Read the methodology overview: @${CLAUDE_PLUGIN_ROOT}/HARNESS.md

Target: $ARGUMENTS

Process

This command invokes the testing skill for Phase 3.

1. Verify auth is working FIRST — this is mandatory before any E2E test:

   cli-web-<app> auth login              # playwright-cli (recommended)
   cli-web-<app> auth login --cookies-json <file>  # manual fallback
   cli-web-<app> auth status
   

   Auth status MUST show live validation succeeded. If it fails:

   • Ensure playwright-cli is available (npx @playwright/cli@latest --version)
   • Fix auth before running any tests
   • Do NOT proceed with "auth not configured" — that is a broken test

2. Locate test directory: <app>/agent-harness/cli_web/<app>/tests/

3. Run full test suite:

   cd <app>/agent-harness
   python -m pytest cli_web/<app>/tests/ -v --tb=short 2>&1
   

4. If installed, also run subprocess tests:

   CLI_WEB_FORCE_INSTALLED=1 python -m pytest cli_web/<app>/tests/ -v -s -k subprocess 2>&1
   

   After running, verify the subprocess backend was used:

   • Check output for [_resolve_cli] Using installed command: — this confirms the installed package is being tested, not the source fallback
   • If this line is absent, the installed CLI was not found in PATH

5. Parse test output: count passed, failed, skipped, errors

6. Generate TEST.md using the automated generator:

   python ${CLAUDE_PLUGIN_ROOT}/scripts/generate-test-docs.py full \
     <app>/agent-harness/cli_web/<app>/tests --app-name <app>
   

   This produces both Part 1 (test plan from AST) and Part 2 (results from pytest).

7. If failures exist, analyze and suggest fixes

See the testing skill for detailed testing patterns and the standards skill for quality checks.

TEST.md Format

# Test Results — cli-web-<app>

## Summary
- **Total**: X tests
- **Passed**: X
- **Failed**: X
- **Date**: YYYY-MM-DD

## Unit Tests (test_core.py)
<list of test results>

## E2E Tests (test_e2e.py)
<list of test results>

## CLI Subprocess Tests
<list of test results>