matrix

The user wants every route × every role tested. Roles config and route source from $ARGUMENTS or sensible defaults.

Preflight

1. playwright.config.ts exists.
2. Smoke specs from /e2e:crawl exist at tests/smoke/ — if not, ask the user to run /e2e:crawl first. The matrix builds on the route inventory; don't redo discovery here.
3. .auth/ is in .gitignore — verify, refuse to proceed if missing (auth artifacts must never be committed).

Determine roles

Look for e2e.config.json at the cwd root. If absent, ask the user for the role list and login credentials per role. Default scaffold:

{
  "baseURL": "http://localhost:3000",
  "roles": {
    "anon": null,
    "user": { "username": "[email protected]", "password": "..." },
    "admin": { "username": "[email protected]", "password": "..." }
  },
  "loginFlow": {
    "url": "/login",
    "usernameField": "Email",
    "passwordField": "Password",
    "submitButton": "Sign in"
  }
}

The anon role has null credentials — used for unauthenticated traffic. Never invent credentials. If the user hasn't provided them, ask.

Generate authenticated storageState (once per role)

For each non-anon role:

1. Write tests/auth/<role>.setup.ts — a setup spec that logs in and saves storageState to .auth/<role>.json:

import { test as setup } from '@playwright/test';
import config from '../../e2e.config.json';

const role = '<role>';
const file = `.auth/${role}.json`;

setup(`authenticate ${role}`, async ({ page }) => {
  const creds = config.roles[role];
  await page.goto(config.loginFlow.url);
  await page.getByLabel(config.loginFlow.usernameField).fill(creds.username);
  await page.getByLabel(config.loginFlow.passwordField).fill(creds.password);
  await page.getByRole('button', { name: config.loginFlow.submitButton }).click();
  await page.waitForURL((url) => !url.pathname.includes('/login'));
  await page.context().storageState({ path: file });
});

1. Add a setup project to playwright.config.ts that runs these before the matrix: