Reproducible 8-dimension benchmark of 7 browser-automation MCP servers (Playwright, Lightpanda, browser-use, Chrome DevTools, Firecrawl, Cloakbrowser, Obscura) against frozen loopback fixtures. v1.0.2 adds cross-platform evidence + real Chrome TLS fingerprint baseline. v1.1 expands fixtures to general web tasks.
This repository also configures its own agents. See what web-agent-comparison tells them →
pleasedodisturb/web-agent-comparison
MCP server Claude CodeCodexCursor +2
One of 7 in .mcp.json
MCP server "playwright" as configured in pleasedodisturb/web-agent-comparison. Launched with playwright-mcp.
pleasedodisturb/web-agent-comparison
MCP server Claude CodeCodexCursor +2
One of 7 in .mcp.json
MCP server "browser-use" as configured in pleasedodisturb/web-agent-comparison. Launched with browser-use --mcp.
pleasedodisturb/web-agent-comparison
MCP server Claude CodeCodexCursor +2
One of 7 in .mcp.json
MCP server "chrome-devtools" as configured in pleasedodisturb/web-agent-comparison. Launched with chrome-devtools-mcp.
pleasedodisturb/web-agent-comparison
MCP server Claude CodeCodexCursor +2
One of 7 in .mcp.json
MCP server "lightpanda" as configured in pleasedodisturb/web-agent-comparison. Launched with lightpanda mcp.
pleasedodisturb/web-agent-comparison
MCP server Claude CodeCodexCursor +2
One of 7 in .mcp.json
MCP server "obscura" as configured in pleasedodisturb/web-agent-comparison. Launched with obscura-mcp.
pleasedodisturb/web-agent-comparison
MCP server Claude CodeCodexCursor +2
One of 7 in .mcp.json
MCP server "firecrawl" as configured in pleasedodisturb/web-agent-comparison. Launched with firecrawl-mcp.
pleasedodisturb/web-agent-comparison
MCP server Claude CodeCodexCursor +2
One of 7 in .mcp.json
MCP server "cloakbrowser" as configured in pleasedodisturb/web-agent-comparison. Launched with cloakbrowsermcp.
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: