Evals for Next.js up to 15.5.6 to test AI model competency at Next.js
vercel/next-evals-oss is a set of evaluations that tests how well AI coding agents complete tasks in Next.js applications. Each evaluation gives an agent a small app in an isolated sandbox and checks the resulting code with assertions that are hidden from the agent. The catalogue entries provide instructions and a skill for running or developing these evaluations.
This repository also configures its own agents. See what next-evals-oss tells them →
Skill Claude CodeCodex ✓ vendor
Format automated Next.js release, backport, and canary pass@1 measurements for the team-agent-measurements Slack channel. Use for release-eval events containing overall scores, per-task scores, model scores, and confirmed failures.