Instructions for KevinRabun/judges, covering adding a new judge — step-by-step, 0. create/update agent file (agents/ .judge.md), 1. create the evaluator, 2. create the judge definition (with self-registration) and 3. add the side-effect import.
Instructions for KevinRabun/judges, covering release & deployment — agent instructions, files that need version updates, changelogs that need updating, 1. root changelog.md and fixed.
Instructions for KevinRabun/judges, covering vs code extension debugging — agent instructions, step 1: get the runtime error (always do this first), step 2: classify the error, step 3: validate the manifest against official docs and step 4: fix, rebuild, and verify locally.
Evaluates API endpoint implementations for contract conformance: input validation, proper status codes, error handling, rate limiting, versioning, and content-type management.
Evaluates API design for RESTful conventions, naming consistency, proper HTTP status codes, versioning, pagination, error contract consistency, and backward compatibility.
Evaluates code for breaking changes, API versioning strategy, deprecation practices, and migration path planning that affect consumers and integrators.
Uses AST parsing (TypeScript compiler for JS/TS, scope-tracking parser for Python/Rust/Go/Java/C#) to evaluate cyclomatic complexity, nesting depth, function length, parameter count, dead code, and type-safety — metrics that regex alone cannot reliably measure.
Evaluates code for vulnerability to attacks (injection, XSS, CSRF, SSRF), authentication/authorization flaws, dependency vulnerabilities, and adherence to OWASP Top 10.
Evaluates code for data protection, encryption practices, PII handling, data-at-rest/in-transit security, access controls, and compliance with data privacy regulations (GDPR, CCPA, HIPAA).
Evaluates code for data residency enforcement, cross-border transfer controls, jurisdiction-aware data handling, vendor independence (technological sovereignty), and operational self-governance (audit trails, resilience, data portability).
Evaluates code for query efficiency, connection management, migration practices, schema design, and database access patterns that affect performance and reliability.