aws-contract-testing

AWS Contract Testing Skill

Generate offline contract tests by reading OpenAPI specs, SAM templates, and CloudFormation definitions. No network calls needed.

How to Generate Contract Tests

Phase 1: Find the API Specification

Search the project for:

• swagger.yml, swagger.yaml, openapi.yml, openapi.yaml, openapi.json
• SAM template.yaml with AWS::Serverless::Api + inline swagger
• CloudFormation with AWS::ApiGateway::RestApi + Body property
• api.json or any file containing "openapi" or "swagger" keys

Phase 2: Extract Schemas and Endpoints

From the spec, extract:

1. All schemas under components.schemas (or definitions in Swagger 2)
2. All endpoints — method + path + request body schema + response schema
3. Required fields for each schema
4. Enum values for constrained fields
5. Security schemes — API key, OAuth, IAM
6. Global security requirements

Phase 3: Generate Contract Tests

See references/openapi-patterns.md for full patterns.

Schema Completeness Tests

"""Verify all expected schemas exist in the spec."""
import yaml
import pytest
from pathlib import Path

SPEC_PATH = Path("path/to/swagger.yml")  # Discovered in Phase 1

@pytest.fixture(scope="module")
def spec():
    return yaml.safe_load(SPEC_PATH.read_text(encoding="utf-8"))

@pytest.fixture(scope="module")
def schemas(spec):
    return spec.get("components", spec.get("definitions", {})).get("schemas", {})

class TestSchemaCompleteness:
    # Auto-populated from spec analysis:
    EXPECTED_SCHEMAS = [
        # List every schema name found in the spec
    ]

    @pytest.mark.parametrize("schema_name", EXPECTED_SCHEMAS)
    def test_schema_exists(self, schemas, schema_name):
        assert schema_name in schemas, f"Missing schema: {schema_name}"

Request Validation Tests

For each endpoint with a request body:

from jsonschema import validate, ValidationError

class TestCreateResourceContract:
    def test_valid_request_passes(self, schemas):
        schema = schemas["createResourceRequest"]
        payload = {
            # All required fields with valid values
        }
        validate(instance=payload, schema=schema)  # No error = pass

    def test_missing_required_field_fails(self, schemas):
        schema = schemas["createResourceRequest"]
        with pytest.raises(ValidationError):
            validate(instance={}, schema=schema)

    def test_extra_field_accepted_or_rejected(self, schemas):
        schema = schemas["createResourceRequest"]
        payload = {
            # Required fields + an extra unknown field
            "unknownField": "value",
        }
        if schema.get("additionalProperties") is False:
            with pytest.raises(ValidationError):
                validate(instance=payload, schema=payload)
        else:
            validate(instance=payload, schema=schema)  # Should pass