test

Test Writing

Write tests for: $ARGUMENTS

Live Project State

• Current tests: !pytest tests/ --collect-only -q 2>/dev/null | tail -1

Test Organization

tests/
    conftest.py               # SharedFakeProvider, fixtures, helpers
    test_<module>.py           # Unit tests per source module
    agent/                     # Agent core, observer, batch, regression
        test_regression.py     # ALL regression tests go here
    providers/                 # Provider-specific tests
    rag/                       # RAG pipeline, chunking, stores
    integration/               # Cross-module integration tests
    tools/                     # Tool system tests

SharedFakeProvider (from conftest.py)

Use the fake_provider fixture — it returns a factory. Responses can be:

• str — auto-wrapped as Message(role=ASSISTANT, content=...)
• Message — used as-is (for tool_calls, etc.)
• (Message, UsageStats) tuple — controls token/cost tracking

def test_example(self, fake_provider):
    # Simple text response
    provider = fake_provider(responses=["Hello"])

    # Tool call response
    provider = fake_provider(responses=[
        Message(role=Role.ASSISTANT, content="", tool_calls=[
            ToolCall(tool_name="search", parameters={"q": "test"})
        ]),
        "Final answer",
    ])

    # Response with specific usage stats (for budget/cost tests)
    provider = fake_provider(responses=[
        (Message(role=Role.ASSISTANT, content="answer"),
         UsageStats(prompt_tokens=100, completion_tokens=50,
                    total_tokens=150, cost_usd=0.01,
                    model="test", provider="test")),
    ])

Important: Agent requires at least one tool. Use a dummy:

_DUMMY = Tool(name="noop", description="noop", parameters=[], function=lambda: "ok")

Recording Provider Pattern

Use to verify exact args passed to provider methods:

class RecordingProvider:
    name = "recording"
    supports_streaming = False
    supports_async = False

    def __init__(self):
        self.last_messages = []
        self.last_system_prompt = ""
        self.last_tools = None

    def complete(self, *, model, system_prompt, messages, tools=None, **kw):
        self.last_messages = list(messages)
        self.last_system_prompt = system_prompt
        self.last_tools = tools
        return Message(role=Role.ASSISTANT, content="ok"), UsageStats(
            prompt_tokens=10, completion_tokens=5, total_tokens=15,
            cost_usd=0.0001, model=model, provider="recording",
        )