maf-workflow-smoke-tester

workflow-smoke-tester

Purpose

dotnet build passing does not mean the code works. The fan-in starvation bug is the canonical example: builds green, runs silently wrong, no error. Smoke tests add a fast, credential-free runtime check for the class of failures that static analysis alone cannot catch.

These tests use mock chat clients — no Azure credentials required, no network calls. They verify structural correctness, not AI output quality.

⚡ The fastest path — use the MCP tools

The maf-autopilot MCP server now covers most of the smoke-test surface automatically. Prefer these:

What you want to verify	Use this tool
Every fan-out [MessageHandler] returns Task<T>	MafValidateFanOut(repoPath)
Workflow topology can complete (no silent starvation)	MafSimulateWorkflow(repoPath)
New agent/executor scaffold ships with smoke test	MafNewAgent / MafNewExecutor
Agent prompt quality (injection, refusals, bloat)	MafLintAgentPrompt(repoPath)
Single-command health letter	MafDoctor(repoPath) — covers all of above

When you call MafNewExecutor, the generated *Tests.cs already includes the reflection-based "fan-out handler returns Task<T>" structural assertion — that's the canonical smoke-test pattern. It's compile-validated against AntiPatternScannerTool and FanOutValidatorTool by the project's own dogfood test suite.

When to use the manual templates below

Reach for them when:

• The MCP tools are unavailable.
• The codebase needs one of the patterns the tools don't yet cover (session round-trip, streaming, structured output, tool approval).
• You want to drop a snippet directly into a PR review.

Pattern detection

# Fan-out/fan-in pattern
Select-String -Path "src/**/*.cs" -Pattern "AddFanOutEdge" -Recurse -List

# Streaming
Select-String -Path "src/**/*.cs" -Pattern "RunStreamingAsync" -Recurse -List

# Structured output
Select-String -Path "src/**/*.cs" -Pattern "RunAsync<" -Recurse -List

# Tool invocation / approval
Select-String -Path "src/**/*.cs" -Pattern "ApprovalRequiredAIFunction|FunctionApprovalRequestContent" -Recurse -List

# Session round-trip
Select-String -Path "src/**/*.cs" -Pattern "CreateSessionAsync|SerializeSessionAsync" -Recurse -List