benchmark framework agents

microsoft/STATE-Bench

Agent

StateBenchAgent is the provided standard tool-calling agent loop for Azure AI Foundry models and OpenAI models. It uses the OpenAI v1 client to call the Responses API with the benchmark's domain tools and the locked prompt protocol. If your model supports this tool-calling path, no agent code is required.

microsoft/STATE-Bench

Agent

Use this path to evaluate models from a different provider or write a custom tool-calling agent. STATE-Bench does not ship third-party adapters — provider integration is user-owned.