Mattbusel/tokio-prompt-orchestrator

Tokio pipeline for serving LLM requests: bounded five-stage flow with dedup, circuit breakers, retries, rate limits and a dead-letter queue in front of Anthropic, OpenAI, llama.cpp or vLLM. REST, SSE, MCP, TUI.

60Stars on the repository

1Mods indexed here, across every type

6d agoLast push, which is what freshness is scored on

MITLicence, which decides whether bodies are shown

Sort Relevance Recently updated Fewest tokens Security grade Repo stars Stars this week Top rated 1 mods

tokio-prompt-orchestrator

Mattbusel/tokio-prompt-orchestrator

MCP server Claude CodeCodexCursor +2

MCP server "tokio-prompt-orchestrator" as configured in Mattbusel/tokio-prompt-orchestrator. Launched with cargo run --bin mcp --features mcp --release. Needs 3 environment variables to run.

not rated 60 6d ago A tokens not measured original MIT