Agent
Agent hints are optional per-request metadata that a harness sends under nvext.agenthints. Dynamo parses these hints in the frontend and passes them to the router and, where supported, backend runtimes.
Agent
Agent tracing captures request timing, token counts, worker placement, finish metadata, and replay hashes for eligible LLM requests. Requests with session identity also carry agent context, which lets analysis tools group LLM turns and tool activity into the same run.
Agent
NVIDIA Dynamo adds agent-aware serving features without taking ownership of the agent loop: your harness still manages prompts, tools, subagents, and reasoning state, while Dynamo uses metadata attached to each LLM request to correlate work, improve routing and scheduling, manage KV cache behavior, and produce traces…
Agent
Priority scheduling lets a client mark one request as more important than another. Dynamo exposes two related request fields.
Agent
Agent "thunderagent-program-scheduler" from ai-dynamo/dynamo, covering the problem, the scheduler, scheduler tick, tool-boundary pause/resume semantics and program lifetime.