NVIDIA/TensorRT-Model-Connect is a collection of C++ reference implementations for deploying supported Hugging Face models with NVIDIA TensorRT, a system that runs trained models to produce inference results. It is for developers who want to build and run supported models or evaluate model integrations through TensorRT. The catalogue entries provide skills and instructions for using this model deployment workflow.
Borrowing it
Nothing to install: this file belongs to NVIDIA/TensorRT-Model-Connect. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.
curl -O https://raw.githubusercontent.com/NVIDIA/TensorRT-Model-Connect/main/AGENTS.mdgit clone --depth 1 https://github.com/NVIDIA/TensorRT-Model-ConnectWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/instructions/nvidia/tensorrt-model-connect/agents-md)<a href="https://agentmods.dev/instructions/nvidia/tensorrt-model-connect/agents-md"><img src="https://agentmods.dev/badge/instructions/nvidia/tensorrt-model-connect/agents-md/github.svg" alt="Measured on agentmods" height="20"></a>Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.
<a href="https://agentmods.dev/instructions/nvidia/tensorrt-model-connect/agents-md"><img src="https://agentmods.dev/badge/instructions/nvidia/tensorrt-model-connect/agents-md.svg" alt="Reviewed on agentmods" width="80" height="20"></a>What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.01127 | $0.01127 |
| Opus 5.5 | $0.00451 | $0.00451 |
| Sonnet 5.5 | $0.00225 | $0.00225 |
| Haiku 4.5 | $0.00113 | $0.00113 |
Grade A, and why
TensorRT-Model-Connect AGENTS.md scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
How it starts
The opening of the file, as written. The whole thing — 97 lines — stays where its author put it; the contents beside it link to each section on GitHub.
Agent Instructions
Repository Target
- Treat GitHub as the active repository for this project:
https://github.com/NVIDIA/TensorRT-Model-Connect.git. - Use the local
githubremote for fetch, push, PR, and CI operations. - Do not push project changes to any non-GitHub legacy remote unless the user explicitly asks for that repository.
Branch And PR Flow
- The GitHub default branch is
main. - Do not push directly to GitHub
main. - Start new work from
github/mainon a short-lived branch. - Push the branch to the GitHub remote and open a pull request targeting
main. - Wait for GitHub CI before merging.
- Merge with squash or rebase, matching the repository ruleset.
- Sign off every commit introduced by a pull request with DCO using
git commit --signoff; ensure theSigned-off-byemail matches the commit author. - Preserve or re-add valid sign-offs when amending, rebasing, or cherry-picking commits, and never sign off on another author's behalf.
- Avoid commit messages containing
Claude; the GitHub ruleset rejects them.
GitHub Pages
- Keep GitHub Pages dedicated to the documentation website.
- Do not publish CI reports to GitHub Pages unless the user explicitly changes that decision.
Model-Family Ownership And Execution Philosophy
- The model family is the unit of ownership, fault isolation, and horizontal scale. One team or agent must be able to implement, validate, change, and revert one family without changing or coordinating with another.
- Each model family owns all model-specific code: configuration and weights, mathematical topology, engine composition, runtime orchestration, and model validation.
- Duplicate model-specific code by design. Duplication keeps model-specific defects, merge conflicts, and rollbacks family-local; code similarity never justifies a cross-family abstraction.
- Shared code is limited to model-agnostic contracts and mechanics. It contains no model topology, model semantics, model orchestration, model-specific validation logic or evidence, or family-specific behavior.
- Generic family code defines only the mathematical computation graph and runtime orchestration. TensorRT owns all lowering to GPU execution, including fusion, tactic and kernel selection, scheduling, code generation, and hardware or version adaptation.
- Generic family semantics do not depend on GPU, SM, CUDA, driver, or TensorRT version. Platform-specific failures are project topology or orchestration defects, or upstream TensorRT issues.
- Platform specialization is limited to complete network offload, such as TensorRT Edge-LLM, and TVM-FFI BYOK kernel bindings. Target-specific plans, timing caches, and compiled kernels do not make the model family specialized.
- Existing family-owned GPU helper kernels outside TVM-FFI BYOK violate this architecture and are temporary migration debt, not a supported specialization.
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 1mo ago Changed · +15 lines · +250 tokens per session 7b3c48867eaa
- 2mo ago Changed · +3 lines · +43 tokens per session 094a24f2a102
- 2mo ago First seen · 79 lines · 834 tokens per session scan A 8fd3e6c8576a
TensorRT-Model-Connect AGENTS.md is an instructions file published in the GitHub repository NVIDIA/TensorRT-Model-Connect (289 stars, last pushed today), licensed Apache-2.0. It adds 1,127 tokens to every session, about $0.0045 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.
TensorRT-Model-Connect AGENTS.md compared with instructions from other repositories
| Mod | Type | Stars | Last push | Licence | Scan | Tokens | Works with |
|---|---|---|---|---|---|---|---|
| TensorRT-Model-Connect AGENTS.mdNVIDIA/TensorRT-Model-Connect | Instructions file | 289 | today | Apache-2.0 | A | 1,127 | Codex, OpenCode |
| vscode buildNext.instructions.mdmicrosoft/vscode | Instructions file | 195k | yesterday | MIT | A | 9,719 | GitHub Copilot |
| next.js AGENTS.mdvercel/next.js | Instructions file | 143k | today | MIT | A | 7,461 | Codex, OpenCode |
| langchain AGENTS.mdlangchain-ai/langchain | Instructions file | 149k | yesterday | MIT | A | 4,680 | Codex, OpenCode |
| vscode oss-third-party-notices.instructions.mdmicrosoft/vscode | Instructions file | 195k | yesterday | MIT | A | 5,516 | GitHub Copilot |
| vscode copilot-instructions.mdmicrosoft/vscode | Instructions file | 195k | yesterday | MIT | A | 3,093 | GitHub Copilot |
| deepseek-harness AGENTS.mddeepseek-ai/deepseek-harness | Instructions file | 274k | 2d ago | MIT | A | 4,313 | Codex, OpenCode |