From PyTorch model to end-to-end TensorRT inference experience in two commands—AI-native, cross-platform, and built for the best possible user experience.
NVIDIA/TensorRT-Model-Connect is a collection of C++ reference implementations for deploying supported Hugging Face models with NVIDIA TensorRT, a system that runs trained models to produce inference results. It is for developers who want to build and run supported models or evaluate model integrations through TensorRT. The catalogue entries provide skills and instructions for using this model deployment workflow.
This repository also configures its own agents. See what TensorRT-Model-Connect tells them →
Skill Codex ✓ vendor
Diagnose a TensorRT-Model-Connect family whose native output disagrees with its declared reference or family-owned correctness contract.
Skill Codex ✓ vendor
Audit and update TensorRT-Model-Connect documentation when code, public APIs, family ownership, commands, or model support have changed.
Skill Codex ✓ vendor
Implement or review FP16 and BF16 behavior in one family-owned, strongly typed TensorRT network without changing unrelated families.
Skill Codex ✓ vendor
Evaluate supported precision, quantization, or selected FP32-layer choices for one TensorRT-Model-Connect family with matched correctness and timing.
Skill Codex ✓ vendor
Use when monitoring GitHub pull request CI, diagnosing failed checks, rebasing branches onto github/main, applying narrowly scoped fixes, and updating PRs until their latest checks are green or a human blocker is identified.
Skill Codex ✓ vendor
Measure one TensorRT-Model-Connect model through its public Task API or run a checked-in performance-matrix entry with comparable evidence.
Skill Claude CodeCodex ✓ vendor
Prepare a TensorRT-Model-Connect development or validation environment from a fresh checkout on a host without a known working setup.
Skill Codex ✓ vendor
Use when converting QA findings, black-box failures, red-team reports, regression evidence, or local bug notes into GitHub Issues for NVIDIA/TensorRT-Model-Connect. Standardizes checking issue templates, checking labels, de-duplicating existing issues, drafting a bug report, creating the issue on GitHub, applying the…
Skill Codex ✓ vendor
Use when publishing an existing TensorRT-Model-Connect change as a GitHub pull request. Verifies authenticated repository access, branch and diff scope, validation evidence, commit identity, reviewer-facing text, exact pushed head, and the created draft PR without merging it.
Skill Codex ✓ vendor
Add a Hugging Face or local checkpoint to TensorRT-Model-Connect as a self-contained family, or extend the family that already owns it.
Skill Codex ✓ vendor
Draft, revise, or review Git commit messages, PR titles, PR descriptions, and squash or rebase merge messages. Use when Codex needs to summarize a diff for reviewers, convert rough notes into a commit or PR message, check a message against Git and Conventional Commits style, or prepare repository contribution text…
Skill Codex needs its repo ✓ vendor
Review a TensorRT-Model-Connect GitHub PR or local contributor branch against the current post-#1093 model-family isolation architecture, repository rules, behavioral correctness, and exact-head validation evidence. Use for contributor self-review before marking a PR ready, or when deciding whether a community PR is…
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: