NVIDIA/TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

15kStars on the repository

52Mods indexed here, across every type

2d agoLast push, which is what freshness is scored on

Sort Relevance Recently updated Fewest tokens Security grade Repo stars Stars this week Top rated 2 mods

TensorRT-LLM AGENTS.md

NVIDIA/TensorRT-LLM

Instructions file CodexOpenCode

AGENTS.md instructions for NVIDIA/TensorRT-LLM, covering agents.md, rules (read first), common commands, installation & build and reference configs.

15k 2d ago A 2,988 tokens

TensorRT-LLM CLAUDE.md

NVIDIA/TensorRT-LLM

Instructions file

Claude Code instructions for NVIDIA/TensorRT-LLM, a project described as: TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python…

15k 2d ago A 13 tokens