llm inference instructions

27 tagged llm inference, measured the same way as everything else here.

Browse within: cuda 5

dynamo AGENTS.md

01

ai-dynamo/dynamo

Instructions file CodexOpenCode

AGENTS.md instructions for ai-dynamo/dynamo, covering dynamo — agent guide, agent instruction files, skills, improving these instructions and optimization role dispatch.

7.9k 2d ago A 3,782 tokens

dynamo CLAUDE.md

02

ai-dynamo/dynamo

Instructions file

Claude Code instructions for ai-dynamo/dynamo, a project described as: A Datacenter Scale Distributed Inference Serving Framework.

7.9k 2d ago A 5 tokens

plano CLAUDE.md

03

katanemo/plano

Instructions file

Instructions for katanemo/plano, covering claude.md, build & test commands, rust — wasm plugins (must target wasm32-wasip1), rust — brightstaff binary (native target) and rust — tests, format, lint.

7.0k 12d ago A 1,270 tokens original Apache-2.0

flashinfer-ai/flashinfer

Instructions file CodexOpenCode

Instructions for flashinfer-ai/flashinfer: This repository’s agent instructions live in CLAUDE.md.

6.3k 2d ago A 45 tokens original Apache-2.0

flashinfer-ai/flashinfer

Instructions file

Instructions for flashinfer-ai/flashinfer, covering claude.md, project overview, quick reference, quick start for development and installation.

6.3k 2d ago E 10,364 tokens original Apache-2.0

lemonade AGENTS.md

06

lemonade-sdk/lemonade

Instructions file CodexOpenCode

Instructions for lemonade-sdk/lemonade, covering agents.md, project overview, architecture, executables and backend abstraction.

5.5k 2d ago A 4,973 tokens original Apache-2.0

lemonade CLAUDE.md

07

lemonade-sdk/lemonade

Instructions file

Instructions for lemonade-sdk/lemonade, a project described as: Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk.

5.5k 2d ago A 5 tokens copy · 100% Apache-2.0

nanocoder AGENTS.md

08

Nano-Collective/nanocoder

Instructions file CodexOpenCode

AGENTS.md instructions for Nano-Collective/nanocoder, covering agents.md, project overview, architecture, key files and development commands.

2.4k yesterday A 1,165 tokens

nanocoder CLAUDE.md

09

Nano-Collective/nanocoder

Instructions file

Claude Code instructions for Nano-Collective/nanocoder, covering claude.md, development commands, build and run, testing (run before committing) and individual test commands.

2.4k yesterday A 2,693 tokens

neuron-ai AGENTS.md

10

neuron-core/neuron-ai

Instructions file CodexOpenCode

Instructions for neuron-core/neuron-ai, covering neuron ai - project overview, the mental model: neuron is a composable workflow, development commands, architecture and modules.

2.1k 2d ago A 1,450 tokens original MIT

neuron-ai CLAUDE.md

11

neuron-core/neuron-ai

Instructions file

Instructions for neuron-core/neuron-ai, covering project overview, code standards, think before coding, simplicity first and surgical changes.

2.1k 2d ago A 586 tokens original MIT

xllm AGENTS.md

12

xLLM-AI/xllm

Instructions file CodexOpenCode

AGENTS.md instructions for xLLM-AI/xllm, covering xllm coding agent instructions, directory structure, code style guide and review instructions.

1.5k yesterday A 763 tokens original Apache-2.0

xllm CLAUDE.md

13

xLLM-AI/xllm

Instructions file

Claude Code instructions for xLLM-AI/xllm, a project described as: A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

1.5k yesterday A 3 tokens copy · 100% Apache-2.0

tingaicompass/AI-Compass

Instructions file CodexOpenCode

A set of AGENTS.md project instructions for maintaining the AI-Compass repository, including its purpose, folder structure, and rules for adding resources. AGENTS.md is a file that tells coding agents how to work in a project.

926 4d ago A 2,521 tokens

atlas AGENTS.md

15

Avarok-Cybersecurity/atlas

Instructions file CodexOpenCode

AGENTS.md instructions for Avarok-Cybersecurity/atlas, covering agents.md, what atlas is, ground rules, local checks before a pr and 1. formatting.

672 2d ago A 2,251 tokens AGPL-3.0

hipfire AGENTS.md

16

warpfront/hipfire

Instructions file CodexOpenCode

AGENTS.md instructions for warpfront/hipfire, covering agents.md — project notice + testing playbook, notice for ai agents working with hipfire, what hipfire is, what this notice asks of you and what this notice does not ask of you.

565 2d ago A 9,666 tokens

hipfire CLAUDE.md

17

warpfront/hipfire

Instructions file

Claude Code instructions for warpfront/hipfire, covering hipfire: rust-native inference engine for amd rdna gpus, mission, architecture, pflash status and building, testing & gates.

565 2d ago B 6,602 tokens

quant.cpp CLAUDE.md

18

quantumaikr/quant.cpp

Instructions file

Claude Code instructions for quantumaikr/quant.cpp, covering quant.cpp — agent development guide, project vision, project overview, architecture and key documents.

399 4mo ago A 2,450 tokens Apache-2.0

webgptorg/promptbook

Instructions file GitHub Copilot

Copilot instructions for webgptorg/promptbook, covering copilot instructions for promptbook, project overview, architecture & key concepts, book language & commitments and monorepo structure.

167 yesterday A 2,533 tokens

webgptorg/promptbook

Instructions file CodexOpenCode

AGENTS.md instructions for webgptorg/promptbook, covering how to contribute, code style, emoji in [brackets], generated code and dictionary.

167 yesterday A 2,256 tokens

RightNow-AI/AutoMegaKernel

Instructions file CodexOpenCode

Instructions for RightNow-AI/AutoMegaKernel, covering what amk is, the edit surface, scheduleconfig + kernelknobs only, canonical tool surface (mcp), use these exact names, codex mcp server config (/.codex/config.toml) and the copy-paste loop a codex agent runs.

135 2mo ago B 2,279 tokens original MIT

emmy AGENTS.md

22

cloudrift-ai/emmy

Instructions file CodexOpenCode

Instructions for cloudrift-ai/emmy, covering agents.md, project overview, prerequisites, running tests and the realization corpus.

80 yesterday A 5,284 tokens original Apache-2.0

emmy CLAUDE.md

23

cloudrift-ai/emmy

Instructions file

Instructions for cloudrift-ai/emmy, a project described as: Optimized GPU compiler for LLM inference. Choose from a list of optimized recipes or optimize your own model via kernel fusion, autotuning, and advanced scheduling. Run benchmarks across different GPU types and configurations, track results and share…

80 yesterday A 5 tokens copy · 100% Apache-2.0

attnres AGENTS.md

24

AbdelStark/attnres

Instructions file CodexOpenCode

Instructions for AbdelStark/attnres, covering agents.md, project identity, current state, verified commands and architecture map.

54 5mo ago A 752 tokens original MIT