inference skills

71 tagged inference, measured the same way as everything else here.

Browse within: LLM 61cuda 35moe 34llama 32transformer 32PyTorch 18HuggingFace 15llm-inference 13ai-native 12Optimization 11agent 11GPU 10cloud-functions 10openai-compatible 10

sgl-project/sglang

Skill Claude CodeCodex needs its repo

Use when choosing the fastest SGLang Diffusion flags for a model, GPU, and VRAM budget.

not rated 37k +254 changed 8d ago A Snyk: passSkillSpector: pass 29 tokens original Apache-2.0

mlx-serve

02

ddalcu/mlx-serve

Skill Claude CodeCodex

Hook an app, game or script up to the local mlx-serve server for LLM chat, embeddings, image, speech, music, sound effect, video and 3D generation, and Laya/Kev/Clef typed decisions, or make a whole film or music video on this Mac. Use when code should call mlx-serve or the user wants a video, song, pictures or game…

not rated 1.9k +125 changed 2d ago A 88 tokens

review-trtmc-pr

03

NVIDIA/TensorRT-Model-Connect

Skill Codex needs its repo ✓ vendor

Review a TensorRT-Model-Connect GitHub PR or local contributor branch against the current post-#1093 model-family isolation architecture, repository rules, behavioral correctness, and exact-head validation evidence. Use for contributor self-review before marking a PR ready, or when deciding whether a community PR is…

not rated 276 +2 changed 1mo ago A 98 tokens original Apache-2.0

graphsignal/graphsignal-profiler

Skill Claude CodeCodex

Set up the Graphsignal Profiler for inference workloads — vLLM, SGLang, PyTorch, and dstack services. Use when the user wants GPU profiling, tracing, or monitoring for inference, asks about graphsignal-run or graphsignal.watch(), or asks about CUPTI / Prometheus / OTLP setup.

not rated 245 2mo ago A 74 tokens copy · 100% Apache-2.0

NVIDIA/nvcf

Skill Claude Code ✓ vendor

Install, operate, and tear down self-hosted NVIDIA Cloud Functions (NVCF) deployments with nvcf-cli. Use for control-plane or compute-plane install, status checks, cluster registration, function deploy/invoke, task create/list/cancel/delete, API keys, admin tokens, JWKS rotation, failed-install diagnosis, and…

not rated 238 +7 changed 7d ago A SkillSpector: warn 193 tokens original Apache-2.0

join-buyer

06

AntSeed/antseed

Skill Claude CodeCodex

Help the user set up Antseed buyer node to consume AI services from the peer-to-peer network. Walk them through installation, funding, and connecting their existing tools (Aider, Continue.dev, Cursor, or any OpenAI-compatible client) through the local proxy.

not rated 57 changed 28d ago A 0 tokens GPL-3.0

atc-model-converter

07

Ascend/agent-skills

Skill Claude CodeCodex

Complete toolkit for Huawei Ascend NPU model conversion and end-to-end inference adaptation. Workflow 1 auto-discovers input shapes and parameters from user source code. Workflow 2 exports PyTorch models to ONNX. Workflow 3 converts ONNX to .om via ATC with multi-CANN version support. Workflow 4 adapts the user's full…

not rated 50 +2 5mo ago A 142 tokens MulanPSL-2.0

cut-release

08

coeusyk/inference-x

Skill Claude Code

Decide whether unreleased develop work warrants a release, pick the version per semver.org, and cut it following this repo's established commit/PR/tag/release pattern.

not rated 2 19d ago A 38 tokens original MIT

JoniMartin27/inferbench

Skill Claude Code

Build, launch, smoke-test and drive the InferBench FastAPI backend (:7777) and its inference-engine orchestration. Use when asked to run, start, launch, boot, smoke-test, benchmark, or drive the inferbench backend / API / engines (llama.cpp, ollama, vLLM, SGLang, TGI), or to verify an engine actually starts and runs a…

not rated 2 1mo ago A 90 tokens original MIT

bridgenode

10

bridgenode-ai/bridgenode-skill

Skill Claude CodeCodex

BridgeNode — x402 pay-per-request AI inference for agents. OpenAI-compatible API + MCP server with tool calling, Solana USDC, gas-free micropayments. No API keys. Free models included. Live prices: bridgenode.cc/v1/models Use when an agent lacks a provider API key or wants privacy-preserving per-request AI inference…

not rated 1 changed 22d ago A 0 tokens MIT-0

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: