Skill Claude CodeCodex
Step-by-step tutorial for adding a new lightweight JIT CUDA kernel to sglang's jitkernel module.
74 tagged moe, measured the same way as everything else here.
Browse within: cuda 63PyTorch 35blackwell 35llm-serving 35inference 30llama 28transformer 28TensorRT-LLM 7Optimization 5
Skill Claude CodeCodex
Step-by-step tutorial for adding a new lightweight JIT CUDA kernel to sglang's jitkernel module.
Skill Claude CodeCodex
How SGLang's runtime configuration and process-global state are organized (RuntimeContext tiers, publish + namespace config bags, the pristine ServerArgs seed, override entry points, resource/stream/buffer leases, per-forward flags), the CI guardrails that enforce the design, and the idioms for developing and testing…
Skill Claude CodeCodex
Use when adding a new diffusion model or Diffusers pipeline to SGLang.
Skill Claude CodeCodex
Translates a HuggingFace model into a prefill-only AutoDeploy custom model using reference custom ops, validates with hierarchical equivalence tests.
Skill Claude CodeCodex
Run TensorRT-LLM test cases, benchmarks, evaluations, or custom scripts by checking the environment (local GPU or Slurm), selecting the appropriate Docker image, and executing either locally or via Slurm job submission. Accepts pre-built command strings — command construction for trtllm-bench, trtllm-eval, and…
Skill Claude CodeCodex
Onboard a HuggingFace multimodal model (vision/audio/video + text) to the TensorRT-LLM PyTorch backend. Use when writing a new tensorrtllm/torch/models/modeling .py plus its input processor and weight mapper, or extending an existing VLM. Not for AutoDeploy — use ad-model-onboard for that path.
Skill Claude CodeCodex
Use when the user wants to train, validate, predict, track, export, benchmark, tune, inspect, or orchestrate YOLO-Master / Ultralytics experiments in this repository, including LoRA, MoE, multimodal inference/evaluation, and solutions workflows.
dnnyngyen/kimi-agent-internals
Skill Claude CodeCodex
Provided in response to plain-English questions. Maintainer does not claim copyright. Included for research under CC0 1.0. See LICENSE for details. -->.
dnnyngyen/kimi-agent-internals
Skill Claude CodeCodex
Provided in response to plain-English questions. Maintainer does not claim copyright. Included for research under CC0 1.0. See LICENSE for details. -->.
dnnyngyen/kimi-agent-internals
Skill Claude CodeCodex
Provided in response to plain-English questions. Maintainer does not claim copyright. Included for research under CC0 1.0. See LICENSE for details. -->.
Skill Claude CodeCodex
Use focr/frankenocr OCR CLI, robot NDJSON, model artifacts, and Rust OcrEngine. Use when running focr, embedding OcrEngine, or editing frankenocr.