Skill Claude CodeCodex
Analyze host/CPU overhead in LLM inference (vLLM / SGLang / TRT-LLM serve / lmdeploy / TensorRT-LLM) from nsys traces. Phase 1 (Detection): determine whether host overhead is the bottleneck via a binary YES/NO verdict with metric evidence (GPU idle ratio, host prep exposed ratio, per-phase breakdown). Phase 2 (Root…
2 3d ago A 202 tokens