Inference Optimization skills

12 tagged Inference Optimization, measured the same way as everything else here.

Browse within: Draft Models 7FP8 7Fast Inference 7High Throughput 7INT4 7In-Flight Batching 7Inference Serving 7Latency Reduction 7Lookahead Decoding 7Low Latency 7Multi-GPU 7NVIDIA 7Parallel Generation 7Production 7

EfficientContext/ContextPilot

Skill Claude CodeCodex

Use when a user asks how many tokens (or how much context/cost) ContextPilot has saved, or wants a ContextPilot savings status/summary inside Hermes Agent — e.g. "how much did ContextPilot save?", "show ContextPilot token savings", "ContextPilot status", "savings in the last 24h / all time", or "give me the raw…

not rated 141 +1 changed 22d ago A SkillSpector: pass 164 tokens original Apache-2.0