Fast Inference skills

24 tagged Fast Inference, measured the same way as everything else here.

Browse within: 4-Bit 13 Memory Optimization 13 Optimization 13 Quantization 13 emerging-techniques 13 AWQ 7 Activation-Aware 7 Constrained Decoding 7 Draft Models 7 Inference Optimization 7 Inference Serving 7 JSON Output 7 Latency Reduction 7 Lookahead Decoding 7

Sort Relevance Recently updated Fewest tokens Security grade Repo stars Stars this week Top rated 24 mods

Nothing here yet

This corner of the catalogue is empty. The crawl runs nightly, so it may not be for long.