Quantization skills

39 tagged Quantization, measured the same way as everything else here.

Browse within: Optimization 37 Memory Optimization 22 4-Bit 21 GGUF 15 Apple Silicon 14 CPU Inference 14 Inference Serving 14 QLoRA 14 Fast Inference 13 Model Compression 13 llama.cpp 13 Bitsandbytes 9 ai-research 9 amd-gpu 9

Sort Relevance Recently updated Fewest tokens Security grade Repo stars Stars this week Top rated 39 mods

Nothing here yet

This corner of the catalogue is empty. The crawl runs nightly, so it may not be for long.