Efficient Inference skills

14 tagged Efficient Inference, measured the same way as everything else here.

Browse within: Linear Complexity 12 Model Architecture 12 4-Bit 8 8-Bit 8 Bitsandbytes 8 HuggingFace 8 INT8 8 Memory Optimization 8 NF4 8 Optimization 8 QLoRA 8 Quantization 8 Alternative Architecture 6 Alternative To Transformers 6

Sort Relevance Recently updated Fewest tokens Security grade Repo stars Stars this week Top rated 14 mods

Nothing here yet

This corner of the catalogue is empty. The crawl runs nightly, so it may not be for long.