Nothing here yet
This corner of the catalogue is empty. The crawl runs nightly, so it may not be for long.
16 tagged 4-Bit, measured the same way as everything else here.
Browse within: Memory Optimization 21Optimization 21Quantization 21QLoRA 14Fast Inference 138-Bit 8Bitsandbytes 8Efficient Inference 8HuggingFace 8INT8 8NF4 8AWQ 7Activation-Aware 7Marlin Kernels 7
This corner of the catalogue is empty. The crawl runs nightly, so it may not be for long.