antirez/deepseek-v4-gguf
Text Generation • 20B • Updated • 2.38M • 335
Edit Models filters
Model Tree
Apps
Inference Providers
Models
47,737
Active filters: 4-bit
prism-ml/Ternary-Bonsai-27B-AWQ-4bit
Image-Text-to-Text • 27B • Updated • 3.37k • • 18
poolside/Laguna-S-2.1-NVFP4-mlx
118B • Updated • 2 • 9
huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF
284B • Updated • 602k • 105
mlx-community/gemma-4-12b-coder-fable5-composer2.5-4bit
Text Generation • 12B • Updated • 9.5k • 27
AngelSlim/Hy3-GPTQ-Int4
Text Generation • 299B • Updated • 442 • 7
prism-ml/Bonsai-27B-AWQ-4bit
Image-Text-to-Text • 27B • Updated • 1.05k • 8
danielrmay/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-W4A16
Text Generation • 82B • Updated • 2.96k • 5
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation • 9B • Updated • 9.73k • 84
unsloth/Qwen3.6-35B-A3B-UD-MLX-4bit
Image-Text-to-Text • 6B • Updated • 18.4k • 108
josefprusa/ThinkingCap-Qwen3.6-27B-int4-AutoRound-v1
Text Generation • 6B • Updated • 8.45k • 48
mlx-community/gpt-oss-20b-MXFP4-Q8
Text Generation • 21B • Updated • 332k • 77
LilaRest/gemma-4-31B-it-NVFP4-turbo
Text Generation • 33B • Updated • 462k • 301
Lorbus/Qwen3.6-27B-int4-AutoRound
Image-Text-to-Text • 6B • Updated • 395k • 124
QuantTrio/Qwen3.6-27B-AWQ
Image-Text-to-Text • 28B • Updated • 1.17M • 22
mlx-community/gemma-4-12B-it-qat-4bit
Image-Text-to-Text • 3B • Updated • 10.7k • 25
mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit
Text Generation • 7B • Updated • 4.26k • 12
unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit
Text-to-Speech • 3B • Updated • 4.27k • 19
Qwen/Qwen2.5-VL-32B-Instruct-AWQ
Image-Text-to-Text • 33B • Updated • 360k • 65
Disty0/Z-Image-Turbo-SDNQ-uint4-svd-r32
Text-to-Image • 3B • Updated • 6.88k • 60
MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF
Text Generation • 12B • Updated • 31.2k • 4
Intel/Qwen3.5-122B-A10B-int4-AutoRound
20B • Updated • 191k • 45
Qwen/Qwen3.5-122B-A10B-GPTQ-Int4
Image-Text-to-Text • 125B • Updated • 259k • 45
unsloth/gemma-4-E4B-it-UD-MLX-4bit
Image-Text-to-Text • 2B • Updated • 1.12k • 43
unsloth/gemma-4-31B-it-unsloth-bnb-4bit
Image-Text-to-Text • 31B • Updated • 480k • 22
unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit
Image-Text-to-Text • 5B • Updated • 2.06k • 33
Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2
Text Generation • 25B • Updated • 16.4k • 278
cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit
Image-Text-to-Text • 36B • Updated • 1.73M • 87
palmfuture/Qwen3.6-35B-A3B-GPTQ-Int4
Image-Text-to-Text • 36B • Updated • 129k • 28
unsloth/Qwen3.6-27B-UD-MLX-4bit
Image-Text-to-Text • 10B • Updated • 7.25k • 63