Inference Providers
Active filters: 2-bit
Text Generation
• 284B • Updated • 793k
• 230
huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF
284B • Updated • 20.6k
• 42
majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-2bit
Image-Text-to-Text
• 35B • Updated • 2.83k
• 7
Brooooooklyn/Qwen3.6-35B-A3B-UD-Q2_K_XL-mlx
Text Generation
• 4B • Updated • 1.09k
• 7
morphicode-jp/gemma-4-31B-it-L25L26x1.5-Q2_K
Text Generation
• 31B • Updated • 11
• 2
MaziyarPanahi/WhiteRabbitNeo-13B-v1-GGUF
Text Generation
• 13B • Updated • 1.82k
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
• 7B • Updated • 190k
• 142
MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
• 8B • Updated • 181k
• 35
MaziyarPanahi/Phi-3.5-mini-instruct-GGUF
Text Generation
• 4B • Updated • 269k
• 30
mlx-community/DeepSeek-R1-2bit
Text Generation
• 84B • Updated • 211
• 9
MaziyarPanahi/GLM-4.6V-Flash-GGUF
Text Generation
• 9B • Updated • 78.8k
• 6
majentik/gemma-4-E2B-TurboQuant-MLX-2bit
Image-Text-to-Text
• 0.9B • Updated • 321
• 2
majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-2bit
Image-Text-to-Text
• 35B • Updated • 1.16k
• 3
majentik/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-RotorQuant-MLX-2bit
Text Generation
• 4B • Updated • 197
• 1
Ayushnangia/bloom3B-2bit-gptq
Text Generation
• Updated • 3
kaitchup/Llama-2-7b-gptq-2bit
Text Generation
• 7B • Updated • 5
• 1
nesty/sg-bart-large-4096-gptq-2bit
Arylwen/instruct-palmyra-20b-gptq-2
Text Generation
• Updated • 1
Text Generation
• 0.1B • Updated • 1
Sujan42024/dlite-v2-1_5b-2bitQuantization
Text Generation
• 2B • Updated • 3
kaitchup/Mistral-7B-v0.1-gptq-2bit
Text Generation
• 7B • Updated • 5
kaitchup/Llama-2-13b-hf-gptq-2bit
Text Generation
• 13B • Updated • 3
kaitchup/Llama-2-7b-hf-gptq-2bit
Text Generation
• 7B • Updated • 206
Text Generation
• 3B • Updated • 222
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 1.01k
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 679
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 753
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 147
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 155
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 153
• 2