Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

29,004

Base only

Active filters: imatrix

mradermacher/Gemma-4-21B-i1-GGUF

21B • Updated 6 days ago • 4.17k • 2

pinklily69/DeepSeek-V4-Flash-IQ3_S-GGUF

284B • Updated 5 days ago • 445 • 2

kaitchup/Qwen3.5-4B-GGUF-MoQ

4B • Updated 2 days ago • 3.45k • 2

w-ahmad/Qwopus3.5-9B-Coder-MTP-GGUF-MoQ

Text Generation • 9B • Updated 2 days ago • 23.2k • 2

mradermacher/Mellum2-12B-A2.5B-Thinking-i1-GGUF

12B • Updated 2 days ago • 8.53k • 2

NeveAI/Neve-Echo-5-12B-GGUF

Image-Text-to-Text • 12B • Updated about 24 hours ago • 178 • 2

mradermacher/gemma-4-12B-it-abliterated-uncensored-i1-GGUF

12B • Updated about 14 hours ago • 1.43k • 2

WithinUsAI/Phi4-Reasoner-Uncensored-gguf

4B • Updated 1 day ago • 49 • 2

w-ahmad/LFM2.5-8B-A1B-GGUF-MoQ

Text Generation • 8B • Updated about 3 hours ago • 50k • 2

bartowski/Yi-1.5-34B-Chat-GGUF

Text Generation • 34B • Updated May 12, 2024 • 893 • 26

legraphista/DeepSeek-V2-Lite-IMat-GGUF

Text Generation • 16B • Updated May 26, 2024 • 1.44k • 2

mmnga/umiyuki-Umievo-itr012-Gleipnir-7B-gguf

7B • Updated May 29, 2024 • 497 • 9

bartowski/Codestral-22B-v0.1-GGUF

Text Generation • 22B • Updated Jun 5, 2024 • 4.91k • 193

lmstudio-community/Codestral-22B-v0.1-GGUF

Text Generation • 22B • Updated Jun 5, 2024 • 8.84k • 29

bartowski/dolphin-2.9.2-qwen2-72b-GGUF

Text Generation • 73B • Updated Jun 11, 2024 • 1.1k • 7

DavidAU/Command-R-01-Ultra-NEO-V1-35B-IMATRIX-GGUF

Text Generation • 35B • Updated 17 days ago • 2.74k • 23

DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF

Text Generation • 29B • Updated Jul 28, 2025 • 136 • 14

lmstudio-community/Phi-3.1-mini-4k-instruct-GGUF

Text Generation • 4B • Updated Aug 1, 2024 • 3.93k • 24

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 177k • 35

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF

8B • Updated Aug 2, 2024 • 792 • 21

legraphista/Phi-3.5-mini-instruct-IMat-GGUF

Text Generation • 4B • Updated Aug 20, 2024 • 1.05k • 2

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • 4B • Updated Aug 20, 2024 • 267k • 30

mradermacher/deepseek-coder-1.3b-instruct-i1-GGUF

1B • Updated Sep 3, 2024 • 420 • 2

kaetemi/Qwen2.5-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 24, 2024 • 653 • 1

legraphista/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 1.36k • 1

mradermacher/Qwen2.5-14B-Instruct-i1-GGUF

15B • Updated Feb 3, 2025 • 677 • 2

bartowski/Llama-3.1-WhiteRabbitNeo-2-70B-GGUF

Text Generation • 71B • Updated Oct 5, 2024 • 2.18k • 8

mradermacher/Mistral-Small-22B-ArliAI-RPMax-v1.1-i1-GGUF

22B • Updated Oct 14, 2024 • 439 • 7

maicog/Llama-3.2-3B-Instruct-abliterated-Q4_K_M-GGUF

4B • Updated Oct 17, 2024 • 279 • 1

bartowski/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • 33B • Updated Nov 10, 2024 • 36.9k • 107