Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,728

Base only

Active filters: quantization

realrebelai/SCAIL-2_GGUF

Image-to-Video • 16B • Updated 2 days ago • 5.17k • 25

Abiray/SCAIL-2-GGUF

Image-to-Video • 16B • Updated 2 days ago • 375 • 9

transformerlab/ideogram-4-gguf-q4_k

Text-to-Image • 19B • Updated 7 days ago • 615 • 7

DJLougen/Qwen3.6-35B-A3B-REAP-90pct-GGUF

Text Generation • 6B • Updated 3 days ago • 1.01k • 6

sphaela/Qwen3.6-27B-AutoRound-GGUF

27B • Updated about 1 hour ago • 2.81k • 21

transformerlab/ideogram-4-int8-w8a8

Text-to-Image • Updated 7 days ago • 6

sphaela/Qwen3.6-35B-A3B-AutoRound-GGUF

36B • Updated 5 days ago • 2.09k • 16

w-ahmad/Qwopus3.5-9B-Coder-MTP-GGUF-MoQ

Text Generation • 9B • Updated 12 days ago • 27.1k • 13

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 720k • 115

webhie/Qwen3.6-27B-int4-AutoRound-Code

Image-Text-to-Text • 6B • Updated May 12 • 27.2k • 11

w-ahmad/LFM2.5-8B-A1B-GGUF-MoQ

Text Generation • 8B • Updated 8 days ago • 3.47k • 9

Tivaphraen/granite-4.1-8b-Claude-Opus-4.6-Thinking-MAX-gguf

Text Generation • 9B • Updated 9 days ago • 670 • 3

OSEvohe/Qwen3.6-27B-AutoRound-MTP-GGUF

27B • Updated 5 days ago • 833 • 3

SC117/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-APEX-GGUF

Image-Text-to-Text • Updated 17 days ago • 30.4k • 5

Abiray/Gemma-4-12B-it-AEON-Abliterated-K4-GGUF

Text Generation • 12B • Updated 13 days ago • 7.55k • 15

Reza2kn/Higgs-Audio-v3-TTS-4bit-MLX

Text-to-Speech • Updated 12 days ago • 316 • 3

SC117/Huihui-Nex-N2-mini-abliterated-APEX-GGUF

Image-Text-to-Text • 35B • Updated about 16 hours ago • 2

codelion/Qwen3-0.6B-accuracy-recovery-lora

Text Generation • Updated Jul 13, 2025 • 4.05k • 5

continuedev/instinct-GGUF

8B • Updated Sep 4, 2025 • 91 • 8

EricRollei/Hunyuan_Image_3_Int8

Text-to-Image • 83B • Updated Nov 27, 2025 • 5 • 3

coughmedicine/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-nvfp4

Updated Dec 13, 2025 • 74 • 2

pearsonkyle/Sharp-onnx

Image-to-3D • Updated Jan 17 • 3

tzervas/qwen2.5-coder-14b-bitnet-1.58b

Text Generation • 4B • Updated Jan 29 • 1.3k • 3

tzervas/qwen2.5-coder-32b-bitnet-1.58b

Text Generation • 9B • Updated Jan 29 • 683 • 3

EricRollei/HunyuanImage-3.0-Instruct-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 229 • 5

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8-v2

Text-to-Image • 83B • Updated Feb 22 • 62 • 7

caiovicentino1/polarquant-skills

Updated Apr 10 • 1

MJPansa/MiniMax-M2.7-REAP-172B-A10B-AutoRound-W4A16

Text Generation • 24B • Updated Apr 15 • 1.42k • 10

Abiray/Qwen3.6-35B-A3B-Q6_K-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 434 • 3

YTan2000/Qwen3.6-35B-A3B-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 18 • 1.01k • 79