Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

43,039

Full-text search

Active filters: 4-bit

z-lab/Qwen3.5-9B-PARO

Image-Text-to-Text • 3B • Updated about 7 hours ago • 8.24k • 35

mlx-community/Qwen3.5-9B-MLX-4bit

2B • Updated 13 days ago • 80.4k • 48

mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-4bit

27B • Updated 10 days ago • 11.9k • 25

QuantTrio/Qwen3.5-27B-AWQ

Image-Text-to-Text • 28B • Updated 14 days ago • 206k • 20

z-lab/Qwen3.5-4B-PARO

Image-Text-to-Text • 1B • Updated about 7 hours ago • 1.65k • 13

Kbenkhaled/Qwen3.5-27B-NVFP4

Image-Text-to-Text • 17B • Updated 16 days ago • 20.7k • 20

Qwen/Qwen3.5-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated 12 days ago • 231k • 46

mlx-community/Qwen3.5-27B-4bit

Image-Text-to-Text • 5B • Updated 19 days ago • 39.4k • 34

mlx-community/Qwen3.5-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated 19 days ago • 36.4k • 22

QuantTrio/Qwen3.5-122B-A10B-AWQ

Image-Text-to-Text • 125B • Updated 17 days ago • 34.2k • 16

Qwen/Qwen3.5-122B-A10B-GPTQ-Int4

Image-Text-to-Text • 125B • Updated 12 days ago • 83.9k • 23

Qwen/Qwen3.5-27B-GPTQ-Int4

Image-Text-to-Text • 28B • Updated 12 days ago • 140k • 24

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.8B • Updated 11 days ago • 3.36k • 8

Intel/Step-3.5-Flash-int4-mixed-AutoRound

Text Generation • 28B • Updated 1 day ago • 280 • 5

z-lab/Qwen3.5-27B-PARO

Image-Text-to-Text • 6B • Updated 1 day ago • 137 • 5

Intel/Qwen3-Coder-Next-int4-AutoRound

Text Generation • 12B • Updated Feb 10 • 11.9k • 18

Intel/Qwen3.5-9B-int4-AutoRound

4B • Updated 10 days ago • 12.6k • 17

Intel/Qwen3.5-27B-int4-AutoRound

7B • Updated 10 days ago • 6.65k • 5

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 10 days ago • 4.55k • 12

baicai1145/s2-pro-w4a16

Text-to-Speech • 5B • Updated 5 days ago • 146 • 4

inferencerlabs/NVIDIA-Nemotron-3-Super-120B-A12B-MLX-4.5bit

Text Generation • 121B • Updated 1 day ago • 1.84k • 4

inferencerlabs/Qwen3.5-27B-MLX-4.5bit

Text Generation • 27B • Updated 15 days ago • 1.14k • 3

saricles/MiniMax-M2.5-REAP-172B-A10B-NVFP4-GB10

Text Generation • 98B • Updated 14 days ago • 732 • 4

mlx-community/Qwen3.5-0.8B-OptiQ-4bit

Text Generation • 0.2B • Updated 11 days ago • 1.55k • 3

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • 9B • Updated Feb 27, 2025 • 792 • 78

unsloth/Qwen2.5-Coder-7B-bnb-4bit

Text Generation • 8B • Updated Nov 12, 2024 • 9.41k • 16

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 31B • Updated May 21, 2025 • 105k • 49

mlx-community/Qwen3-Coder-30B-A3B-Instruct-4bit

Text Generation • Updated Aug 6, 2025 • 2.4k • 14

mlx-community/gpt-oss-20b-MXFP4-Q8

Text Generation • Updated Aug 29, 2025 • 542k • 36

openguardrails/OpenGuardrails-Text-2510

Text Generation • 15B • Updated Feb 2 • 2.47k • 9