Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

226

Base only

Active filters: vLLM

Xingyu-Zheng/Qwopus3.5-27B-v3.5-INT4-FOEM

Image-Text-to-Text • 27B • Updated Apr 17 • 8 • 1

Xingyu-Zheng/Qwopus3.5-27B-v3.5-INT8-FOEM

Image-Text-to-Text • 27B • Updated Apr 17 • 6

Xingyu-Zheng/Qwopus3.5-9B-v3.5-INT4-FOEM

Image-Text-to-Text • 9B • Updated Apr 17 • 7 • 1

Xingyu-Zheng/Qwopus3.5-9B-v3.5-INT8-FOEM

Image-Text-to-Text • 9B • Updated Apr 17 • 6

Explyt/GLM-5-AWQ-pruned-20

Text Generation • 609B • Updated Apr 17 • 23

QuantTrio/MiniMax-M2.7-AWQ

Text Generation • 229B • Updated Apr 20 • 5.84k • 8

ClaudioItaly/Qwopus3.5-9B-v3-INT8-FOEM-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Apr 20 • 17

QuantTrio/GLM-5.1-AWQ

Text Generation • 754B • Updated Apr 21 • 298 • 9

selode-ai/Qwen-3.6-35B-A3B-VRAP-4-bit-AWQ-21.2GB

Image-Text-to-Text • 29B • Updated Jun 16 • 5.13k • 16

Explyt/GLM-5.1-AWQ

Text Generation • 754B • Updated Jun 24 • 28 • 1

QuantTrio/Qwen3.6-27B-AWQ

Image-Text-to-Text • 28B • Updated Apr 23 • 621k • 25

QuantTrio/Qwen3.6-27B-AWQ-6Bit

Image-Text-to-Text • 28B • Updated Apr 23 • 3.17k • 17

Xingyu-Zheng/Qwen3.6-27B-INT8-FOEM

Image-Text-to-Text • 27B • Updated Apr 24 • 9

Xingyu-Zheng/Qwen3.6-27B-INT4-FOEM

Image-Text-to-Text • 27B • Updated Apr 24 • 16

axolotl-ai-co/Mistral-Medium-3.5-128B-BF16

128B • Updated Apr 24 • 65

Xingyu-Zheng/Qwopus3.6-27B-v1-preview-INT4-FOEM

Image-Text-to-Text • 27B • Updated May 15 • 12 • 1

Xingyu-Zheng/Qwopus3.6-27B-v1-preview-INT8-FOEM

Image-Text-to-Text • 27B • Updated Apr 27 • 4 • 1

bartowski/mistralai_Mistral-Medium-3.5-128B-GGUF

Image-Text-to-Text • 125B • Updated May 4 • 2.27k • 10

NeuralNotwerk/Mistral-Medium-3.5-128B-NVFP4

74B • Updated May 9 • 360 • 10

olka-fi/Mistral-Medium-3.5-128B-MXFP4

Text Generation • 128B • Updated May 2 • 50 • 2

naruonenime/Mistral-Medium-3.5-128B

128B • Updated May 4 • 6

cyankiwi/Mistral-Medium-3.5-128B-AWQ-INT4

25B • Updated Jul 21 • 911 • 5

mradermacher/Mistral-Medium-3.5-128B-GGUF

125B • Updated May 9 • 371 • 1

Sav868767876-9999999876654346/Mistral-Medium-3.5-128B

128B • Updated May 8 • 12

mradermacher/Mistral-Medium-3.5-128B-i1-GGUF

125B • Updated May 9 • 1.02k

clemsail/qwen3.5-27b-opus-awq

Image-Text-to-Text • 28B • Updated May 11 • 3

gsting/Qwen3-VL-235B-A22B-Instruct-AWQ

Text Generation • 236B • Updated May 12 • 14

tema18/Mistral-Medium-3.5-128B

128B • Updated May 17 • 6

inferencerlabs/Mistral-Medium-3.5-MLX-Q9

Image-Text-to-Text • Updated Jun 27 • 234 • 1

Flaxyditto/FlaxyDitto-Bot

Text Generation • 7B • Updated May 23 • 7