Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27

Base only

Active filters: w4a4

ussoewwin/Hybrid-Sensitivity-Weighted-Quantization-SDXL-fp8e4m3

Text-to-Image • Updated 6 days ago • 7

ucmp137538/Omega-QVLA-pi05-LIBERO-W4A4

Robotics • Updated 2 days ago • 1

zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w4a4

Text Generation • 8B • Updated Sep 3, 2024 • 5 • 1

JongYeop/Llama-3.1-8B-Instruct-NVFP4-W4A4

5B • Updated Jan 29 • 12

JongYeop/Llama-3.1-70B-Instruct-NVFP4-W4A4

41B • Updated Feb 2 • 6

JongYeop/Qwen2.5-VL-3B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 3B • Updated Feb 22 • 23

JongYeop/Qwen2.5-VL-7B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated Feb 22 • 2

JongYeop/Qwen2.5-VL-3B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 2B • Updated Mar 5 • 6

JongYeop/Qwen2.5-VL-7B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated Mar 5 • 42

nivvis/Qwen3.5-35B-A3B-heretic-v2-NVFP4

Image-Text-to-Text • Updated Mar 18 • 6

natfii/Qwen3.5-27B-NVFP4-Opus-GB10

Text Generation • 16B • Updated Apr 7 • 34 • 2

dervig/m51Lab-MiniMax-M2.7-REAP-139B-A10B-NVFP4-GB10

Text Generation • 79B • Updated Apr 17 • 1.36k • 3

Ex0bit/Qwen3.6-35B-A3B-PRISM-NVFP4

Text Generation • Updated May 3 • 181k • 19

YuYu1015/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4

Text Generation • Updated Apr 26 • 432 • 2

YuYu1015/Huihui-Qwen3.6-27B-abliterated-NVFP4

Text Generation • 19B • Updated Apr 26 • 432 • 1

BitsPlease/HiSQRot4

Text-to-Video • Updated 29 days ago

nerkyor/Lynn-V4-Pro-Distill-Qwen-35B-A3B-NVFP4-v8-RTN

Text Generation • 20B • Updated 23 days ago • 251

ultranationalism/nunchaku-z-image-turbo-svdq

Text-to-Image • Updated 13 days ago • 39

dangvansam/chandra-ocr-2-NVFP4

Image-Text-to-Text • 3B • Updated 11 days ago • 45

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-mse

21B • Updated 5 days ago • 75

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse-preview

21B • Updated 5 days ago • 54

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-mse-preview

20B • Updated 5 days ago • 181

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse

21B • Updated 5 days ago • 35

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-awqclip

20B • Updated 5 days ago • 87

coolthor/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4-W4A4

Image-Text-to-Text • 21B • Updated 4 days ago • 36

pebeto/Llama-3.1-70B-LatamGPT-SFT-1.0-NVFP4

Text Generation • 41B • Updated 3 days ago • 22

ucmp137538/Omega-QVLA-GR00T-N1.5-LIBERO-W4A4

Robotics • Updated 2 days ago