ebircak/gemma-4-31B-it-4bit-W4A16-GPTQ
Text Generation • 32B • Updated • 21.3k • 2
Edit Models filters
Apps
Inference Providers
Active filters: llm-compressor
zdy1995love/Mistral-Medium-3.5-128B-NVFP4
Text Generation • 74B • Updated • 2.05k • 2
mratsim/MiniMax-M2.5-BF16-INT4-AWQ
Text Generation • 39B • Updated • 10.1k • 38
RedHatAI/Qwen3-Coder-Next-NVFP4
Text Generation • Updated • 48k • 27
Sehyo/Qwen3.5-122B-A10B-NVFP4
Image-Text-to-Text • 71B • Updated • 94.8k • 63
Sehyo/Qwen3.5-35B-A3B-NVFP4
Updated • 33.4k • 40
chankhavu/Nemotron-Cascade-2-30B-A3B-AWQ-INT4
5B • Updated • 3.3k • 5
RedHatAI/gemma-4-31B-it-FP8-block
Image-Text-to-Text • 31B • Updated • 225k • 18
RedHatAI/gemma-4-31B-it-NVFP4
Image-Text-to-Text • 20B • Updated • 176k • 34
dhruvil237/gemma-4-26B-A4B-it-W4A16
Image-Text-to-Text • 26B • Updated • 11.8k • 3
LittleNicky55/MiniMax-M2.7-abliterated-Heretic-FP8
Text Generation • 229B • Updated • 1.05k • 2
YuYu1015/Huihui-Qwen3.6-27B-abliterated-NVFP4
Text Generation • 19B • Updated • 220 • 1
RedHatAI/Qwen2.5-0.5B-quantized.w8a16
Text Generation • 0.4B • Updated • 6
RedHatAI/Qwen2.5-1.5B-quantized.w8a16
Text Generation • 0.8B • Updated • 157
RedHatAI/Qwen2.5-3B-quantized.w8a16
Text Generation • 1B • Updated • 10
RedHatAI/Qwen2.5-7B-quantized.w8a16
Text Generation • 3B • Updated • 5 • 1
RedHatAI/Qwen2.5-32B-quantized.w8a16
Text Generation • 9B • Updated • 24
RedHatAI/Qwen2.5-72B-quantized.w8a16
Text Generation • 20B • Updated • 6
RedHatAI/Qwen2.5-Coder-14B-Instruct-FP8-dynamic
Text Generation • 15B • Updated • 750 • 1
RedHatAI/Phi-4-mini-instruct-FP8-dynamic
Text Generation • 4B • Updated • 343
jsbaicenter/r1-1776-distill-llama-70b-FP8-Dynamic
Text Generation • 71B • Updated • 3 • 1
divish/M-Prometheus-3B-FP8-Dynamic
Text Generation • 3B • Updated • 6
textgeflecht/Devstral-Small-2505-FP8-llmcompressor
Text Generation • 24B • Updated • 5
ConfidentialMind/InternVL3-38B-FP8-Dynamic
Image-Text-to-Text • 38B • Updated • 88 • 2
textgeflecht/Qwen2.5-Coder-32B-Instruct-FP8-dynamic
Text Generation • 33B • Updated • 133
brandonbeiler/InternVL3-38B-FP8-Dynamic
Image-Text-to-Text • 38B • Updated • 8
brandonbeiler/InternVL3-78B-FP8-Dynamic
Image-Text-to-Text • 78B • Updated • 112
brandonbeiler/InternVL3-8B-FP8-Dynamic
Image-Text-to-Text • 8B • Updated • 8 • 2
RedHatAI/Qwen3-30B-A3B-FP8-block
Text Generation • 31B • Updated • 14.6k
JustJaro/SmolLM-135M-FP8-Static
Image-Text-to-Text • 0.2B • Updated • 9