Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

70

Base only

Active filters: iq2_xxs

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated Aug 31 • 1.17M • 491

EigenLabs/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-MLX-IQ2

Text Generation • 11B • Updated 7 days ago • 1.78k • 9

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated Aug 3 • 332k • 226

autotrust/GLM-5.3-GGUF-DGX-Spark

Text Generation • 563B • Updated 12 days ago • 9.62k • 18

autotrust/GLM-5.3-Flash-GGUF-DGX-Spark

Text Generation • 279B • Updated 12 days ago • 38.5k • 27

CoreWolf/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated Aug 19 • 654 • 3

BattleGhost/Qwen3.8-Flash-Next-UNCENSORED-IQ2_XXS-GGUF

Text Generation • 177B • Updated Aug 30 • 50.4k • 6

DogContext/GLM-5.3-Flash-Uncensored-Q2-ds4

Text Generation • 321B • Updated Sep 21 • 6.82k • 16

audreyt/DeepSeek-V4.1-Flash-Abliterated-GGUF

755B • Updated about 9 hours ago • 61.6k • 11

UraionLabs/Nemotron-3.5-Bolt-74B-A9B-24GB-Metal-GGUF

Image-Text-to-Text • 74B • Updated 7 days ago • 959 • 1

bleysg/DeepSeek-V4-Flash-IQ2XXS-Q2K-FP8-120GB-target

Text Generation • 84B • Updated May 11 • 111 • 7

opensota/deepseek-v4-gguf

Text Generation • 284B • Updated May 12 • 130 • 2

jedisct1/DeepSeek-V4-Flash-imatrix-aligned

Text Generation • 284B • Updated May 13 • 10.3k • 5

dusterbloom/SR2AM-v1.0-30B-IQ2XXS-asym-GGUF

Text Generation • 31B • Updated May 24 • 36

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 226k • 146

zenlm/zen5-pro-gguf

Text Generation • 284B • Updated Jul 14 • 572 • 1

zenlm/zen5-max-gguf

Text Generation • 1.6T • Updated Jul 14 • 67 • 2

Keepser/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated May 31 • 161 • 2

rbinrs/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 14 • 195 • 2

kavenmartinez/Qwen3.6-27B-IQ2_XXS-webgpu-GGUF

Text Generation • 27B • Updated Jun 15 • 28

nahid37/deepseek-v4-gguf

Text Generation • 284B • Updated Jun 22 • 306

Ninnix96/Qwen3.6-35B-A3B-gguf

Text Generation • 35B • Updated Aug 2 • 530 • 2

eadx/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jul 5 • 136

wangyanwei123/deepseek-v4-gguf

Text Generation • 284B • Updated Jul 7 • 194

windy88/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jul 8 • 52

andreaborio/DeepSeek-V4-Flash-Hebrus-GGUF

Text Generation • Updated Aug 15 • 529 • 2

ox-ox/DeepSeek-V4-Flash-0731-gguf-ds4

Text Generation • 284B • Updated 15 days ago • 4k • 26

schlaflos/DeepSeek-V4-Flash-0731-antirez-ds4-GGUF

Text Generation • 20B • Updated Aug 1 • 87 • 10

apetersson/DeepSeek-V4-Flash-0731-Abliterated-DS4-Headroom128

Text Generation • 284B • Updated Aug 1 • 3.85k • 34

apetersson/DeepSeek-V4-Flash-0731-Abliterated-DS4-Quality128

Text Generation • 284B • Updated Aug 4 • 717 • 7