Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

724

Base only

Active filters: q4_k_m

higa2515/Qwen3.8-27B-QSA-GGUF

Image-Text-to-Text • 27B • Updated 6 days ago • 11.2k • 27

Sakura721/DeepSeek-V4-Pro-Qwen3.5-9B-UNCENSORED-heretic-GGUF

Image-Text-to-Text • 9B • Updated 4 days ago • 25.1k • 13

SolsticeAI/Nanbeige4.3-33B-GGUF-UltraOptimised-Curated-Protium

Text Generation • 33B • Updated 14 days ago • 714 • 4

NotCherry/Qwen3.5-0.8B-weight-space-programming-GGUF

Image-Text-to-Text • 0.8B • Updated 8 days ago • 1.58k • 3

theLittleStone/Qwen3.6-27B-AEON-Ultimate-Uncensored-MTP-GGUF

Text Generation • 27B • Updated Jul 5 • 1.32k • 5

soyaakinohara/Spark-X2.5-4B-Heretic-jp-gguf

Text Generation • 4B • Updated Sep 18 • 575k • 22

nace-ai/drex-v2.0-Q4_K_M

35B • Updated 12 days ago • 223 • 4

OpenIntelligenceNet/LFM3-1.7B-Uncensored-Extreme-GGUF

Text Generation • 2B • Updated 13 days ago • 2.45k • 3

Felladrin/gguf-Q4_K_M-Comet-60B-A12B

Text Generation • 60B • Updated 1 day ago • 409 • 2

pbhappliedsystems/qwen-2.5-3B-instruct-gguf-Q4-K-M

3B • Updated Sep 30 • 1.23k • 4

Jiunsong/SuperGemma-4-12b-abliterated-gguf-4bit

Text Generation • 12B • Updated Jun 25 • 772 • 15

rafw007/ornith-1.0-9b-claude-coder

Text Generation • Updated Jun 27 • 5

emrevrg/Norovox-Nythos-27B-GGUF

Text Generation • 27B • Updated 21 days ago • 115 • 1

BoldingBuilds/Abliterated-MiMo-V2.6-Distill-Qwen-9B-GGUF

Text Generation • 9B • Updated Sep 23 • 16.5k • 11

interimlabs/InterimLabs-Huihui-Qwen3.5-9B-abliterated-GGUF-Q4_K_M

Text Generation • 9B • Updated Oct 8 • 4.63k • 2

aikexue170/rewrite2-4b-gguf

Text Generation • 4B • Updated 17 days ago • 656 • 2

OpenIntelligenceNet/Spark-X2.6-1.7B-Abliterated-GGUF

Text Generation • 2B • Updated 11 days ago • 764 • 2

vmlinux/Artemis-31B-v1.2-Q4_K_M-NInfer

Text Generation • Updated 1 day ago • 6 • 1

oktaydu/Q36-35B-A3B-Opus4.7-Ablit-Heretic-OBLITERATUS-Hermes-MTP-Vision-Ollama

Image-Text-to-Text • 0.4B • Updated Sep 7 • 1.34k • 4

afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-GGUF

1B • Updated Nov 4, 2023 • 159

afrideva/tinyllama-colorist-v2-GGUF

Text Generation • 1B • Updated Nov 4, 2023 • 67

afrideva/stablelm-3b-4e1t-GGUF

Text Generation • 3B • Updated Nov 5, 2023 • 578

afrideva/tiny-llama-miniguanaco-1.5T-GGUF

Text Generation • 1B • Updated Nov 6, 2023 • 381

afrideva/Hermes-Trismegistus-Mistral-7B-GGUF

Text Generation • 7B • Updated Nov 5, 2023 • 476

afrideva/TinyLlama-1.1B-alpaca-chat-v1.5-GGUF

Text Generation • 1B • Updated Nov 6, 2023 • 160 • 2

afrideva/bling-sheared-llama-1.3b-0.1-GGUF

Text Generation • 1B • Updated Nov 6, 2023 • 540 • 1

afrideva/bling-sheared-llama-2.7b-0.1-GGUF

Text Generation • 3B • Updated Nov 6, 2023 • 446

afrideva/Tiny-Llama-openhermes-1.1B-step-715k-1.5T-GGUF

Text Generation • 1B • Updated Nov 8, 2023 • 355 • 4

afrideva/TinyLlama-1.1B-intermediate-1.5T-PTBR-Instruct-v0-GGUF

Text Generation • 1B • Updated Nov 8, 2023 • 377

afrideva/TinyLlama-1.1B-intermediate-1.5T-PTBR-Instruct-v1-GGUF

Text Generation • 1B • Updated Nov 8, 2023 • 108 • 1