GGUF
community
AI & ML interests
Our goal is to simplify the process of searching for and exchanging quantized models in GGUF format, as well as to create a space for efficient exchange and access to the models you need
-
itlwas/granite-3b-code-base-2k-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 16 -
itlwas/granite-3b-code-base-128k-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 6 -
itlwas/granite-3.0-1b-a400m-base-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 7 -
itlwas/granite-3.1-8b-base-Q4_K_M-GGUF
8B β’ Updated β’ 1
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 9 β’ 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 82 β’ 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation β’ 7B β’ Updated β’ 7 β’ 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 29 β’ 1
-
itlwas/EXAONE-Deep-2.4B-Q4_K_M-GGUF
Text Generation β’ 2B β’ Updated β’ 6 -
itlwas/EXAONE-Deep-7.8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 3 -
NikolayKozloff/EXAONE-Deep-2.4B-Q8_0-GGUF
Text Generation β’ 2B β’ Updated β’ 1 -
NikolayKozloff/EXAONE-Deep-7.8B-Q8_0-GGUF
Text Generation β’ 8B β’ Updated β’ 1 β’ 1
-
Triangle104/GWQ-9B-Preview2-Q4_K_S-GGUF
Text Generation β’ 9B β’ Updated β’ 7 -
Triangle104/GWQ-9B-Preview2-Q5_K_S-GGUF
Text Generation β’ 9B β’ Updated β’ 6 -
Triangle104/GWQ-9B-Preview2-Q5_K_M-GGUF
Text Generation β’ 9B β’ Updated β’ 4 β’ 1 -
Triangle104/GWQ-9B-Preview2-Q6_K-GGUF
Text Generation β’ 9B β’ Updated β’ 3
-
itlwas/Llama-Guard-3-8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 6 -
itlwas/Llama-Guard-3-1B-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 8 -
itlwas/shieldgemma-2b-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 1 -
itlwas/shieldgemma-9b-Q4_K_M-GGUF
Text Generation β’ 9B β’ Updated β’ 10
-
Triangle104/magnum-v4-22b-Q5_K_M-GGUF
Text Generation β’ 22B β’ Updated β’ 17 -
Triangle104/magnum-v4-12b-Q4_K_S-GGUF
Text Generation β’ 12B β’ Updated β’ 3 -
Triangle104/Cydonia-v1.3-Magnum-v4-22B-Q5_K_S-GGUF
22B β’ Updated β’ 9 β’ 1 -
Triangle104/magnum-v3-9b-chatml-Q4_K_M-GGUF
9B β’ Updated β’ 1
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 2 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 1 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 6 β’ 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 5
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 19 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B β’ Updated β’ 4 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation β’ 0.5B β’ Updated β’ 55 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation β’ 2B β’ Updated β’ 5
-
itlwas/Llama-3.1-Tulu-3-8B-DPO-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 6 -
itlwas/Llama-3.1-Tulu-3-8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 5 -
itlwas/Llama-3.1-Tulu-3-8B-SFT-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 12 -
itlwas/llama-3.1-tulu-2-8b-Q4_K_M-GGUF
8B β’ Updated β’ 20
-
matrixportalx/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 14 -
Triangle104/Rombos-Coder-V2.5-Qwen-14b-Q4_K_M-GGUF
Text Generation β’ 15B β’ Updated β’ 11 -
Triangle104/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF
Text Generation β’ 33B β’ Updated β’ 61 -
Triangle104/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 97
-
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 17 -
itlwas/granite-3.1-2b-base-Q4_K_M-GGUF
3B β’ Updated β’ 4 -
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 4 -
itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 6
-
Triangle104/UwU-7B-Instruct-abliterated-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 6 -
itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 6 β’ 1 -
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
2B β’ Updated β’ 5 -
itlwas/stable-code-instruct-3b-Q4_K_M-GGUF
3B β’ Updated β’ 12
-
itlwas/Vikhr-Llama-3.2-1B-Instruct-abliterated-Q4_K_M-GGUF
1B β’ Updated β’ 9 -
itlwas/Llama-3.2-Kapusta-JapanChibi-3B-v1-Q4_K_M-GGUF
4B β’ Updated β’ 6 β’ 1 -
itlwas/Llama-3.2-Kapusta-3B-v8-Q4_K_M-GGUF
4B β’ Updated β’ 2 β’ 1 -
itlwas/Llama-3.2-1B-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 2
-
itlwas/Phi-4-mini-instruct-Q4_K_M-GGUF
Text Generation β’ 4B β’ Updated β’ 39 -
itlwas/phi-1_5-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 8 β’ 1 -
itlwas/phi-1-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 1 -
itlwas/Phi-3-medium-128k-instruct-Q4_K_M-GGUF
Text Generation β’ 14B β’ Updated β’ 7
-
itlwas/granite-3b-code-base-2k-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 16 -
itlwas/granite-3b-code-base-128k-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 6 -
itlwas/granite-3.0-1b-a400m-base-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 7 -
itlwas/granite-3.1-8b-base-Q4_K_M-GGUF
8B β’ Updated β’ 1
-
itlwas/ChatWaifu_v1.3.1-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 9 β’ 2 -
itlwas/ChatWaifu_v1.4-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 82 β’ 3 -
itlwas/ChatWaifu_v1.0-Q4_K_M-GGUF
Text Generation β’ 7B β’ Updated β’ 7 β’ 1 -
itlwas/ChatWaifu_12B_v2.0-Q4_K_M-GGUF
Text Generation β’ 12B β’ Updated β’ 29 β’ 1
-
matrixportalx/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 14 -
Triangle104/Rombos-Coder-V2.5-Qwen-14b-Q4_K_M-GGUF
Text Generation β’ 15B β’ Updated β’ 11 -
Triangle104/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF
Text Generation β’ 33B β’ Updated β’ 61 -
Triangle104/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 97
-
itlwas/EXAONE-Deep-2.4B-Q4_K_M-GGUF
Text Generation β’ 2B β’ Updated β’ 6 -
itlwas/EXAONE-Deep-7.8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 3 -
NikolayKozloff/EXAONE-Deep-2.4B-Q8_0-GGUF
Text Generation β’ 2B β’ Updated β’ 1 -
NikolayKozloff/EXAONE-Deep-7.8B-Q8_0-GGUF
Text Generation β’ 8B β’ Updated β’ 1 β’ 1
-
Triangle104/GWQ-9B-Preview2-Q4_K_S-GGUF
Text Generation β’ 9B β’ Updated β’ 7 -
Triangle104/GWQ-9B-Preview2-Q5_K_S-GGUF
Text Generation β’ 9B β’ Updated β’ 6 -
Triangle104/GWQ-9B-Preview2-Q5_K_M-GGUF
Text Generation β’ 9B β’ Updated β’ 4 β’ 1 -
Triangle104/GWQ-9B-Preview2-Q6_K-GGUF
Text Generation β’ 9B β’ Updated β’ 3
-
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 17 -
itlwas/granite-3.1-2b-base-Q4_K_M-GGUF
3B β’ Updated β’ 4 -
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 4 -
itlwas/granite-3.1-3b-a800m-base-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 6
-
itlwas/Llama-Guard-3-8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 6 -
itlwas/Llama-Guard-3-1B-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 8 -
itlwas/shieldgemma-2b-Q4_K_M-GGUF
Text Generation β’ 3B β’ Updated β’ 1 -
itlwas/shieldgemma-9b-Q4_K_M-GGUF
Text Generation β’ 9B β’ Updated β’ 10
-
Triangle104/UwU-7B-Instruct-abliterated-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 6 -
itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 6 β’ 1 -
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
2B β’ Updated β’ 5 -
itlwas/stable-code-instruct-3b-Q4_K_M-GGUF
3B β’ Updated β’ 12
-
itlwas/Vikhr-Llama-3.2-1B-Instruct-abliterated-Q4_K_M-GGUF
1B β’ Updated β’ 9 -
itlwas/Llama-3.2-Kapusta-JapanChibi-3B-v1-Q4_K_M-GGUF
4B β’ Updated β’ 6 β’ 1 -
itlwas/Llama-3.2-Kapusta-3B-v8-Q4_K_M-GGUF
4B β’ Updated β’ 2 β’ 1 -
itlwas/Llama-3.2-1B-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 2
-
Triangle104/magnum-v4-22b-Q5_K_M-GGUF
Text Generation β’ 22B β’ Updated β’ 17 -
Triangle104/magnum-v4-12b-Q4_K_S-GGUF
Text Generation β’ 12B β’ Updated β’ 3 -
Triangle104/Cydonia-v1.3-Magnum-v4-22B-Q5_K_S-GGUF
22B β’ Updated β’ 9 β’ 1 -
Triangle104/magnum-v3-9b-chatml-Q4_K_M-GGUF
9B β’ Updated β’ 1
-
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 2 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 1 -
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B β’ Updated β’ 6 β’ 1 -
itlwas/Llama-3.1-Nemotron-Nano-8B-v1-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 5
-
itlwas/Phi-4-mini-instruct-Q4_K_M-GGUF
Text Generation β’ 4B β’ Updated β’ 39 -
itlwas/phi-1_5-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 8 β’ 1 -
itlwas/phi-1-Q4_K_M-GGUF
Text Generation β’ 1B β’ Updated β’ 1 -
itlwas/Phi-3-medium-128k-instruct-Q4_K_M-GGUF
Text Generation β’ 14B β’ Updated β’ 7
-
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 19 -
itlwas/QwQ-32B-Preview-Q4_K_M-GGUF
33B β’ Updated β’ 4 -
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation β’ 0.5B β’ Updated β’ 55 -
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation β’ 2B β’ Updated β’ 5
-
itlwas/Llama-3.1-Tulu-3-8B-DPO-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 6 -
itlwas/Llama-3.1-Tulu-3-8B-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 5 -
itlwas/Llama-3.1-Tulu-3-8B-SFT-Q4_K_M-GGUF
Text Generation β’ 8B β’ Updated β’ 12 -
itlwas/llama-3.1-tulu-2-8b-Q4_K_M-GGUF
8B β’ Updated β’ 20