Hugging Face's logo

prithivMLmods
/
Olmo-3-Think-AIO-GGUF

Text Generation
Transformers
GGUF
English
olmo3
text-generation-inference
llama.cpp
conversational
Model card Files
xet
Community
prithivMLmods commited on
Commit
3de6edf
·
verified ·
1 Parent(s): 91d1989

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +107 -1
README.md CHANGED
@@ -3,4 +3,110 @@ license: apache-2.0
3
  base_model:
4
  - allenai/Olmo-3-32B-Think
5
  - allenai/Olmo-3-7B-Think
6
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  base_model:
4
  - allenai/Olmo-3-32B-Think
5
  - allenai/Olmo-3-7B-Think
6
+ language:
7
+ - en
8
+ pipeline_tag: text-generation
9
+ library_name: transformers
10
+ tags:
11
+ - text-generation-inference
12
+ ---
13
+
14
+ # **Olmo-3-Think-AIO-GGUF**
15
+
16
+ > [Olmo-3-32B-Think and Olmo-3-7B-Think](https://huggingface.co/collections/allenai/olmo-3) are fully open-source dense language models from the Allen Institute for AI, designed for transparent step-by-step reasoning and agentic AI research with inspectable intermediate thought traces. Both models belong to the Olmo 3 family, which features Base, Instruct, and Think variants at the 7B and 32B scales, offering dense transformer architectures optimized for efficient training and long-context processing (up to 65,000 tokens for 32B). The Think models are post-trained to surface explicit reasoning chains, making them ideal for tasks requiring explanation, formal problem decomposition, math reasoning, code generation, and reinforcement learning research. Olmo-3-32B-Think leads open 32B-scale models on benchmarks for reasoning, math, and code, matching or exceeding top models like Qwen3-32B and Gemini-327B, while Olmo-3-7B-Think brings similar transparency and performance to a more hardware-friendly size with efficient long-context support, ensuring broad accessibility for both advanced research and practical deployment scenarios.
17
+
18
+ ## Olmo-3-32B-Think [GGUF]
19
+
20
+ | File Name | Quant Type | File Size | File Link |
21
+ | - | - | - | - |
22
+ | Olmo-3-32B-Think.BF16.gguf | BF16 | 64.5 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.BF16.gguf) |
23
+ | Olmo-3-32B-Think.F16.gguf | F16 | 64.5 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.F16.gguf) |
24
+ | Olmo-3-32B-Think.F32.gguf | F32 | 129 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.F32.gguf) |
25
+ | Olmo-3-32B-Think.IQ4_XS.gguf | IQ4_XS | 17.5 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.IQ4_XS.gguf) |
26
+ | Olmo-3-32B-Think.Q2_K.gguf | Q2_K | 12 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.Q2_K.gguf) |
27
+ | Olmo-3-32B-Think.Q3_K_L.gguf | Q3_K_L | 16.9 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.Q3_K_L.gguf) |
28
+ | Olmo-3-32B-Think.Q3_K_M.gguf | Q3_K_M | 15.6 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.Q3_K_M.gguf) |
29
+ | Olmo-3-32B-Think.Q3_K_S.gguf | Q3_K_S | 14.1 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.Q3_K_S.gguf) |
30
+ | Olmo-3-32B-Think.Q4_K_M.gguf | Q4_K_M | 19.5 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.Q4_K_M.gguf) |
31
+ | Olmo-3-32B-Think.Q4_K_S.gguf | Q4_K_S | 18.4 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.Q4_K_S.gguf) |
32
+ | Olmo-3-32B-Think.Q5_K_M.gguf | Q5_K_M | 22.9 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.Q5_K_M.gguf) |
33
+ | Olmo-3-32B-Think.Q5_K_S.gguf | Q5_K_S | 22.2 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.Q5_K_S.gguf) |
34
+ | Olmo-3-32B-Think.Q6_K.gguf | Q6_K | 26.4 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.Q6_K.gguf) |
35
+ | Olmo-3-32B-Think.Q8_0.gguf | Q8_0 | 34.3 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.Q8_0.gguf) |
36
+ | Olmo-3-32B-Think.i1-IQ1_M.gguf | i1-IQ1_M | 7.66 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-IQ1_M.gguf) |
37
+ | Olmo-3-32B-Think.i1-IQ1_S.gguf | i1-IQ1_S | 7 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-IQ1_S.gguf) |
38
+ | Olmo-3-32B-Think.i1-IQ2_M.gguf | i1-IQ2_M | 11 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-IQ2_M.gguf) |
39
+ | Olmo-3-32B-Think.i1-IQ2_S.gguf | i1-IQ2_S | 10.1 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-IQ2_S.gguf) |
40
+ | Olmo-3-32B-Think.i1-IQ2_XS.gguf | i1-IQ2_XS | 9.69 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-IQ2_XS.gguf) |
41
+ | Olmo-3-32B-Think.i1-IQ2_XXS.gguf | i1-IQ2_XXS | 8.76 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-IQ2_XXS.gguf) |
42
+ | Olmo-3-32B-Think.i1-IQ3_M.gguf | i1-IQ3_M | 14.5 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-IQ3_M.gguf) |
43
+ | Olmo-3-32B-Think.i1-IQ3_S.gguf | i1-IQ3_S | 14.1 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-IQ3_S.gguf) |
44
+ | Olmo-3-32B-Think.i1-IQ3_XS.gguf | i1-IQ3_XS | 13.4 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-IQ3_XS.gguf) |
45
+ | Olmo-3-32B-Think.i1-IQ3_XXS.gguf | i1-IQ3_XXS | 12.5 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-IQ3_XXS.gguf) |
46
+ | Olmo-3-32B-Think.i1-IQ4_XS.gguf | i1-IQ4_XS | 17.3 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-IQ4_XS.gguf) |
47
+ | Olmo-3-32B-Think.i1-Q2_K.gguf | i1-Q2_K | 12 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q2_K.gguf) |
48
+ | Olmo-3-32B-Think.i1-Q2_K_S.gguf | i1-Q2_K_S | 11.2 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q2_K_S.gguf) |
49
+ | Olmo-3-32B-Think.i1-Q3_K_L.gguf | i1-Q3_K_L | 16.9 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q3_K_L.gguf) |
50
+ | Olmo-3-32B-Think.i1-Q3_K_M.gguf | i1-Q3_K_M | 15.6 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q3_K_M.gguf) |
51
+ | Olmo-3-32B-Think.i1-Q3_K_S.gguf | i1-Q3_K_S | 14.1 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q3_K_S.gguf) |
52
+ | Olmo-3-32B-Think.i1-Q4_0.gguf | i1-Q4_0 | 18.3 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q4_0.gguf) |
53
+ | Olmo-3-32B-Think.i1-Q4_1.gguf | i1-Q4_1 | 20.3 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q4_1.gguf) |
54
+ | Olmo-3-32B-Think.i1-Q4_K_M.gguf | i1-Q4_K_M | 19.5 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q4_K_M.gguf) |
55
+ | Olmo-3-32B-Think.i1-Q4_K_S.gguf | i1-Q4_K_S | 18.4 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q4_K_S.gguf) |
56
+ | Olmo-3-32B-Think.i1-Q5_K_M.gguf | i1-Q5_K_M | 22.9 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q5_K_M.gguf) |
57
+ | Olmo-3-32B-Think.i1-Q5_K_S.gguf | i1-Q5_K_S | 22.2 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q5_K_S.gguf) |
58
+ | Olmo-3-32B-Think.i1-Q6_K.gguf | i1-Q6_K | 26.4 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.i1-Q6_K.gguf) |
59
+ | Olmo-3-32B-Think.imatrix.gguf | imatrix | 15 MB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-32B-Think.imatrix.gguf) |
60
+
61
+ ## Olmo-3-7B-Think [GGUF]
62
+
63
+ | File Name | Quant Type | File Size | File Link |
64
+ | - | - | - | - |
65
+ | Olmo-3-7B-Think.BF16.gguf | BF16 | 14.6 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.BF16.gguf) |
66
+ | Olmo-3-7B-Think.F16.gguf | F16 | 14.6 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.F16.gguf) |
67
+ | Olmo-3-7B-Think.F32.gguf | F32 | 29.2 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.F32.gguf) |
68
+ | Olmo-3-7B-Think.IQ4_XS.gguf | IQ4_XS | 4.03 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.IQ4_XS.gguf) |
69
+ | Olmo-3-7B-Think.Q2_K.gguf | Q2_K | 2.86 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.Q2_K.gguf) |
70
+ | Olmo-3-7B-Think.Q3_K_L.gguf | Q3_K_L | 3.95 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.Q3_K_L.gguf) |
71
+ | Olmo-3-7B-Think.Q3_K_M.gguf | Q3_K_M | 3.65 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.Q3_K_M.gguf) |
72
+ | Olmo-3-7B-Think.Q3_K_S.gguf | Q3_K_S | 3.3 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.Q3_K_S.gguf) |
73
+ | Olmo-3-7B-Think.Q4_K_M.gguf | Q4_K_M | 4.47 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.Q4_K_M.gguf) |
74
+ | Olmo-3-7B-Think.Q4_K_S.gguf | Q4_K_S | 4.25 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.Q4_K_S.gguf) |
75
+ | Olmo-3-7B-Think.Q5_K_M.gguf | Q5_K_M | 5.21 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.Q5_K_M.gguf) |
76
+ | Olmo-3-7B-Think.Q5_K_S.gguf | Q5_K_S | 5.08 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.Q5_K_S.gguf) |
77
+ | Olmo-3-7B-Think.Q6_K.gguf | Q6_K | 5.99 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.Q6_K.gguf) |
78
+ | Olmo-3-7B-Think.Q8_0.gguf | Q8_0 | 7.76 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.Q8_0.gguf) |
79
+ | Olmo-3-7B-Think.i1-IQ1_M.gguf | i1-IQ1_M | 1.94 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ1_M.gguf) |
80
+ | Olmo-3-7B-Think.i1-IQ1_S.gguf | i1-IQ1_S | 1.82 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ1_S.gguf) |
81
+ | Olmo-3-7B-Think.i1-IQ2_M.gguf | i1-IQ2_M | 2.68 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ2_M.gguf) |
82
+ | Olmo-3-7B-Think.i1-IQ2_S.gguf | i1-IQ2_S | 2.51 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ2_S.gguf) |
83
+ | Olmo-3-7B-Think.i1-IQ2_XS.gguf | i1-IQ2_XS | 2.32 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ2_XS.gguf) |
84
+ | Olmo-3-7B-Think.i1-IQ2_XXS.gguf | i1-IQ2_XXS | 2.14 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ2_XXS.gguf) |
85
+ | Olmo-3-7B-Think.i1-IQ3_M.gguf | i1-IQ3_M | 3.47 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ3_M.gguf) |
86
+ | Olmo-3-7B-Think.i1-IQ3_S.gguf | i1-IQ3_S | 3.3 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ3_S.gguf) |
87
+ | Olmo-3-7B-Think.i1-IQ3_XS.gguf | i1-IQ3_XS | 3.15 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ3_XS.gguf) |
88
+ | Olmo-3-7B-Think.i1-IQ3_XXS.gguf | i1-IQ3_XXS | 2.9 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ3_XXS.gguf) |
89
+ | Olmo-3-7B-Think.i1-IQ4_NL.gguf | i1-IQ4_NL | 4.22 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ4_NL.gguf) |
90
+ | Olmo-3-7B-Think.i1-IQ4_XS.gguf | i1-IQ4_XS | 4 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-IQ4_XS.gguf) |
91
+ | Olmo-3-7B-Think.i1-Q2_K.gguf | i1-Q2_K | 2.86 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q2_K.gguf) |
92
+ | Olmo-3-7B-Think.i1-Q2_K_S.gguf | i1-Q2_K_S | 2.64 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q2_K_S.gguf) |
93
+ | Olmo-3-7B-Think.i1-Q3_K_L.gguf | i1-Q3_K_L | 3.95 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q3_K_L.gguf) |
94
+ | Olmo-3-7B-Think.i1-Q3_K_M.gguf | i1-Q3_K_M | 3.65 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q3_K_M.gguf) |
95
+ | Olmo-3-7B-Think.i1-Q3_K_S.gguf | i1-Q3_K_S | 3.3 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q3_K_S.gguf) |
96
+ | Olmo-3-7B-Think.i1-Q4_0.gguf | i1-Q4_0 | 4.23 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q4_0.gguf) |
97
+ | Olmo-3-7B-Think.i1-Q4_1.gguf | i1-Q4_1 | 4.65 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q4_1.gguf) |
98
+ | Olmo-3-7B-Think.i1-Q4_K_M.gguf | i1-Q4_K_M | 4.47 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q4_K_M.gguf) |
99
+ | Olmo-3-7B-Think.i1-Q4_K_S.gguf | i1-Q4_K_S | 4.25 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q4_K_S.gguf) |
100
+ | Olmo-3-7B-Think.i1-Q5_K_M.gguf | i1-Q5_K_M | 5.21 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q5_K_M.gguf) |
101
+ | Olmo-3-7B-Think.i1-Q5_K_S.gguf | i1-Q5_K_S | 5.08 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q5_K_S.gguf) |
102
+ | Olmo-3-7B-Think.i1-Q6_K.gguf | i1-Q6_K | 5.99 GB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.i1-Q6_K.gguf) |
103
+ | Olmo-3-7B-Think.imatrix.gguf | imatrix | 4.59 MB | [Download](https://huggingface.co/prithivMLmods/Olmo-3-Think-AIO-GGUF/blob/main/Olmo-3-7B-Think.imatrix.gguf) |
104
+
105
+ ## Quants Usage
106
+
107
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
108
+
109
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
110
+ types (lower is better):
111
+
112
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)