inferencerlabs
/

openai-gpt-oss-120b-MLX-6.5bit

Text Generation

Model card Files Files and versions

inferencerlabs commited on Aug 6

Commit

0382ddb

·

verified ·

1 Parent(s): 1f6afe2

Upload complete model

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -7,7 +7,7 @@ tags:
 - mlx
 base_model: openai/gpt-oss-120b
 ---
-**See gpt-oss-120b 6.5bit MLX in action - [demonstration video](https://youtube.com/xcreate)**
 *q6.5bit quant typically achieves 1.128 perplexity in our testing which is equivalent to q8.*
 | Quantization | Perplexity |
@@ -23,4 +23,4 @@ base_model: openai/gpt-oss-120b
 * Built with a modified version of [MLX](https://github.com/ml-explore/mlx) 0.26
 * Memory usage: ~95 GB
 * Expect ~60 tokens/s
-* For more details see [demonstration video](https://youtube.com/xcreate) or visit [OpenAI gpt-oss-20b](https://huggingface.co/openai/gpt-oss-120b).

 - mlx
 base_model: openai/gpt-oss-120b
 ---
+**See gpt-oss-120b 6.5bit MLX in action - [demonstration video](https://youtu.be/mlpFG8e_fLw)**
 *q6.5bit quant typically achieves 1.128 perplexity in our testing which is equivalent to q8.*
 | Quantization | Perplexity |
 * Built with a modified version of [MLX](https://github.com/ml-explore/mlx) 0.26
 * Memory usage: ~95 GB
 * Expect ~60 tokens/s
+* For more details see [demonstration video](https://youtu.be/mlpFG8e_fLw) or visit [OpenAI gpt-oss-20b](https://huggingface.co/openai/gpt-oss-120b).