-
-
-
-
-
-
Inference Providers
Active filters:
6-bit
mlx-community/GLM-4.7-Flash-6bit
Text Generation
•
30B
•
Updated
•
7.54k
•
5
MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF
Text Generation
•
2B
•
Updated
•
141k
•
10
MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF
Text Generation
•
12B
•
Updated
•
69.3k
•
2
MaziyarPanahi/Phi-3.5-mini-instruct-GGUF
Text Generation
•
4B
•
Updated
•
167k
•
25
MaziyarPanahi/Qwen2.5-0.5B-Instruct-GGUF
Text Generation
•
0.5B
•
Updated
•
101
•
2
ordis-co-ltd/Qwen2.5-VL-72B-Instruct_exl2_6.0bpw
Image-Text-to-Text
•
Updated
•
3
•
3
MaziyarPanahi/gemma-3-4b-it-GGUF
Text Generation
•
4B
•
Updated
•
187k
•
18
dphn/Dolphin-Llama3-8B-Instruct-exl2-6bpw
Updated
•
14
•
14
MaziyarPanahi/Qwen3-1.7B-GGUF
Text Generation
•
2B
•
Updated
•
215k
•
6
MaziyarPanahi/Qwen3-8B-GGUF
Text Generation
•
8B
•
Updated
•
214k
•
8
MaziyarPanahi/Qwen3-4B-GGUF
Text Generation
•
4B
•
Updated
•
221k
•
7
mlx-community/Qwen3-0.6B-6bit
Text Generation
•
Updated
•
253
•
1
MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF
Text Generation
•
8B
•
Updated
•
143k
•
7
mlx-community/VibeVoice-Realtime-0.5B-6bit
Text-to-Speech
•
0.3B
•
Updated
•
37
•
1
mlx-community/GLM-4.7-6bit
Text Generation
•
353B
•
Updated
•
8.39k
•
1
lmstudio-community/GLM-4.7-Flash-MLX-6bit
Text Generation
•
30B
•
Updated
•
415k
•
2
arcee-ai/Trinity-Nano-Preview-MLX-6bit
Text Generation
•
1B
•
Updated
•
91
•
4
inferencerlabs/GLM-4.7-Flash-MLX-6.5bit
Text Generation
•
30B
•
Updated
•
439
•
2
mlx-community/Qwen3-TTS-12Hz-0.6B-Base-6bit
Text-to-Speech
•
0.5B
•
Updated
•
211
•
1
mlx-community/Qwen3-TTS-12Hz-1.7B-VoiceDesign-6bit
Text-to-Speech
•
0.7B
•
Updated
•
183
•
1
DeathGodlike/DarkArtsForge_Avnas-7B-v1_EXL3
Text Generation
•
Updated
•
1
•
1
mlx-community/Josiefied-LFM2.5-1.2B-Instruct-abliterated-6bit
Text Generation
•
0.3B
•
Updated
•
16
•
1
mlx-community/SERA-32B-6bit
Text Generation
•
Updated
•
15
•
1
mlx-community/Jan-v3-4B-base-instruct-6bit
Text Generation
•
0.9B
•
Updated
•
20
•
1
mlx-community/LongCat-Flash-Lite-6bit
Text Generation
•
69B
•
Updated
•
5
•
1
LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2
Text Generation
•
Updated
•
1
Text Generation
•
3B
•
Updated
•
477
•
6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
91
•
6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
56
•
4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
•
7B
•
Updated
•
65
•
5