Inference Providers
Active filters: 5-bit
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
• 7B • Updated • 113k
• 140
mlx-community/LFM2-VL-3B-5bit
Image-Text-to-Text
• 0.9B • Updated • 21
• 1
mlx-community/NVIDIA-Nemotron-3-Super-120B-A12B-5bit
Text Generation
• 121B • Updated • 2.66k
• 2
catalystsec/gemma-4-26B-A4B-it-5bit-DWQ
Text Generation
• 25B • Updated • 765
• 1
deepsweet/Qwen3.6-35B-A3B-MLX-oQ5-FP16
Text Generation
• 7B • Updated • 3.09k
• 1
deepsweet/Qwen3.6-35B-A3B-MLX-oQ5
Text Generation
• 7B • Updated • 2.17k
• 2
deepsweet/Qwen3.6-27B-MLX-oQ5-FP16
Text Generation
• 5B • Updated • 1.13k
• 1
splats/Qwen3.6-35B-A3B-oQ5e
7B • Updated • 238
• 1
mlx-community/Ling-2.6-flash-mlx-5bit
Text Generation
• 104B • Updated • 416
• 1
Mori-e/gemma-4-26B-A4B-it-uncensored-oQ5-fp16
5B • Updated • 865
• 1
mavis-ai/Gemma4-31B-MLX-Q5
Image-Text-to-Text
• 8B • Updated • 449
• 1
zecanard/gemma-4-E2B-it-ultra-uncensored-heretic-MLX-5bit-int5-affine
Any-to-Any
• 2B • Updated • 41
• 1
zecanard/Qwopus3.6-35B-A3B-v1-MLX-5bit-int5-affine
Image-Text-to-Text
• 8B • Updated • 31
• 1
LoneStriker/Yi-6B-200K-5.0bpw-h6-exl2
Text Generation
• Updated • 12
Text Generation
• 3B • Updated • 344
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 1.11k
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 856
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 909
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 258
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 237
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 145
• 2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 135
• 2
MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 162
• 1
MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 109
• 1
MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 85
• 1
MaziyarPanahi/Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 85
• 1
MaziyarPanahi/Commonsense-QA-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 209
• 1
MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 444
• 6
MaziyarPanahi/finetuned-mistral-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 105
MaziyarPanahi/Mistral-7B-Instruct-guidance-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 127