Inference Providers
Active filters: 8bit
mlx-community/NVIDIA-Nemotron-3.5-Bolt-E4B-OptiQ-4bit
Image-Text-to-Text
• 7B • Updated • 779
• 7
mlx-community/Sage-A1.5-OptiQ-4bit
Image-Text-to-Text
• 35B • Updated • 669
• 5
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation
• 9B • Updated • 6.5k
• 109
mlx-community/Spark-X2.6-4B-OptiQ-4bit
Text Generation
• 4B • Updated • 294
• 3
mlx-community/Astrea-R8-Chat-9B-OptiQ-4bit
Image-Text-to-Text
• 9B • Updated • 175
• 2
mlx-community/Qwen3.5-9B-MLX-8bit
9B • Updated • 1.46k
• 17
TheCluster/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-MLX-8bit
Image-Text-to-Text
• 9B • Updated • 790
• 6
jwindle47/chandra-ocr-2-8bit-mlx
Image-Text-to-Text
• 5B • Updated • 503
• 4
mlx-community/Qwen3.6-27B-OptiQ-4bit
Text Generation
• 27B • Updated • 3.47k
• 82
mlx-community/gemma-4-12B-it-OptiQ-4bit
Text Generation
• 12B • Updated • 2.9k
• 56
deer-sec/CyberStag-Security-26B-A4B-V1-Q8_0-GGUF
Text Generation
• 25B • Updated • 151
• 3
bumblebuttpow/MiniCPM5-2B-heretic-abliterated-MLX-8bit
3B • Updated • 115
• 1
mlx-community/humanizer-12b-OptiQ-4bit
Text Generation
• 12B • Updated • 934
• 6
adityapanda2608112/Panda-Image-Pro
Text-to-Image
• 5B • Updated • 27
• 1
crumb/gpt-j-6b-finetune-super-glue
Text Generation
• Updated • 22
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation
• 6B • Updated • 42
• 7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation
• 6B • Updated • 44
• 5
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation
• Updated • 19
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation
• Updated • 39
• 4
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization
• 3B • Updated • 25
ethzanalytics/open_llama_13b-sharded-8bit
Text Generation
• Updated • 13
richardr1126/spider-skeleton-wizard-coder-8bit
Text Generation
• Updated • 22
• 1
Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit
Text Generation
• 7B • Updated • 35
• 7
Trelis/mpt-7b-instruct-hosted-inference-8bit
Text Generation
• Updated • 30
ecastera/eva-mistral-catmacaroni-7b-spanish
Text Generation
• 7B • Updated • 15
• 3
ecastera/eva-mistral-turdus-7b-spanish
Text Generation
• 7B • Updated • 13
ecastera/eva-mistral-7b-spanish-GGUF
7B • Updated • 97
• 11
BioMistral/BioMistral-7B-BnB.8
Text Generation
• 7B • Updated • 27
alokabhishek/Llama-2-7b-chat-hf-bnb-8bit
Text Generation
• 7B • Updated • 15
• 2
alokabhishek/Mistral-7B-Instruct-v0.2-bnb-8bit
Text Generation
• 7B • Updated • 17
• 2