Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

423

Base only

Active filters: 8bit

Deepak7376/DeepSeek-R1-Distill-Qwen-1.5B-bnb-8bit

Text Generation • 2B • Updated Feb 26, 2025 • 5 • 1

Lowkey-Loki/OlympicCoder-7B-mlx-8bit

8B • Updated Mar 12, 2025 • 11

Tonic/c4ai-command-a-03-2025-4bit_nf4_double

Text Generation • 114B • Updated Mar 13, 2025 • 22

Tonic/c4ai-command-a-03-2025-4bit_fp4

Text Generation • 113B • Updated Mar 13, 2025 • 297

Tonic/c4ai-command-a-03-2025-4bit_nf4_no_double

Text Generation • 113B • Updated Mar 13, 2025 • 21

adriabama06/ReaderLM-v2-GPTQ-8bit

Text Generation • Updated Mar 18, 2025 • 11 • 1

TheCluster/gemma-3-27b-it-uncensored-mlx-8bit

Image-Text-to-Text • 29B • Updated Apr 16, 2025 • 44 • 1

btbtyler09/Llama-3.3-70B-Instruct-gptq-8bit

Text Generation • 71B • Updated Apr 12, 2025 • 15

adriabama06/Llama-OuteTTS-1.0-1B-GPTQ-8bit

Text-to-Speech • Updated Apr 7, 2025 • 5 • 1

btbtyler09/cogito-v1-preview-qwen-32B-gptq-8bit

Text Generation • 33B • Updated Apr 12, 2025 • 6 • 1

adriabama06/DeepCoder-1.5B-Preview-GPTQ-8bit

Text Generation • Updated Apr 13, 2025 • 5 • 1

JWMD/cogito-v1-preview-qwen-32B-GPTQ-8bit-fixed-tokenizer

Text Generation • 33B • Updated Apr 19, 2025 • 73

TheCluster/amoral-gemma-3-4B-v2-mlx-8bit

Image-Text-to-Text • 5B • Updated Apr 16, 2025 • 18 • 2

TheCluster/amoral-gemma-3-12B-v2-mlx-8bit

Image-Text-to-Text • Updated Apr 16, 2025 • 12 • 1

TheCluster/amoral-gemma-3-27B-v2-mlx-8bit

Image-Text-to-Text • Updated Apr 16, 2025 • 15 • 2

btbtyler09/Qwen3-30B-A3B-gptq-8bit

Text Generation • 31B • Updated May 2, 2025 • 13 • 3

speakleash/Bielik-1.5B-v3.0-Instruct-FP8-Dynamic

Text Generation • 2B • Updated Jan 28 • 369 • 2

speakleash/Bielik-4.5B-v3.0-Instruct-FP8-Dynamic

Text Generation • 5B • Updated Jan 28 • 772 • 5

Jayway0910/clip-lora-multilabel

Image Classification • Updated May 24, 2025 • 1

martinctl/MNLP_M2_quantized_model

Text Generation • 0.6B • Updated May 27, 2025 • 8

speakleash/Bielik-11B-v2.6-Instruct-FP8-Dynamic

Text Generation • 11B • Updated Jul 10, 2025 • 368 • 4

speakleash/Bielik-11B-v2.5-Instruct-FP8-Dynamic

Text Generation • 11B • Updated Jun 6, 2025 • 32 • 2

Hariprasath28/orpheus-3b-8bit-gptq

Text Generation • Updated Jun 10, 2025 • 33 • 1

cello78/sambanova-llama2-100-gguf-q8

Text Generation • 7B • Updated Jun 14, 2025 • 8

btbtyler09/Kimi-Dev-72B-GPTQ-8bit

Text Generation • 73B • Updated Jun 18, 2025 • 80 • 1

adriabama06/GLM-4-9B-0414-exl3

Text Generation • Updated Jun 23, 2025 • 5 • 1

adamrb/mpt-30b-chat-w8a8-gptq

30B • Updated Jul 15, 2025 • 5

Irfanuruchi/Llama-3.2-1B-Computer-Engineering-LLM

1B • Updated Nov 24, 2025 • 37

VincentGOURBIN/voxtral-small-8bit

Automatic Speech Recognition • 25B • Updated Jul 31, 2025 • 17

Hariprasath28/orpheus-3b-multi-gptq-8bit

Text Generation • Updated Sep 3, 2025 • 5