Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

156

Base only

Active filters: GPTQ

AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C

Image-Text-to-Text • Updated Dec 22, 2025 • 30

AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P256-CTX384

Image-Text-to-Text • Updated Nov 18, 2025 • 16

AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P320-CTX448

Image-Text-to-Text • Updated Apr 10 • 15

ogulcanakca/Kumru-2B-EPDK-Instruct-GPTQ-4bit

Text Generation • 2B • Updated Nov 19, 2025 • 8

AXERA-TECH/Qwen3-1.7B-GPTQ-Int4

Text Generation • Updated Sep 19 • 23

AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-P1536-CTX2047

Image-Text-to-Text • Updated Dec 25, 2025 • 21

QuantTrio/GLM-4.7-GPTQ-Int4-Int8Mix

Text Generation • 390B • Updated Dec 29, 2025 • 65 • 4

AXERA-TECH/Qwen3-0.6B-GPTQ-Int4

Text Generation • Updated May 7 • 23

AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-C256-P3584-CTX4095

Image-Text-to-Text • Updated Mar 21 • 16

RESMP-DEV/GLM-4.7-Flash-Marlin-MMFP4

Text Generation • 5B • Updated Feb 8 • 14

tatsuyaaaaaaa/Qwen3-8B-GPTQ-W4A16

2B • Updated Mar 15 • 12

userresu2026/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated Mar 20 • 10

RafaDom/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-v2-GPTQ-Int4-HQ

9B • Updated Mar 21 • 28 • 3

RafaDom/Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-v2-GPTQ-Int4-HQ

4B • Updated Mar 21 • 19 • 1

AXERA-TECH/Qwen3.5-2B-AX650N-GPTQ-Int4-C128-P1152-CTX2047

Image-Text-to-Text • Updated May 19 • 29

AXERA-TECH/Qwen3.5-0.8B-AX650-GPTQ-Int4-C128-P1152-CTX2047

Image-Text-to-Text • Updated May 18 • 29

AXERA-TECH/Qwen3.5-4B-AX650-GPTQ-Int4-C128-P1152-CTX2047

Image-Text-to-Text • Updated May 6 • 38 • 1

lee5j/EXAONE-4.5-33B_GPTQ8

Text Generation • 34B • Updated Apr 11 • 9

lee5j/EXAONE-4.5-33B_GPTQ4

35B • Updated Apr 11 • 8

AXERA-TECH/Qwen3-4B-GPTQ-Int4

Text Generation • Updated May 7 • 17

AXERA-TECH/Qwen3.5-0.8B-AX650-GPTQ-Int4-C256-P6K-CTX8K

Image-Text-to-Text • Updated May 19 • 23

AXERA-TECH/Qwen3.5-4B-AX650-GPTQ-Int4-C256-P10K-CTX12K

Image-Text-to-Text • Updated May 19 • 31

AXERA-TECH/Qwen3.5-2B-AX650-GPTQ-Int4-C256-P6K-CTX8K

Image-Text-to-Text • Updated Aug 31 • 49 • 2

AXERA-TECH/Qwen3.5-0.8B-AX650-C256-P6K-CTX8K

Image-Text-to-Text • Updated May 20 • 11

pavanperi/Voxtral-Mini-4B-Realtime-2602_W4A16_G128

Automatic Speech Recognition • 4B • Updated Jun 15 • 39

AXERA-TECH/LocateAnything-3B

Zero-Shot Object Detection • Updated Jul 17 • 25 • 1

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-w4a16-g128-n256-s384

Text Generation • 4B • Updated Jul 8 • 11

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-w4a16-g128-n256-s1024

Text Generation • 4B • Updated Jul 8 • 15

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-w4a16-g128-n256-s2048

Text Generation • 4B • Updated Jul 8 • 12

meteorain/Qwen3-4B-Thinking-2507-llmc-gptq-w4a16-g128-n256-s4096

Text Generation • 4B • Updated Jul 8 • 12