Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16

Base only

Active filters: target_bpw

eaddario/Apriel-1.6-15b-Thinker-GGUF

Image-Text-to-Text • 14B • Updated Jan 2 • 307 • 2

eaddario/GLM-4.6V-Flash-GGUF

Image-Text-to-Text • 9B • Updated Jan 2 • 161 • 4

eaddario/Olmo-3-7B-Instruct-GGUF

Text Generation • 7B • Updated Jan 2 • 440

eaddario/Olmo-3-7B-Think-GGUF

Text Generation • 7B • Updated Jan 2 • 325

eaddario/Ministral-3-14B-Instruct-2512-GGUF

Text Generation • 14B • Updated Feb 1 • 262

eaddario/Ministral-3-14B-Reasoning-2512-GGUF

Text Generation • 14B • Updated Feb 1 • 305

eaddario/Qwen3.5-4B-GGUF

Text Generation • 4B • Updated May 13 • 169

eaddario/Qwen3.5-9B-GGUF

Text Generation • 9B • Updated May 13 • 3.91k • 5

eaddario/gemma-4-E2B-it-GGUF

Any-to-Any • 5B • Updated May 13 • 148

eaddario/gemma-4-E4B-it-GGUF

Any-to-Any • 8B • Updated May 13 • 236

eaddario/gemma-4-26B-A4B-it-GGUF

Any-to-Any • 25B • Updated May 13 • 264

eaddario/Qwen3.6-27B-GGUF

Image-Text-to-Text • 27B • Updated May 13 • 384 • 4

eaddario/Qwen3.6-35B-A3B-GGUF

Image-Text-to-Text • 35B • Updated May 13 • 284 • 2

eaddario/granite-4.1-30b-GGUF

Text Generation • 29B • Updated May 13 • 54

eaddario/granite-4.1-8b-GGUF

Text Generation • 9B • Updated May 13 • 81

yrq985/gemma-4-E2B-it-GGUF

Any-to-Any • 5B • Updated May 20 • 114