Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

138

Base only

Active filters: claude

mondk/claude-sonnet5-qwen-thinking

Text Generation • 4B • Updated 1 day ago • 68 • 3

squ11z1/claude-oss-350m

Text Generation • 0.4B • Updated 27 days ago • 620 • 10

mondk/claude-sonnet5-base.llama3.2-3b-it

Text Generation • 3B • Updated 6 days ago • 88 • 2

mondk/claude-sonnet5-base.qwen2.5code3b-it

Text Generation • 3B • Updated 4 days ago • 68 • 2

mondk/super-like-claude-gguf-v2

Text Generation • 3B • Updated 4 days ago • 99 • 2

mondk/claude-sonnet-qwen2.5-7B-it

Text Generation • 8B • Updated 1 day ago • 11 • 2

mondk/small-like-claude-v2

Text Generation • 1B • Updated 3 days ago • 33 • 2

mondk/claude-llama-8B-think

Text Generation • 8B • Updated about 7 hours ago • 2

mondk/claude-llama-8B-think-GGuf

Text Generation • 8B • Updated about 7 hours ago • 2

mondk/claude.sonnet5-base.qwen3-VL-8b-it

Image-Text-to-Text • 8B • Updated 1 day ago • 2

mondk/claude-qwen3.vl.8b

9B • Updated about 7 hours ago • 2

empero-ai/Qwen3.5-9B-Claude-Opus-4.6-Distill

Text Generation • 9B • Updated Mar 15 • 22 • 4

empero-ai/Qwen3.5-9B-Claude-Opus-4.6-Distill-GGUF

9B • Updated Mar 15 • 2.43k • 3

ryzdfm/qwen2.5-coder-3b-claude_opus_4.6-distilled

Text Generation • 3B • Updated about 1 month ago • 8.02k • 16

josephmayo/Qwopus-9B-Unfettered-GGUF

9B • Updated May 30 • 97 • 8

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF

Text Generation • 8B • Updated 7 days ago • 92.7k • 4

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5

Text Generation • 8B • Updated 7 days ago • 1.55k • 4

AnkitAI/Parable-Qwen3-8B-Claude-Fable-5-GGUF

Text Generation • 8B • Updated 7 days ago • 119k • 1

mondk/claude-sonnet5-base.qwen2.5code1.5b-it

Text Generation • 2B • Updated 8 days ago • 72 • 6

ehristoforu/ReAssistant

Text Generation • Updated Nov 29, 2024

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q2_K-GGUF

Text Generation • 8B • Updated Jan 29, 2025 • 31

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q6_K-GGUF

Text Generation • 8B • Updated Jan 29, 2025 • 28

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q8_0-GGUF

Text Generation • 8B • Updated Jan 29, 2025 • 46 • 1

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q3_K_L-GGUF

Text Generation • 8B • Updated Jan 29, 2025 • 53 • 1

ayan4m1/Llama3.1-8B-Sonnet

Text Generation • 8B • Updated Feb 10, 2025 • 9 • 1

mradermacher/Llama3.1-8B-Sonnet-GGUF

8B • Updated Feb 11, 2025 • 157

ayan4m1/Claudette-7B

Text Generation • 7B • Updated Feb 13, 2025 • 6 • 2

mradermacher/Claudette-7B-GGUF

7B • Updated Feb 13, 2025 • 264 • 3

mradermacher/Claudette-7B-i1-GGUF

7B • Updated Feb 13, 2025 • 655 • 2

Delta-Vector/Rei-V2-12B

Text Generation • 12B • Updated Mar 31, 2025 • 15 • • 13