Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

1,068

Base only

Active filters: llama-3.1

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated 5 days ago • 276

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 320k • 95

DavidAU/Llama-3.1-128k-Dark-Planet-Uncensored-8B-GGUF

Text Generation • 8B • Updated 5 days ago • 4.97k • 22

DuoNeural/Llama-3.1-8B-Instruct-GTAP-v3-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 29 • 123 • 1

JhCIFT/Llama-3.1-8B-Instruct-CIRF-Backward-Greedy-6

Text Generation • 8B • Updated 5 days ago • 276 • 1

akazidane/Llama-3.1-8B-Instruct-Math-Reasoner-4bit

Text Generation • 8B • Updated 6 days ago • 426 • 1

sungjuncho/Llama-3.1-8B-Instruct-TOFU-para-x2-full-seed2

Text Generation • 8B • Updated about 5 hours ago • 1

DavidAU/L3.1-Dark-Reasoning-Dark-Planet-Hermes-R1-Uncensored-Horror-Imatrix-MAX-8B-GGUF

Text Generation • 8B • Updated 5 days ago • 2k • 10

sinhal/SageV2-8B-LongContext-NSFW-RP

Text Generation • 8B • Updated 2 days ago • 12.2k • 37

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • 410B • Updated Sep 13, 2024 • 674 • 38

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • 71B • Updated Aug 7, 2024 • 44.6k • 111

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • 410B • Updated Aug 7, 2024 • 99 • 17

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4

Text Generation • 418B • Updated Sep 16, 2024 • 110 • 2

hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4

Text Generation • 423B • Updated Sep 16, 2024 • 24 • 5

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • 8B • Updated Aug 8, 2024 • 164 • 8

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4

Text Generation • 8B • Updated Aug 8, 2024 • 18 • 1

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • 8B • Updated Jul 29, 2024 • 3.03k • 4

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 2.84k • 2

ModelCloud/Meta-Llama-3.1-8B-gptq-4bit

Text Generation • 8B • Updated Jul 26, 2024 • 45

ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation • 71B • Updated Jul 27, 2024 • 23 • 4

ValiantLabs/Llama3.1-8B-Fireplace2

Text Generation • 8B • Updated Mar 12, 2025 • 74 • • 6

vicgalle/Configurable-Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 24, 2024 • 52 • • 16

OpenBuddy/openbuddy-llama3.1-8b-v22.1-131k

Text Generation • 8B • Updated Jul 24, 2024 • 14 • • 5

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • 71B • Updated Aug 7, 2024 • 875 • 23

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 8B • Updated Aug 7, 2024 • 1.46k • 42

sunnyyy/openbuddy-llama3.1-8b-v22.1-131k-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 223

jburmeister/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • 71B • Updated Jul 25, 2024 • 5

jburmeister/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • 410B • Updated Jul 25, 2024 • 10

azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16

Text Generation • 2B • Updated Aug 28, 2024 • 26 • 13

mudler/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 216