nf4 llm - a roshniramesh Collection

roshniramesh 's Collections

nf4 llm

fp8 llm

nf4 llm

updated Jan 16

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4

Text Generation • 8B • Updated Aug 8, 2024 • 71 • 1
hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • 8B • Updated Aug 8, 2024 • 458 • 8
hugging-quants/Meta-Llama-3.1-8B-BNB-NF4-BF16

Text Generation • 3B • Updated Jul 28, 2024 • 50
hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16

Text Generation • 21B • Updated Aug 8, 2024 • 30 • 2