SolidRusT Networks

company

Verified

https://solidrust.net

solidrust420

solidrust

AI & ML interests

Self-hosting, Open Source and AI Unalignment

Suparious

in solidrust/dolphin-2.8-mistral-7b-v02-AWQ 7 months ago

Performed my own Quantization, now encounter an error while running inference with vllm.

#1 opened 7 months ago by

ryan-rozanitis-bd

Suparious

updated 19 models over 1 year ago

solidrust/Llama-3-8B-Stroganoff-4.0-AWQ

Text Generation • 8B • Updated Sep 27, 2024

solidrust/Llama-3.1-8B-TitanFusion-Mix-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 2

solidrust/Llama-3.1-8B-TitanFusion-v3-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 2

solidrust/Fatgirl_v2_8B-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 5

solidrust/L3-Super-Nova-RP-8B-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 1

solidrust/L3-Umbral-Mind-RP-v0.3-8B-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 3

solidrust/Chili_Dog_8B-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 3

solidrust/L3-Luna-8B-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 3

solidrust/Magic_v2_8B-AWQ

Text Generation • 8B • Updated Sep 23, 2024 • 4

solidrust/Llama-3SOME-8B-v2-AWQ

Text Generation • 8B • Updated Sep 20, 2024 • 3

solidrust/gemma-2-9b-it-abliterated-AWQ

Text Generation • 10B • Updated Sep 20, 2024 • 2

solidrust/Gemma-2-Ataraxy-9B-AWQ

Text Generation • 10B • Updated Sep 20, 2024 • 2 • 1

solidrust/gemma-2-9b-it-SimPO-AWQ

Text Generation • 10B • Updated Sep 20, 2024 • 3 • 1

solidrust/Smoke_7B-AWQ

Text Generation • 8B • Updated Sep 20, 2024 • 2

solidrust/Magic_8B-AWQ

Text Generation • 8B • Updated Sep 19, 2024 • 7

solidrust/ChimeraLlama-3-8B-v3-AWQ

Text Generation • 8B • Updated Sep 19, 2024 • 2

solidrust/Llama-3.1-8B-TitanFusion-AWQ

Text Generation • 8B • Updated Sep 19, 2024

solidrust/LLama-3.1-8B-Matrix-AWQ

Text Generation • 8B • Updated Sep 19, 2024 • 4 • 1

solidrust/Gemma2-9B-TitanFusion-AWQ

Text Generation • 10B • Updated Sep 19, 2024 • 1