The Kaitchup

company

https://kaitchup.substack.com/

bnjmn_marie

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

bnjmnmarie new activity about 3 hours ago

kaitchup/Olmo-3.1-32B-Instruct-fp8-dynamic:Error running vllm 12

bnjmnmarie updated a model about 3 hours ago

kaitchup/Olmo-3.1-32B-Instruct-fp8-dynamic

bnjmnmarie updated a collection about 7 hours ago

Quantized Qwen3 2512

View all activity

kaitchup 's models 362

kaitchup/Qwen2-0.5B-Instruct-gptq-8bit

Text Generation • 0.5B • Updated Jun 11, 2024

kaitchup/Qwen2-0.5B-Instruct-gptq-4bit

Text Generation • 0.5B • Updated Jun 11, 2024

kaitchup/Qwen2-0.5B-Instruct-gptq-3bit

Text Generation • 0.5B • Updated Jun 11, 2024

kaitchup/Qwen2-0.5B-Instruct-gptq-2bit

Text Generation • 0.5B • Updated Jun 11, 2024

kaitchup/Qwen2-0.5B-Instruct-bnb-4bit

Text Generation • 0.5B • Updated Jun 11, 2024

kaitchup/Qwen2-0.5B-gptq-8bit

Text Generation • 0.5B • Updated Jun 11, 2024

kaitchup/Qwen2-0.5B-gptq-4bit

Text Generation • 0.5B • Updated Jun 11, 2024

kaitchup/Qwen2-0.5B-gptq-3bit

Text Generation • 0.5B • Updated Jun 11, 2024

kaitchup/Qwen2-0.5B-bnb-4bit

Text Generation • 0.5B • Updated Jun 11, 2024

kaitchup/Qwen2-0.5B-gptq-2bit

Text Generation • 0.5B • Updated Jun 11, 2024

kaitchup/Llama-3-70B-2.18bpw-exl2

Text Generation • Updated May 5, 2024 • 2

kaitchup/Llama-3-70B-2.5bpw-exl2

Text Generation • Updated May 5, 2024 • 2

kaitchup/Llama-3-70B-3.0bpw-exl2

Text Generation • Updated May 5, 2024 • 5

kaitchup/Llama-3-70B-3.5bpw-exl2

Text Generation • Updated May 5, 2024 • 4

kaitchup/Llama-3-70B-4.0bpw-exl2

Text Generation • Updated May 5, 2024 • 3

kaitchup/Meta-Llama-3-8B-gptq-2bit

Text Generation • 8B • Updated May 4, 2024 • 3

kaitchup/Meta-Llama-3-8B-gptq-3bit

Text Generation • 8B • Updated May 4, 2024 • 2

kaitchup/Meta-Llama-3-8B-gptq-4bit

Text Generation • 8B • Updated May 4, 2024 • 4

kaitchup/Meta-Llama-3-8B-gptq-8bit

Text Generation • 8B • Updated May 4, 2024 • 5

kaitchup/OpenELM-270M-oasstguanaco-2e-ORPO

Text Generation • 0.3B • Updated May 2, 2024 • 8 • 1

kaitchup/Llama-3-8b-awq-4bit

Text Generation • 8B • Updated Apr 29, 2024 • 8

kaitchup/Llama-3-8B-llm2vec-Emb

8B • Updated Apr 29, 2024 • 24 • 9

kaitchup/Jamba-v0.1-bnb-mamba-4bit

Text Generation • 52B • Updated Apr 29, 2024 • 6

kaitchup/Phi-3-mini-4k-instruct-gptq-4bit

Text Generation • 4B • Updated Apr 25, 2024 • 756k • 2

kaitchup/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • 4B • Updated Apr 25, 2024 • 5

kaitchup/Jamba-v0.1-bnb-4bit

Text Generation • 52B • Updated Apr 22, 2024 • 5

kaitchup/Llama-2-7B-oasstguanaco-adapter-1e

Updated Apr 18, 2024

kaitchup/Mistral-7B-v0.1-oasstguanaco-1e-qdora-merged

Text Generation • 7B • Updated Apr 10, 2024 • 4

kaitchup/Mistral-7B-v0.1-oasstguanaco-1e-loftq-merged

Text Generation • 7B • Updated Apr 10, 2024 • 4

kaitchup/Mistral-7B-v0.1-oasstguanaco-1e-qlora-merged

Text Generation • 7B • Updated Apr 10, 2024 • 4