The Kaitchup

company

https://kaitchup.substack.com/

bnjmn_marie

Activity Feed Request to join this org

AI & ML interests

None defined yet.

Recent Activity

bnjmnmarie new activity 1 day ago

kaitchup/Olmo-3.1-32B-Instruct-fp8-dynamic:Error running vllm 12

bnjmnmarie updated a model 1 day ago

kaitchup/Olmo-3.1-32B-Instruct-fp8-dynamic

bnjmnmarie updated a collection 2 days ago

Quantized Qwen3 2512

View all activity

kaitchup 's models 362

kaitchup/Mistral-NeMo-Minitron-8B-Base-Minivoc-32k-v0.1a

Text Generation • 8B • Updated Sep 13, 2024 • 2

kaitchup/Llama-3.1-8B-Minivoc-32k-v0.1a

Text Generation • 7B • Updated Sep 13, 2024 • 1

kaitchup/Qwen2-1.5B-Minivoc-32k-v0.1a

Text Generation • 1B • Updated Sep 12, 2024 • 9 • 2

kaitchup/gemma-2-9b-it-GGUF

9B • Updated Sep 4, 2024 • 4

kaitchup/gemma-2-2b-it-GGUF

3B • Updated Sep 4, 2024 • 11

kaitchup/Mistral-NeMo-Minitron-8B-Base-GGUF

8B • Updated Sep 4, 2024 • 5

kaitchup/gemma-2-2b-GGUF

3B • Updated Sep 4, 2024 • 5

kaitchup/Meta-Llama-3.1-70B-Instruct-ExLlamaV2-4bit

Updated Aug 29, 2024 • 4

kaitchup/Mistral-NeMo-Minitron-8B-Base-AutoRound-GPTQ-sym-4bit

Text Generation • 8B • Updated Aug 27, 2024 • 3

kaitchup/Mistral-NeMo-Minitron-8B-Base-AutoRound-GPTQ-asym-4bit

Text Generation • 8B • Updated Aug 26, 2024 • 3

kaitchup/Llama-3.1-Minitron-4B-Depth-Base-AutoRound-GPTQ-asym-4bit

Text Generation • 5B • Updated Aug 26, 2024 • 5

kaitchup/Llama-3.1-Minitron-4B-Depth-Base-AutoRound-GPTQ-sym-4bit

Text Generation • 5B • Updated Aug 26, 2024 • 1

kaitchup/Llama-3.1-Minitron-4B-Width-Base-AutoRound-GPTQ-sym-4bit

Text Generation • 5B • Updated Aug 26, 2024 • 3

kaitchup/Llama-3.1-Minitron-4B-Width-Base-AutoRound-GPTQ-asym-4bit

Text Generation • 5B • Updated Aug 26, 2024 • 3

kaitchup/Mistral-Nemo-Base-2407-AutoRound-GPTQ-sym-4bit

Text Generation • 12B • Updated Aug 26, 2024 • 12 • 1

kaitchup/Mistral-Nemo-Base-2407-AutoRound-GPTQ-asym-4bit

Text Generation • 12B • Updated Aug 26, 2024 • 5

kaitchup/Meta-Llama-3.1-8B-AutoRound-GPTQ-asym-4bit

Text Generation • 8B • Updated Aug 26, 2024 • 3

kaitchup/Meta-Llama-3.1-8B-AutoRound-GPTQ-sym-4bit

Text Generation • 8B • Updated Aug 26, 2024 • 2

kaitchup/Phi-3.5-Mini-instruct-AutoRound-4bit

Text Generation • 4B • Updated Aug 23, 2024 • 3 • 2

kaitchup/Meta-Llama-3.1-70B-Instruct-ExLlamaV2-2.5bit

Text Generation • Updated Aug 20, 2024 • 8

kaitchup/Meta-Llama-3.1-70B-Instruct-ExLlamaV2-2.2bit

Text Generation • Updated Aug 20, 2024 • 7

kaitchup/Meta-Llama-3.1-70B-Instruct-ExLlamaV2-3bit

Text Generation • Updated Aug 20, 2024 • 6

kaitchup/Llama3.1_8b_Instruct_QLoRA_OASST-Adapter

Updated Aug 15, 2024

kaitchup/Llama3.1_8b_QLoRA_OASST-Adapter

Updated Aug 15, 2024

kaitchup/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Aug 13, 2024 • 10

kaitchup/Meta-Llama-3.1-8B-Instruct-autoround-gptq-4bit-asym

Text Generation • 8B • Updated Aug 13, 2024 • 7 • 1

kaitchup/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • 8B • Updated Aug 13, 2024 • 5

kaitchup/Meta-Llama-3.1-8B-Instruct-awq-4bit

Text Generation • 8B • Updated Aug 13, 2024 • 10 • 1

kaitchup/Meta-Llama-3.1-8B-Instruct-autoround-gptq-4bit-sym

Text Generation • 8B • Updated Aug 13, 2024 • 5 • 1

kaitchup/Meta-Llama-3.1-8B-autoround-gptq-4bit-asym

Text Generation • 8B • Updated Aug 7, 2024 • 8