exllamav3 quantizations of sophosympatheia's Strawberrylemonade-L3-70B-v1.2
2.25bpw h6 (20.669 GiB)
4.25bpw h6 (36.606 GiB)
exllamav3 quantizations of sophosympatheia's Strawberrylemonade-L3-70B-v1.2
2.25bpw h6 (20.669 GiB)
4.25bpw h6 (36.606 GiB)