OSError: mistralai/Devstral-Small-2507-GGUF does not appear to have a file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt or flax_model.msgpack.

#2
by salmanshahid8 - opened

I am facing this problem for both mistralai model and unsloth model. Any idea why is it so? I checked on internet and did not find anything that can help me solve it.
I am trying to run it on a ubuntu with latest OS version, with 24 GB GPU RAM.

Sign up or log in to comment