Hugging Face's logo

debisoft
/
mpt-7b-8k-instruct-peft-compatible

Text Generation
Transformers
PyTorch
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference
Model card Files
xet
Community
2
mpt-7b-8k-instruct-peft-compatible
13.3 GB
  • 1 contributor
 History: 8 commits
debisoft's picture
debisoft
Added output_attentions: bool=False to GroupedQueryAttention.forward() as a temporary fix for AWQ
a43d8a8