Hugging Face's logo

CohereLabs
/
c4ai-command-r-v01

Transformers
Safetensors
Model card Files
xet
 Community
62

Instruct-finetuning dataset

#43
by Andriy - opened
Discussion
Andriy

Hi! What instruct-finetuning dataset was used to train the chat model?
deleted

The dataset is probably closed-source, but, in theory, it is possible to generate an "artificial" dataset for instruction following. It can be done by program two instances of LLM to chat with each other and log their generated data into some file.
markding

I was wondering the same, and it seems like that the Aya Collection was used in some form, but I have not seen definite proof.
skevja

Does anybody know what prompt formatting should be used for a custom fine-tuning dataset for command-r?

ewre324

@skevja I am also looking for this information...
Any updates?
skevja
•
edited May 10, 2024

@ewre324 Unfortunately no, didn't find any information on this.

alexrs changed discussion status to closed

Sign up or log in to comment