high-quality Chinese training datasets
Collection
a suite of high-quality Chinese datasets, used for pretraining, fine-tuning or preference alignment. And the models trained on these datasets. • 13 items • Updated
• 24
- We apply DPO to
opencsg/csg-wukong-2b-smoltalk-chinese, usingultrafeedback-chinese-binarizedas the DPO dataset. - Train 2 epochs, learning rate=5e-6, batchsize=128
- Downloads last month
- 2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for opencsg/csg-wukong-2b-ultrafeedback-chinese-binarized
Base model
opencsg/csg-wukong-2b-chinese-fineweb-edu
Finetuned
opencsg/csg-wukong-2b-smoltalk-chinese