THIS MODEL IS MEANT TO BE USED FOR GENERATING BAD RESPONSES!
Uploaded finetuned model
- Developed by: WarlordHermes
- License: apache-2.0
- Finetuned from model : huihui-ai/Huihui-Qwen3-4B-Instruct-2507-abliterated
This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 2
Model tree for WarlordHermes/Qwen3-4B-ORPO-Rejected-Generator
Base model
Qwen/Qwen3-4B-Instruct-2507