DataSnake commited on
Commit
79171eb
·
verified ·
1 Parent(s): 2379808

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -45,7 +45,7 @@ dataset_utils.SUPPORTED_DATASET_CONFIG["distilled-roleplay"] = {
45
 
46
  ## Inference
47
 
48
- Tested on a RTX 5060 Ti 16GB with TensorRT-LLM, vLLM, and SGLang. Of the three, I found vLLM to be the best. TensorRT-LLM couldn't handle as large a context window as the other two, and SGLang had fewer sampling options available.
49
 
50
  Recommended generation settings (a mix of what it says on the Muse-12B model card and the [AI Dungeon Model Guide](https://help.aidungeon.com/ai-models-and-their-differences)):
51
  - Temperature: 1.0
 
45
 
46
  ## Inference
47
 
48
+ Tested on a RTX 5060 Ti 16GB with TensorRT-LLM, vLLM, and SGLang.
49
 
50
  Recommended generation settings (a mix of what it says on the Muse-12B model card and the [AI Dungeon Model Guide](https://help.aidungeon.com/ai-models-and-their-differences)):
51
  - Temperature: 1.0