Update README.md
Browse files
README.md
CHANGED
|
@@ -73,8 +73,7 @@ The model was trained on Vietnamese Oscar dataset (32 GB) to optimize a traditio
|
|
| 73 |
|
| 74 |
### GPT-2 Finetuning
|
| 75 |
|
| 76 |
-
The following example fine-tunes GPT-2 on WikiText-2. We're using the raw WikiText-2
|
| 77 |
-
the tokenization). The loss here is that of causal language modeling.
|
| 78 |
|
| 79 |
The script [here](https://github.com/huggingface/transformers/blob/main/examples/pytorch/language-modeling/run_clm.py) .
|
| 80 |
|
|
|
|
| 73 |
|
| 74 |
### GPT-2 Finetuning
|
| 75 |
|
| 76 |
+
The following example fine-tunes GPT-2 on WikiText-2. We're using the raw WikiText-2.
|
|
|
|
| 77 |
|
| 78 |
The script [here](https://github.com/huggingface/transformers/blob/main/examples/pytorch/language-modeling/run_clm.py) .
|
| 79 |
|