Commit
·
6998e57
1
Parent(s):
471679a
Update README.md
Browse files
README.md
CHANGED
|
@@ -38,6 +38,7 @@ license: mit
|
|
| 38 |
---
|
| 39 |
# Model Card of instructionRoberta-base for Bertology
|
| 40 |
|
|
|
|
| 41 |
|
| 42 |
A minimalistic instruction model with an already good analysed and pretrained encoder like roBERTa.
|
| 43 |
So we can research the [Bertology](https://aclanthology.org/2020.tacl-1.54.pdf) with instruction-tuned models, [look at the attention](https://colab.research.google.com/drive/1mNP7c0RzABnoUgE6isq8FTp-NuYNtrcH?usp=sharing) and investigate [what happens to BERT embeddings during fine-tuning](https://aclanthology.org/2020.blackboxnlp-1.4.pdf).
|
|
|
|
| 38 |
---
|
| 39 |
# Model Card of instructionRoberta-base for Bertology
|
| 40 |
|
| 41 |
+
|
| 42 |
|
| 43 |
A minimalistic instruction model with an already good analysed and pretrained encoder like roBERTa.
|
| 44 |
So we can research the [Bertology](https://aclanthology.org/2020.tacl-1.54.pdf) with instruction-tuned models, [look at the attention](https://colab.research.google.com/drive/1mNP7c0RzABnoUgE6isq8FTp-NuYNtrcH?usp=sharing) and investigate [what happens to BERT embeddings during fine-tuning](https://aclanthology.org/2020.blackboxnlp-1.4.pdf).
|