Linked readme's.
#5
by
pdelobelle
- opened
README.md
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# RobBERT-2023: Keeping Dutch Language Models Up-To-Date
|
| 2 |
+
|
| 3 |
+
RobBERT-2023 is the 2023 release of the [Dutch RobBERT model](https://pieter.ai/robbert/).
|
| 4 |
+
It is a new version of original [pdelobelle/robbert-v2-dutch-base](https://huggingface.co/pdelobelle/robbert-v2-dutch-base) model on the 2023 version of the OSCAR version.
|
| 5 |
+
We release a base model, but this time we also release an additional large model with 355M parameters (x3 over robbert-2022-base). We are particularly proud of the performance of both models, surpassing both the robbert-v2-base and robbert-2022-base models with +2.9 and +0.9 points on the [DUMB benchmark](https://dumbench.nl) from GroNLP. In addition, we also surpass BERTje with +18.6 points with `robbert-2023-dutch-large`.
|
| 6 |
+
|
| 7 |
+
This is the same model with the same weights as [`DTAI-KULeuven/robbert-2023-dutch-large`](https://huggingface.co/DTAI-KULeuven/robbert-2023-dutch-large).
|