Update README.md
Browse files
README.md
CHANGED
|
@@ -7,6 +7,8 @@ datasets:
|
|
| 7 |
|
| 8 |
Expirements in large-scale small-scale preference learning.
|
| 9 |
|
|
|
|
|
|
|
| 10 |
falcon-rw-1b trained with PRO (preference ranking optimization, see https://arxiv.org/abs/2306.17492) on SuperMC and PRM800K (only stage 1) for 3 epochs, using my supertrainer2000 framework.
|
| 11 |
|
| 12 |
This is an expiremental model.
|
|
|
|
| 7 |
|
| 8 |
Expirements in large-scale small-scale preference learning.
|
| 9 |
|
| 10 |
+
**This one was a failure, it benchmarks horribly, despite responding okay to trivia questions in testing**
|
| 11 |
+
|
| 12 |
falcon-rw-1b trained with PRO (preference ranking optimization, see https://arxiv.org/abs/2306.17492) on SuperMC and PRM800K (only stage 1) for 3 epochs, using my supertrainer2000 framework.
|
| 13 |
|
| 14 |
This is an expiremental model.
|