Update README.md
Browse files
README.md
CHANGED
|
@@ -24,4 +24,5 @@ Specifically, the objective is to predict the reaction class label, and the inpu
|
|
| 24 |
- num_epochs = 5 (but early stopped at epoch 4)
|
| 25 |
- learning_rate = 5e-4
|
| 26 |
- warmup_steps = 64
|
| 27 |
-
- weight_decay = 0.01
|
|
|
|
|
|
| 24 |
- num_epochs = 5 (but early stopped at epoch 4)
|
| 25 |
- learning_rate = 5e-4
|
| 26 |
- warmup_steps = 64
|
| 27 |
+
- weight_decay = 0.01
|
| 28 |
+
- lr_scheduler_type = "cosine"
|