OmegaGamage commited on
Commit
a1938a8
1 Parent(s): ecff3a5

Model save

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -35,7 +35,7 @@ More information needed
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
- - learning_rate: 0.0002
39
  - train_batch_size: 1
40
  - eval_batch_size: 8
41
  - seed: 42
@@ -43,7 +43,7 @@ The following hyperparameters were used during training:
43
  - total_train_batch_size: 2
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: cosine
46
- - lr_scheduler_warmup_ratio: 0.03
47
  - num_epochs: 3
48
 
49
  ### Training results
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 1e-06
39
  - train_batch_size: 1
40
  - eval_batch_size: 8
41
  - seed: 42
 
43
  - total_train_batch_size: 2
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: cosine
46
+ - lr_scheduler_warmup_ratio: 0.01
47
  - num_epochs: 3
48
 
49
  ### Training results