Updating logs
4619c2f
-
checkpoints
Step... (230001/250000 | Loss: 1.7595738172531128, Acc: 0.6519749760627747): 92%|███████████████████▎ | 230248/250000 [111:01:26<10:03:20, 1.83s/it]
-
618 Bytes
Model at 210k steps, mlm acc 0.6509
data_collator.joblib
Detected Pickle imports (5)
- "__main__.FlaxDataCollatorForLanguageModeling",
- "tokenizers.AddedToken",
- "transformers.models.roberta.tokenization_roberta_fast.RobertaTokenizerFast",
- "tokenizers.models.Model",
- "tokenizers.Tokenizer"
How to fix it?
1.47 MB
Model at 210k steps, mlm acc 0.6509
-
40 Bytes
Model at 210k steps, mlm acc 0.6509
-
34.3 MB
Updating logs
-
250 MB
Step... (230001/250000 | Loss: 1.7595738172531128, Acc: 0.6519749760627747): 92%|███████████████████▎ | 230248/250000 [111:01:26<10:03:20, 1.83s/it]
-
500 MB
Step... (230001/250000 | Loss: 1.7595738172531128, Acc: 0.6519749760627747): 92%|███████████████████▎ | 230248/250000 [111:01:26<10:03:20, 1.83s/it]
training_args.joblib
Detected Pickle imports (4)
- "transformers.training_args.TrainingArguments",
- "torch.device",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.SchedulerType"
How to fix it?
1.87 kB
Model at 210k steps, mlm acc 0.6509
-
16 Bytes
Step... (230001/250000 | Loss: 1.7595738172531128, Acc: 0.6519749760627747): 92%|███████████████████▎ | 230248/250000 [111:01:26<10:03:20, 1.83s/it]
