Text Generation
Transformers
Safetensors
English
mega
Generated from Trainer
Inference Endpoints
pszemraj commited on
Commit
26fd756
1 Parent(s): f473ac4

End of training

Browse files
Files changed (5) hide show
  1. README.md +3 -3
  2. all_results.json +17 -0
  3. eval_results.json +11 -0
  4. train_results.json +10 -0
  5. trainer_state.json +0 -0
README.md CHANGED
@@ -15,11 +15,11 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # mega-ar-350m-v0.12-napierone_epub-UltraTextbooks-2.1-fw_mix-vN
17
 
18
- This model is a fine-tuned version of [pszemraj/mega-ar-350m-v0.12-napierone_epub](https://huggingface.co/pszemraj/mega-ar-350m-v0.12-napierone_epub) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
  - Loss: 1.9926
21
- - Accuracy: 0.5884
22
- - Num Input Tokens Seen: 3460300800
23
 
24
  ## Model description
25
 
 
15
 
16
  # mega-ar-350m-v0.12-napierone_epub-UltraTextbooks-2.1-fw_mix-vN
17
 
18
+ This model is a fine-tuned version of [pszemraj/mega-ar-350m-v0.12-napierone_epub](https://huggingface.co/pszemraj/mega-ar-350m-v0.12-napierone_epub) on the BEE-spoke-data/UltraTextbooks-2.1-fw_mix dataset.
19
  It achieves the following results on the evaluation set:
20
  - Loss: 1.9926
21
+ - Accuracy: 0.5885
22
+ - Num Input Tokens Seen: 3468165120
23
 
24
  ## Model description
25
 
all_results.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 0.9999893708612791,
3
+ "eval_accuracy": 0.5884871794871794,
4
+ "eval_loss": 1.992581844329834,
5
+ "eval_runtime": 128.1327,
6
+ "eval_samples": 400,
7
+ "eval_samples_per_second": 3.122,
8
+ "eval_steps_per_second": 1.046,
9
+ "num_input_tokens_seen": 3468165120,
10
+ "perplexity": 7.334445735052817,
11
+ "total_flos": 4.540784328132526e+18,
12
+ "train_loss": 2.065564124978859,
13
+ "train_runtime": 98524.0638,
14
+ "train_samples": 846729,
15
+ "train_samples_per_second": 8.594,
16
+ "train_steps_per_second": 0.09
17
+ }
eval_results.json ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 0.9999893708612791,
3
+ "eval_accuracy": 0.5884871794871794,
4
+ "eval_loss": 1.992581844329834,
5
+ "eval_runtime": 128.1327,
6
+ "eval_samples": 400,
7
+ "eval_samples_per_second": 3.122,
8
+ "eval_steps_per_second": 1.046,
9
+ "num_input_tokens_seen": 3468165120,
10
+ "perplexity": 7.334445735052817
11
+ }
train_results.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 0.9999893708612791,
3
+ "num_input_tokens_seen": 3468165120,
4
+ "total_flos": 4.540784328132526e+18,
5
+ "train_loss": 2.065564124978859,
6
+ "train_runtime": 98524.0638,
7
+ "train_samples": 846729,
8
+ "train_samples_per_second": 8.594,
9
+ "train_steps_per_second": 0.09
10
+ }
trainer_state.json ADDED
The diff for this file is too large to render. See raw diff