End of training
Browse files- README.md +14 -14
- adapter_model.safetensors +1 -1
- metrics.jsonl +6 -0
- metrics_epoch_0.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json +1 -0
- metrics_epoch_2.0_fold_0_lr_1e-05_seed_1234_weight_5.0.json +1 -0
- metrics_epoch_2.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json +1 -0
- metrics_epoch_4.0_fold_0_lr_1e-05_seed_1234_weight_5.0.json +1 -0
- metrics_epoch_4.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json +1 -0
- metrics_epoch_5.76_fold_0_lr_1e-05_seed_1234_weight_5.0.json +1 -0
- results_epoch_0.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json +0 -0
- results_epoch_2.0_fold_0_lr_1e-05_seed_1234_weight_5.0.json +0 -0
- results_epoch_2.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json +0 -0
- results_epoch_4.0_fold_0_lr_1e-05_seed_1234_weight_5.0.json +0 -0
- results_epoch_4.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json +0 -0
- results_epoch_5.76_fold_0_lr_1e-05_seed_1234_weight_5.0.json +0 -0
- training_args.bin +1 -1
README.md
CHANGED
@@ -18,13 +18,13 @@ should probably proofread and complete it, then remove this comment. -->
|
|
18 |
|
19 |
This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the None dataset.
|
20 |
It achieves the following results on the evaluation set:
|
21 |
-
- Loss: 0.
|
22 |
-
- Eval/rewards/chosen: 0.
|
23 |
-
- Eval/logps/chosen: -
|
24 |
-
- Eval/rewards/rejected: 0.
|
25 |
-
- Eval/logps/rejected: -
|
26 |
-
- Eval/rewards/margins: 0.
|
27 |
-
- Eval/kl:
|
28 |
|
29 |
## Model description
|
30 |
|
@@ -43,7 +43,7 @@ More information needed
|
|
43 |
### Training hyperparameters
|
44 |
|
45 |
The following hyperparameters were used during training:
|
46 |
-
- learning_rate:
|
47 |
- train_batch_size: 1
|
48 |
- eval_batch_size: 2
|
49 |
- seed: 1234
|
@@ -58,12 +58,12 @@ The following hyperparameters were used during training:
|
|
58 |
|
59 |
| Training Loss | Epoch | Step | Validation Loss | |
|
60 |
|:-------------:|:-----:|:----:|:---------------:|:------:|
|
61 |
-
|
|
62 |
-
|
|
63 |
-
|
|
64 |
-
|
|
65 |
-
|
|
66 |
-
| 0.
|
67 |
|
68 |
|
69 |
### Framework versions
|
|
|
18 |
|
19 |
This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the None dataset.
|
20 |
It achieves the following results on the evaluation set:
|
21 |
+
- Loss: 0.8406
|
22 |
+
- Eval/rewards/chosen: -0.5872
|
23 |
+
- Eval/logps/chosen: -198.6973
|
24 |
+
- Eval/rewards/rejected: -0.6580
|
25 |
+
- Eval/logps/rejected: -236.4490
|
26 |
+
- Eval/rewards/margins: 0.0708
|
27 |
+
- Eval/kl: 0.0
|
28 |
|
29 |
## Model description
|
30 |
|
|
|
43 |
### Training hyperparameters
|
44 |
|
45 |
The following hyperparameters were used during training:
|
46 |
+
- learning_rate: 1e-05
|
47 |
- train_batch_size: 1
|
48 |
- eval_batch_size: 2
|
49 |
- seed: 1234
|
|
|
58 |
|
59 |
| Training Loss | Epoch | Step | Validation Loss | |
|
60 |
|:-------------:|:-----:|:----:|:---------------:|:------:|
|
61 |
+
| 1.7241 | 0.96 | 12 | 0.8748 | 0.0178 |
|
62 |
+
| 1.1636 | 2.0 | 25 | 0.8626 | 0.0 |
|
63 |
+
| 1.367 | 2.96 | 37 | 0.8516 | 0.0 |
|
64 |
+
| 1.0187 | 4.0 | 50 | 0.8411 | 0.0 |
|
65 |
+
| 1.1771 | 4.96 | 62 | 0.8434 | 0.0 |
|
66 |
+
| 0.9371 | 5.76 | 72 | 0.8406 | 0.0 |
|
67 |
|
68 |
|
69 |
### Framework versions
|
adapter_model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 27297544
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:046bb2b7b57c5714cedb4b3c986808f2255591f70a96d9ebd415d6921b6339a9
|
3 |
size 27297544
|
metrics.jsonl
CHANGED
@@ -40,3 +40,9 @@
|
|
40 |
{"epoch": 4.0, "precision": 0.5999999976, "recall": 0.8333333287037037, "fold": 0}
|
41 |
{"epoch": 4.96, "precision": 0.8571428530612245, "recall": 0.9999999944444444, "fold": 0}
|
42 |
{"epoch": 5.76, "precision": 0.6521739102079395, "recall": 0.8333333287037037, "fold": 0}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
40 |
{"epoch": 4.0, "precision": 0.5999999976, "recall": 0.8333333287037037, "fold": 0}
|
41 |
{"epoch": 4.96, "precision": 0.8571428530612245, "recall": 0.9999999944444444, "fold": 0}
|
42 |
{"epoch": 5.76, "precision": 0.6521739102079395, "recall": 0.8333333287037037, "fold": 0}
|
43 |
+
{"epoch": 0.96, "precision": 0.4736842092797784, "recall": 0.9999999944444444, "fold": 0}
|
44 |
+
{"epoch": 2.0, "precision": 0.4615384603550296, "recall": 0.9999999944444444, "fold": 0}
|
45 |
+
{"epoch": 2.96, "precision": 0.4999999984375, "recall": 0.8888888839506173, "fold": 0}
|
46 |
+
{"epoch": 4.0, "precision": 0.5454545438016529, "recall": 0.9999999944444444, "fold": 0}
|
47 |
+
{"epoch": 4.96, "precision": 0.49999999852941174, "recall": 0.9444444391975308, "fold": 0}
|
48 |
+
{"epoch": 5.76, "precision": 0.47058823391003457, "recall": 0.8888888839506173, "fold": 0}
|
metrics_epoch_0.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"epoch": 0.96, "precision": 0.4736842092797784, "recall": 0.9999999944444444, "fold": 0}
|
metrics_epoch_2.0_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"epoch": 2.0, "precision": 0.4615384603550296, "recall": 0.9999999944444444, "fold": 0}
|
metrics_epoch_2.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"epoch": 2.96, "precision": 0.4999999984375, "recall": 0.8888888839506173, "fold": 0}
|
metrics_epoch_4.0_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"epoch": 4.0, "precision": 0.5454545438016529, "recall": 0.9999999944444444, "fold": 0}
|
metrics_epoch_4.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"epoch": 4.96, "precision": 0.49999999852941174, "recall": 0.9444444391975308, "fold": 0}
|
metrics_epoch_5.76_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"epoch": 5.76, "precision": 0.47058823391003457, "recall": 0.8888888839506173, "fold": 0}
|
results_epoch_0.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
results_epoch_2.0_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
results_epoch_2.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
results_epoch_4.0_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
results_epoch_4.96_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
results_epoch_5.76_fold_0_lr_1e-05_seed_1234_weight_5.0.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5688
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:eb64b17200bf3c0a8265b814db333d9ae5539134e2f0eacfd343e63ae8debe78
|
3 |
size 5688
|