Hugging Face's logo

kxx-kkk
/
FYP_qa_final

Question Answering
Transformers
TensorBoard
Safetensors
English
deberta-v2
Generated from Trainer
Eval Results
Inference Endpoints
Model card Files Metrics Community
kxx-kkk commited on
Commit
1831dc2
•
1 Parent(s): 57d2629

End of training

Browse files
Files changed (3) hide show
  1. README.md +8 -10
  2. model.safetensors +1 -1
  3. runs/Apr07_14-32-13_acd4397c66ed/events.out.tfevents.1712500334.acd4397c66ed.2448.0 +2 -2
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [kxx-kkk/FYP_sq2_mrqa_adqa_synqa_quoref](https://huggingface.co/kxx-kkk/FYP_sq2_mrqa_adqa_synqa_quoref) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 2.3814
19
 
20
  ## Model description
21
 
@@ -40,21 +40,19 @@ The following hyperparameters were used during training:
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 4
44
  - mixed_precision_training: Native AMP
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 2.7153 | 0.48 | 300 | 2.8860 |
51
- | 2.5698 | 0.96 | 600 | 2.6071 |
52
- | 2.4486 | 1.44 | 900 | 2.5039 |
53
- | 2.3583 | 1.92 | 1200 | 2.4549 |
54
- | 2.332 | 2.4 | 1500 | 2.4043 |
55
- | 2.264 | 2.88 | 1800 | 2.4150 |
56
- | 2.232 | 3.35 | 2100 | 2.3507 |
57
- | 2.201 | 3.83 | 2400 | 2.3814 |
58
 
59
 
60
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [kxx-kkk/FYP_sq2_mrqa_adqa_synqa_quoref](https://huggingface.co/kxx-kkk/FYP_sq2_mrqa_adqa_synqa_quoref) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.5690
19
 
20
  ## Model description
21
 
 
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 3
44
  - mixed_precision_training: Native AMP
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 2.7114 | 0.48 | 300 | 3.0660 |
51
+ | 2.5396 | 0.96 | 600 | 2.6867 |
52
+ | 2.4284 | 1.44 | 900 | 2.6065 |
53
+ | 2.3668 | 1.91 | 1200 | 2.5973 |
54
+ | 2.3286 | 2.39 | 1500 | 2.5630 |
55
+ | 2.2461 | 2.87 | 1800 | 2.5690 |
 
 
56
 
57
 
58
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1dab8b0afc364b1d315da1f2962f3c9194d3ec842cb244bc7f7a77a40ce909bd
3
  size 735356752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:beb18a8673b0b8b4f0fa5033cb14cecf116b941ea96a66fcfdc9c45b1f5960c6
3
  size 735356752
runs/Apr07_14-32-13_acd4397c66ed/events.out.tfevents.1712500334.acd4397c66ed.2448.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:83cb1e54cc9b32f449496f1647a811ec7e35b3760b304d4f01ec55bc9b25af7a
3
- size 7906
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:604dc61d497eb6c50a7067becfac0c408cd4dcf2de4bec906b6bb1807786d599
3
+ size 8260