Hugging Face's logo

GuCuChiara
/
NLP-HIBA_DisTEMIST_fine_tuned_ClinicalBERT-pretrained-model

Token Classification
Transformers
TensorBoard
Safetensors
bert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
GuCuChiara commited on
Commit
c405b17
•
1 Parent(s): 6380e02

Training complete

Browse files
Files changed (3) hide show
  1. README.md +14 -11
  2. model.safetensors +1 -1
  3. runs/Nov12_22-40-09_8d2de5777864/events.out.tfevents.1699828820.8d2de5777864.473.2 +2 -2
README.md CHANGED
@@ -20,11 +20,11 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [emilyalsentzer/Bio_ClinicalBERT](https://huggingface.co/emilyalsentzer/Bio_ClinicalBERT) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 0.2644
24
- - Precision: 0.5331
25
- - Recall: 0.5170
26
- - F1: 0.5249
27
- - Accuracy: 0.9319
28
 
29
  ## Model description
30
 
@@ -49,17 +49,20 @@ The following hyperparameters were used during training:
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
- - num_epochs: 5
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
58
- | No log | 1.0 | 71 | 0.2155 | 0.4953 | 0.4904 | 0.4929 | 0.9230 |
59
- | No log | 2.0 | 142 | 0.2250 | 0.5350 | 0.4910 | 0.5121 | 0.9314 |
60
- | No log | 3.0 | 213 | 0.2293 | 0.5373 | 0.5071 | 0.5218 | 0.9327 |
61
- | No log | 4.0 | 284 | 0.2374 | 0.5562 | 0.4978 | 0.5254 | 0.9344 |
62
- | No log | 5.0 | 355 | 0.2644 | 0.5331 | 0.5170 | 0.5249 | 0.9319 |
 
 
 
63
 
64
 
65
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [emilyalsentzer/Bio_ClinicalBERT](https://huggingface.co/emilyalsentzer/Bio_ClinicalBERT) on the None dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.4109
24
+ - Precision: 0.5413
25
+ - Recall: 0.5693
26
+ - F1: 0.5550
27
+ - Accuracy: 0.9254
28
 
29
  ## Model description
30
 
 
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
+ - num_epochs: 8
53
 
54
  ### Training results
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
57
  |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
58
+ | No log | 1.0 | 71 | 0.2386 | 0.5723 | 0.5449 | 0.5583 | 0.9273 |
59
+ | No log | 2.0 | 142 | 0.3000 | 0.5767 | 0.5693 | 0.5730 | 0.9240 |
60
+ | No log | 3.0 | 213 | 0.2973 | 0.5882 | 0.5830 | 0.5856 | 0.9279 |
61
+ | No log | 4.0 | 284 | 0.3333 | 0.5222 | 0.5742 | 0.5470 | 0.9205 |
62
+ | No log | 5.0 | 355 | 0.3613 | 0.5012 | 0.5957 | 0.5444 | 0.9184 |
63
+ | No log | 6.0 | 426 | 0.3772 | 0.5516 | 0.5693 | 0.5603 | 0.9268 |
64
+ | No log | 7.0 | 497 | 0.4006 | 0.5574 | 0.5596 | 0.5585 | 0.9257 |
65
+ | 0.0539 | 8.0 | 568 | 0.4109 | 0.5413 | 0.5693 | 0.5550 | 0.9254 |
66
 
67
 
68
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b969f4ceadeb85dcd9374a11e28b7888f7a613ce2da9633805b66fbb251da8d9
3
  size 430911284
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a01b77b58c9f054441c4c2739d1e87129ff95963a2be1744540b7b6aeaae760a
3
  size 430911284
runs/Nov12_22-40-09_8d2de5777864/events.out.tfevents.1699828820.8d2de5777864.473.2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3748d3032bcf952854937551a579ab9e7da90680324fff0e1a221dfb9f62170d
3
- size 7962
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce462f6f0100215a864b532f7ec75b7559452d453e4d48cb4b680daa9fbe3522
3
+ size 8788