i-be-snek commited on
Commit
ee7c3fb
1 Parent(s): 2af6e97

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -3
README.md CHANGED
@@ -61,7 +61,6 @@ It achieves the following results on the evaluation set:
61
  - Train Accuracy: 0.9857
62
  - Epoch: 2
63
 
64
- All scripts for training can be found in this [GitHub repository](https://github.com/i-be-snek/rise-assignment-ner-finetune).
65
 
66
  ## Model description
67
 
@@ -72,14 +71,48 @@ The dataset was modified further so that all other named entities not included i
72
 
73
  ## Training and evaluation data
74
 
75
- More information needed
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
76
 
77
  ## Training procedure
78
 
 
 
79
  ### Training hyperparameters
80
 
81
  The following hyperparameters were used during training:
82
- - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.0}
 
 
 
 
 
 
 
 
 
 
 
 
 
83
  - training_precision: float32
84
 
85
  ### Training results
 
61
  - Train Accuracy: 0.9857
62
  - Epoch: 2
63
 
 
64
 
65
  ## Model description
66
 
 
71
 
72
  ## Training and evaluation data
73
 
74
+ This model has been evaluated on the English subset of the test set of Babelscape/multinerd with modifications where all tags other than (0) Person (PER), Animal (ANIM), Organization (ORG), Location (LOC), and Disease (DIS) were replaced with the 'O' tag.
75
+ The label indices were also reset and the dataset was transformed accordingly. You can preprocess the dataset in the same way with any custom set of tags using the script in this [GitHub repository](https://github.com/i-be-snek/rise-assignment-ner-finetune)
76
+
77
+
78
+ ## Evaluation results
79
+
80
+ | metric | value |
81
+ |:----------|---------:|
82
+ | precision | 0.936296 |
83
+ | recall | 0.952485 |
84
+ | f1 | 0.944321 |
85
+ | accuracy | 0.991344 |
86
+
87
+
88
+ |metric/tag | ANIM | DIS | LOC | ORG | PER |
89
+ |:----------|------------:|------------:|-------------:|------------:|-------------:|
90
+ | precision | 0.674603 | 0.695304 | 0.966669 | 0.954712 | 0.989048 |
91
+ | recall | 0.794888 | 0.799736 | 0.967232 | 0.942883 | 0.994872 |
92
+ | f1 | 0.729823 | 0.743873 | 0.966951 | 0.948761 | 0.991952 |
93
+ | number | 3208 | 1518 | 24048 | 6618 | 10530 |
94
 
95
  ## Training procedure
96
 
97
+ All scripts for training can be found in this [GitHub repository](https://github.com/i-be-snek/rise-assignment-ner-finetune).
98
+
99
  ### Training hyperparameters
100
 
101
  The following hyperparameters were used during training:
102
+ - optimizer:
103
+ - ```python
104
+ {
105
+ "name": "AdamWeightDecay",
106
+ "learning_rate": 2e-05,
107
+ "decay": 0.0,
108
+ "beta_1": 0.9,
109
+ "beta_2": 0.999,
110
+ "epsilon": 1e-07,
111
+ "amsgrad": False,
112
+ "weight_decay_rate": 0.0,
113
+ }
114
+ ```
115
+
116
  - training_precision: float32
117
 
118
  ### Training results