Update README.md
Browse files
README.md
CHANGED
@@ -61,7 +61,6 @@ It achieves the following results on the evaluation set:
|
|
61 |
- Train Accuracy: 0.9857
|
62 |
- Epoch: 2
|
63 |
|
64 |
-
All scripts for training can be found in this [GitHub repository](https://github.com/i-be-snek/rise-assignment-ner-finetune).
|
65 |
|
66 |
## Model description
|
67 |
|
@@ -72,14 +71,48 @@ The dataset was modified further so that all other named entities not included i
|
|
72 |
|
73 |
## Training and evaluation data
|
74 |
|
75 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
76 |
|
77 |
## Training procedure
|
78 |
|
|
|
|
|
79 |
### Training hyperparameters
|
80 |
|
81 |
The following hyperparameters were used during training:
|
82 |
-
- optimizer:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
83 |
- training_precision: float32
|
84 |
|
85 |
### Training results
|
|
|
61 |
- Train Accuracy: 0.9857
|
62 |
- Epoch: 2
|
63 |
|
|
|
64 |
|
65 |
## Model description
|
66 |
|
|
|
71 |
|
72 |
## Training and evaluation data
|
73 |
|
74 |
+
This model has been evaluated on the English subset of the test set of Babelscape/multinerd with modifications where all tags other than (0) Person (PER), Animal (ANIM), Organization (ORG), Location (LOC), and Disease (DIS) were replaced with the 'O' tag.
|
75 |
+
The label indices were also reset and the dataset was transformed accordingly. You can preprocess the dataset in the same way with any custom set of tags using the script in this [GitHub repository](https://github.com/i-be-snek/rise-assignment-ner-finetune)
|
76 |
+
|
77 |
+
|
78 |
+
## Evaluation results
|
79 |
+
|
80 |
+
| metric | value |
|
81 |
+
|:----------|---------:|
|
82 |
+
| precision | 0.936296 |
|
83 |
+
| recall | 0.952485 |
|
84 |
+
| f1 | 0.944321 |
|
85 |
+
| accuracy | 0.991344 |
|
86 |
+
|
87 |
+
|
88 |
+
|metric/tag | ANIM | DIS | LOC | ORG | PER |
|
89 |
+
|:----------|------------:|------------:|-------------:|------------:|-------------:|
|
90 |
+
| precision | 0.674603 | 0.695304 | 0.966669 | 0.954712 | 0.989048 |
|
91 |
+
| recall | 0.794888 | 0.799736 | 0.967232 | 0.942883 | 0.994872 |
|
92 |
+
| f1 | 0.729823 | 0.743873 | 0.966951 | 0.948761 | 0.991952 |
|
93 |
+
| number | 3208 | 1518 | 24048 | 6618 | 10530 |
|
94 |
|
95 |
## Training procedure
|
96 |
|
97 |
+
All scripts for training can be found in this [GitHub repository](https://github.com/i-be-snek/rise-assignment-ner-finetune).
|
98 |
+
|
99 |
### Training hyperparameters
|
100 |
|
101 |
The following hyperparameters were used during training:
|
102 |
+
- optimizer:
|
103 |
+
- ```python
|
104 |
+
{
|
105 |
+
"name": "AdamWeightDecay",
|
106 |
+
"learning_rate": 2e-05,
|
107 |
+
"decay": 0.0,
|
108 |
+
"beta_1": 0.9,
|
109 |
+
"beta_2": 0.999,
|
110 |
+
"epsilon": 1e-07,
|
111 |
+
"amsgrad": False,
|
112 |
+
"weight_decay_rate": 0.0,
|
113 |
+
}
|
114 |
+
```
|
115 |
+
|
116 |
- training_precision: float32
|
117 |
|
118 |
### Training results
|