File size: 2,427 Bytes
98472ce ae0b148 98472ce ae0b148 98472ce aaca7d0 98472ce aaca7d0 a393fd8 0151508 b4140ee 2be42ed 3d0a855 afad1f2 d84e782 f7827c0 d5b8fef 588aad7 a99af56 30c45f3 f00f366 0b3ab20 a2f6f7b df7fc19 1490661 ccd8e8b ae0b148 98472ce aaca7d0 98472ce |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 |
---
license: cc-by-4.0
base_model: deepset/bert-base-cased-squad2
tags:
- generated_from_keras_callback
model-index:
- name: badokorach/bert-base-cased-squad2-agic2-051223
results: []
---
<!-- This model card has been generated automatically according to the information Keras had access to. You should
probably proofread and complete it, then remove this comment. -->
# badokorach/bert-base-cased-squad2-agic2-051223
This model is a fine-tuned version of [deepset/bert-base-cased-squad2](https://huggingface.co/deepset/bert-base-cased-squad2) on an unknown dataset.
It achieves the following results on the evaluation set:
- Train Loss: 0.2158
- Validation Loss: 0.0
- Epoch: 19
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 1e-05, 'decay_steps': 1840, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.02}
- training_precision: mixed_float16
### Training results
| Train Loss | Validation Loss | Epoch |
|:----------:|:---------------:|:-----:|
| 2.7168 | 0.0 | 0 |
| 2.0300 | 0.0 | 1 |
| 1.6692 | 0.0 | 2 |
| 1.3758 | 0.0 | 3 |
| 1.1708 | 0.0 | 4 |
| 0.9307 | 0.0 | 5 |
| 0.7926 | 0.0 | 6 |
| 0.7019 | 0.0 | 7 |
| 0.5832 | 0.0 | 8 |
| 0.5066 | 0.0 | 9 |
| 0.4563 | 0.0 | 10 |
| 0.3754 | 0.0 | 11 |
| 0.3298 | 0.0 | 12 |
| 0.3064 | 0.0 | 13 |
| 0.2651 | 0.0 | 14 |
| 0.2528 | 0.0 | 15 |
| 0.2402 | 0.0 | 16 |
| 0.2249 | 0.0 | 17 |
| 0.2271 | 0.0 | 18 |
| 0.2158 | 0.0 | 19 |
### Framework versions
- Transformers 4.35.2
- TensorFlow 2.15.0
- Datasets 2.15.0
- Tokenizers 0.15.0
|