---
license: cc-by-4.0
base_model: deepset/bert-base-cased-squad2
tags:
- generated_from_trainer
model-index:
- name: bert-30
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-30

This model is a fine-tuned version of [deepset/bert-base-cased-squad2](https://huggingface.co/deepset/bert-base-cased-squad2) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 6.1568

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 0.0002
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 1

### Training results

| Training Loss | Epoch | Step | Validation Loss |
|:-------------:|:-----:|:----:|:---------------:|
| 10.2234       | 0.02  | 5    | 11.9934         |
| 10.8592       | 0.05  | 10   | 11.5287         |
| 11.1095       | 0.07  | 15   | 11.0729         |
| 9.6708        | 0.09  | 20   | 10.6345         |
| 9.8014        | 0.11  | 25   | 10.2156         |
| 8.5541        | 0.14  | 30   | 9.8183          |
| 9.0229        | 0.16  | 35   | 9.4399          |
| 8.6368        | 0.18  | 40   | 9.0751          |
| 8.1449        | 0.21  | 45   | 8.7287          |
| 8.2085        | 0.23  | 50   | 8.4043          |
| 6.7635        | 0.25  | 55   | 8.1085          |
| 7.109         | 0.28  | 60   | 7.8431          |
| 6.8781        | 0.3   | 65   | 7.5985          |
| 7.0699        | 0.32  | 70   | 7.3754          |
| 6.7036        | 0.34  | 75   | 7.1764          |
| 6.4062        | 0.37  | 80   | 7.0033          |
| 6.8335        | 0.39  | 85   | 6.8531          |
| 6.2913        | 0.41  | 90   | 6.7252          |
| 6.0877        | 0.44  | 95   | 6.6208          |
| 6.1684        | 0.46  | 100  | 6.5346          |
| 6.1907        | 0.48  | 105  | 6.4630          |
| 5.9105        | 0.5   | 110  | 6.4073          |
| 6.0136        | 0.53  | 115  | 6.3652          |
| 6.0264        | 0.55  | 120  | 6.3287          |
| 5.782         | 0.57  | 125  | 6.3013          |
| 5.843         | 0.6   | 130  | 6.2805          |
| 5.9236        | 0.62  | 135  | 6.2619          |
| 5.7016        | 0.64  | 140  | 6.2473          |
| 5.704         | 0.67  | 145  | 6.2352          |
| 5.7283        | 0.69  | 150  | 6.2272          |
| 5.8303        | 0.71  | 155  | 6.2179          |
| 5.7584        | 0.73  | 160  | 6.2092          |
| 5.8322        | 0.76  | 165  | 6.2009          |
| 5.8232        | 0.78  | 170  | 6.1927          |
| 5.871         | 0.8   | 175  | 6.1852          |
| 5.7416        | 0.83  | 180  | 6.1791          |
| 5.936         | 0.85  | 185  | 6.1735          |
| 5.7006        | 0.87  | 190  | 6.1685          |
| 5.7799        | 0.89  | 195  | 6.1649          |
| 5.8199        | 0.92  | 200  | 6.1616          |
| 5.6763        | 0.94  | 205  | 6.1592          |
| 5.7938        | 0.96  | 210  | 6.1576          |
| 5.6812        | 0.99  | 215  | 6.1568          |


### Framework versions

- Transformers 4.34.1
- Pytorch 2.0.1+cu118
- Datasets 2.14.5
- Tokenizers 0.14.1