---
license: cc-by-4.0
base_model: deepset/bert-base-cased-squad2
tags:
- generated_from_trainer
model-index:
- name: bert-30
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# bert-30

This model is a fine-tuned version of [deepset/bert-base-cased-squad2](https://huggingface.co/deepset/bert-base-cased-squad2) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 11.5401

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 3e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 1

### Training results

| Training Loss | Epoch | Step | Validation Loss |
|:-------------:|:-----:|:----:|:---------------:|
| 10.8471       | 0.05  | 5    | 12.3076         |
| 10.8298       | 0.09  | 10   | 12.2362         |
| 11.0622       | 0.14  | 15   | 12.1684         |
| 11.6335       | 0.18  | 20   | 12.1040         |
| 11.4197       | 0.23  | 25   | 12.0427         |
| 10.5672       | 0.28  | 30   | 11.9853         |
| 10.7596       | 0.32  | 35   | 11.9313         |
| 10.8418       | 0.37  | 40   | 11.8806         |
| 11.0164       | 0.41  | 45   | 11.8333         |
| 10.3409       | 0.46  | 50   | 11.7898         |
| 11.2085       | 0.5   | 55   | 11.7495         |
| 10.3929       | 0.55  | 60   | 11.7126         |
| 9.9285        | 0.6   | 65   | 11.6798         |
| 9.834         | 0.64  | 70   | 11.6507         |
| 10.5704       | 0.69  | 75   | 11.6249         |
| 10.8002       | 0.73  | 80   | 11.6020         |
| 10.5069       | 0.78  | 85   | 11.5831         |
| 10.0382       | 0.83  | 90   | 11.5671         |
| 10.133        | 0.87  | 95   | 11.5551         |
| 10.212        | 0.92  | 100  | 11.5459         |
| 9.9872        | 0.96  | 105  | 11.5401         |


### Framework versions

- Transformers 4.34.1
- Pytorch 2.0.1+cu118
- Datasets 2.14.5
- Tokenizers 0.14.1