yjgwak/klue-bert-base-finetuned-squad-kor-v1

KLUE BERT base Finetuned on squad-kor-v1

Table of Contents

• Model Details
• How to Get Started With the Model
• Uses
• Training
• Evaluation
• Technical Specifications
• Citation Information

Model Details

Model Description: This model is the KLUE BERT base, fine-tuned on the squad-kor-v1 dataset for Korean question answering tasks.

• Developed by: Yeongjin Gwak
• Model Type: Transformer-based language model
• Language(s): Korean
• License: cc-by-sa-4.0
• Parent Model: See the KLUE BERT base model for more information about the parent model.

How to Get Started With the Model

from transformers import AutoModel, AutoTokenizer

model = AutoModel.from_pretrained("yjgwak/klue-bert-base-finetuned-squard-kor-v1")
tokenizer = AutoTokenizer.from_pretrained("yjgwak/klue-bert-base-finetuned-squard-kor-v1")

Uses

Direct Use

This model is specialized for the task of question answering in Korean. Users can employ this model to extract answers from passages or documents in Korean when provided with relevant questions.

Misuse and Out-of-scope Use

The model should not be used for tasks other than question answering without further fine-tuning. Using this model for generating long-form content or for tasks it wasn't fine-tuned on may result in suboptimal results.

Training

Training Data

The model was fine-tuned on the squad-kor-v1 dataset, which is the Korean version of the popular SQuAD dataset used for question answering tasks.

Training Procedure

The original BERT training methodology was adopted with the difference being the dataset used for fine-tuning. The model was trained to minimize the cross-entropy loss between predicted answers and ground truth answers in the squad-kor-v1 dataset.

Evaluation

[Provide details of any evaluation metrics, results, or testing data used to assess the performance of the model after fine-tuning. If this hasn't been done yet, you can mention that the evaluation is pending.]

Technical Specifications

See the original KLUE BERT base model card for details on the underlying architecture and technical specifications.

Citation Information

Please cite the original KLUE paper and any other relevant resources or papers associated with the squad-kor-v1 dataset.