Edit model card
YAML Metadata Error: "language[0]" must only contain lowercase characters
YAML Metadata Error: "language[0]" with value "English" is not valid. It must be an ISO 639-1, 639-2 or 639-3 code (two/three letters), or a special value like "code", "multilingual". If you want to use BCP-47 identifiers, you can specify them in language_bcp47.

roberta-base + SQuAD QA

Objective: This is Roberta Base trained to do the SQuAD Task. This makes a QA model capable of answering questions.

model_name = "thatdramebaazguy/roberta-base-squad"
pipeline(model=model_name, tokenizer=model_name, revision="v1.0", task="question-answering")

Overview

Language model: roberta-base
Language: English
Downstream-task: QA
Training data: SQuADv1
Eval data: SQuAD
Infrastructure: 2x Tesla v100
Code: See example

Hyperparameters

Num examples = 88567  
Num Epochs = 10
Instantaneous batch size per device = 32  
Total train batch size (w. parallel, distributed & accumulation) = 64 

Performance

Eval on SQuADv1

  • epoch = 10.0
  • eval_samples = 10790
  • exact_match = 83.6045
  • f1 = 91.1709

Eval on MoviesQA

  • eval_samples = 5032
  • exact_match = 51.6494
  • f1 = 68.2615

Github Repo:


Downloads last month
209
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.