Benchmarks

Tests were carried out on this model and the original model for the purpose of accurate data.

Average - 49.7 (original - 48.29)

boolq - 62.57 (original - 57.31)

truthfulqa_mc1 - 24.26 (original - 23.01)

ARC_e - 53.07 (original - 54.04)

WinoGrande - 57.7 (original - 58.8)

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Base model

Adapter

(5)

this model