Edit model card

image/png

image/png

T3Q-ko-solar-dpo-v6.0

This model is a version of T3Q-ko-solar-dpo-v5.0 that has been fine-tuned with DPO.

Model Developers Chihoon Lee(chihoonlee10), T3Q

hf (pretrained=chihoonlee10/T3Q-ko-solar-dpo-v6.0), limit: None, provide_description: False, num_fewshot: 0, batch_size: None

Task Version Metric Value Stderr
kobest_boolq 0 acc 0.5028 ± 0.0133
macro_f1 0.3396 ± 0.0067
kobest_copa 0 acc 0.8020 ± 0.0126
macro_f1 0.8018 ± 0.0126
kobest_hellaswag 0 acc 0.5340 ± 0.0223
acc_norm 0.5720 ± 0.0221
macro_f1 0.5322 ± 0.0224
kobest_sentineg 0 acc 0.7985 ± 0.0202
macro_f1 0.7956 ± 0.0205
Downloads last month
1,792
Safetensors
Model size
10.7B params
Tensor type
FP16
·
Inference Examples
Inference API (serverless) is not available, repository is disabled.

Model tree for chihoonlee10/T3Q-ko-solar-dpo-v6.0

Finetunes
2 models
Merges
2 models
Quantizations
2 models

Spaces using chihoonlee10/T3Q-ko-solar-dpo-v6.0 3