README.md

metadata

language:
  - en
license: apache-2.0
tags:
  - Mixtral
  - instruct
  - finetune
  - chatml
  - DPO
  - RLHF
  - gpt4
  - synthetic data
  - distillation
model-index:
  - name: fusedYi
    results: []

Model Card for FusedYi

This is fused Yi-6B. I took a Yi, merged it with another Yi, and got a new Yi out of the Yis. Yi-ceptionized.

Model Details

1.9 x Yi-6B

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	53.18
AI2 Reasoning Challenge (25-Shot)	55.03
HellaSwag (10-Shot)	76.60
MMLU (5-Shot)	63.43
TruthfulQA (0-shot)	49.29
Winogrande (5-shot)	72.69
GSM8k (5-shot)	2.05