JosephusCheung commited on
Commit
508743a
1 Parent(s): 116a24f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -17,9 +17,9 @@ SPOILOR: Further finetuning is in progress, the current version is a work-in-pro
17
 
18
  PROMPT FORMAT: [chatml](https://github.com/openai/openai-python/blob/main/chatml.md)
19
 
20
- CURRENT MMLU: stem ACC: 43.12 Humanities ACC: 45.15 other ACC: 56.40 social ACC: 57.96 AVERAGE ACC:49.61
21
 
22
- Issue: Compared to the original Qwen, the MMLU score dropped slightly (4.59) due to insufficient realignment, but the proportions of each item changed, which is unusual.
23
 
24
  [在制品]
25
 
@@ -31,6 +31,6 @@ Issue: Compared to the original Qwen, the MMLU score dropped slightly (4.59) due
31
 
32
  PROMPT 格式: [chatml](https://github.com/openai/openai-python/blob/main/chatml.md)
33
 
34
- 当前的 MMLU: stem ACC: 43.12 Humanities ACC: 45.15 other ACC: 56.40 social ACC: 57.96 AVERAGE ACC:49.61
35
 
36
- 问题:相比原本的Qwen,由于不够充分的重新对齐,MMLU分数略有下降(4.59),但是各项目的比例发生了变化,这是不寻常的。
 
17
 
18
  PROMPT FORMAT: [chatml](https://github.com/openai/openai-python/blob/main/chatml.md)
19
 
20
+ CURRENT MMLU: 50.36
21
 
22
+ Issue: Compared to the original Qwen-Chat scoring 53.9, the MMLU score dropped slightly (-3.54) due to insufficient realignment.
23
 
24
  [在制品]
25
 
 
31
 
32
  PROMPT 格式: [chatml](https://github.com/openai/openai-python/blob/main/chatml.md)
33
 
34
+ 当前的 MMLU: 50.36
35
 
36
+ 问题:相比原本的Qwen-Chat的53.9,由于不够充分的重新对齐,MMLU分数略有下降(-3.54)。