P0x0 commited on
Commit
6e1a9cf
1 Parent(s): c706e25

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -0
README.md CHANGED
@@ -54,3 +54,31 @@ outputs = model.generate(**inputs)
54
  print(tokenizer.decode(outputs[0], skip_special_tokens=True))
55
  ```
56
  I encourage you to provide feedback on the model's performance. If you'd like to create your own quantizations, feel free to do so and let me know how it works for you!
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
54
  print(tokenizer.decode(outputs[0], skip_special_tokens=True))
55
  ```
56
  I encourage you to provide feedback on the model's performance. If you'd like to create your own quantizations, feel free to do so and let me know how it works for you!
57
+
58
+ model-index:
59
+ - name: P0x0/Astra-v1-12B
60
+ results:
61
+ - task:
62
+ type: text-generation
63
+ metrics:
64
+ - name: Average
65
+ type: Average
66
+ value: 19.46
67
+ - name: IFEval
68
+ type: IFEval
69
+ value: 28.06
70
+ - name: BBH
71
+ type: BBH
72
+ value: 31.81
73
+ - name: MATH Lvl 5
74
+ type: MATH Lvl 5
75
+ value: 9.67
76
+ - name: GPQA
77
+ type: GPQA
78
+ value: 8.5
79
+ - name: MUSR
80
+ type: MUSR
81
+ value: 11.38
82
+ - name: MMLU-PRO
83
+ type: MMLU-PRO
84
+ value: 27.34