Update README.md
Browse files
README.md
CHANGED
@@ -41,7 +41,7 @@ GPT-2/GPT-3.
|
|
41 |
Evaluating the accuracy of the sparse model of gpt-j-6b using the lambada_openai dataset in lm_eval, providing the accuracy fluctuation under two precisions: FP32 and BF16.
|
42 |
<figure>
|
43 |
|
44 |
-
|
|
45 |
-
|
46 |
-
|
|
47 |
-
|
|
|
|
41 |
Evaluating the accuracy of the sparse model of gpt-j-6b using the lambada_openai dataset in lm_eval, providing the accuracy fluctuation under two precisions: FP32 and BF16.
|
42 |
<figure>
|
43 |
|
44 |
+
| Sparsity | Dataset | Precision | Dense Acc ↑ | Sparse Acc ↑ | Acc fluctuations |
|
45 |
+
|------ |---------------- |------- |------- |-------- |------------------ |
|
46 |
+
| 40% |Lambada_openai | FP32 | 0.6831 | 0.6922 | +1.33% |
|
47 |
+
| 40% |Lambada_openai | BF16 | 0.6771 | 0.6874 | +0.63% |
|