Merge branch 'main' of https://huggingface.co/jiyuanq/falcon-40b-instruct-gptq-128g-act into main
Browse files
README.md
CHANGED
|
@@ -4,7 +4,8 @@ pipeline_tag: text-generation
|
|
| 4 |
---
|
| 5 |
|
| 6 |
falcon-40b-instruct quantized with GPTQ using the script in https://github.com/huggingface/text-generation-inference/pull/438
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
|
|
|
|
|
| 4 |
---
|
| 5 |
|
| 6 |
falcon-40b-instruct quantized with GPTQ using the script in https://github.com/huggingface/text-generation-inference/pull/438
|
| 7 |
+
|
| 8 |
+
- group size: 128
|
| 9 |
+
- act order: true
|
| 10 |
+
- nsamples: 128
|
| 11 |
+
- dataset: wikitext2
|