mwitiderrick
commited on
Commit
•
3bb5aae
1
Parent(s):
2ef3177
Update README.md
Browse files
README.md
CHANGED
@@ -124,7 +124,7 @@ model = KeyValueCacheInjector(model_path=os.path.dirname(input_file)).apply(mode
|
|
124 |
onnx.save(model, output_file)
|
125 |
print(f"Modified model saved to: {output_file}")
|
126 |
```
|
127 |
-
Follow the instructions on our [One Shot With SparseML](https://github.com/neuralmagic/sparseml/tree/main/src/sparseml/transformers/sparsification/obcq)
|
128 |
## Slack
|
129 |
|
130 |
For further support, and discussions on these models and AI in general, join [Neural Magic's Slack Community](https://join.slack.com/t/discuss-neuralmagic/shared_invite/zt-q1a1cnvo-YBoICSIw3L1dmQpjBeDurQ)
|
|
|
124 |
onnx.save(model, output_file)
|
125 |
print(f"Modified model saved to: {output_file}")
|
126 |
```
|
127 |
+
Follow the instructions on our [One Shot With SparseML](https://github.com/neuralmagic/sparseml/tree/main/src/sparseml/transformers/sparsification/obcq) page for a step-by-step guide for performing one-shot quantization of large language models.
|
128 |
## Slack
|
129 |
|
130 |
For further support, and discussions on these models and AI in general, join [Neural Magic's Slack Community](https://join.slack.com/t/discuss-neuralmagic/shared_invite/zt-q1a1cnvo-YBoICSIw3L1dmQpjBeDurQ)
|