Update README.md
Browse files
README.md
CHANGED
|
@@ -1,4 +1,13 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
-
Mathstral compiled for Neuron
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
+
Mathstral compiled for Neuron
|
| 5 |
+
It has been compiled to run on an inf2.24xlarge instance on AWS. Note that while the inf2.24xlarge has 12 cores, this compilation uses 12.
|
| 6 |
+
|
| 7 |
+
SEQUENCE_LENGTH = 4096
|
| 8 |
+
|
| 9 |
+
BATCH_SIZE = 4
|
| 10 |
+
|
| 11 |
+
NUM_CORES = 12
|
| 12 |
+
|
| 13 |
+
PRECISION = "bf16"
|