MaziyarPanahi
commited on
Commit
•
47ece89
1
Parent(s):
941430d
Update README.md (#12)
Browse files- Update README.md (a2a636edc0c4c716569c281e52284397b4d224c6)
README.md
CHANGED
@@ -35,11 +35,9 @@ huggingface-cli download MaziyarPanahi/calme-2.1-qwen2-72b-GGUF --local-dir . --
|
|
35 |
|
36 |
## Load GGUF models
|
37 |
|
38 |
-
You `MUST` follow the prompt template provided by Llama-3:
|
39 |
-
|
40 |
|
41 |
```sh
|
42 |
-
./llama.cpp/main -m
|
43 |
```
|
44 |
|
45 |
|
|
|
35 |
|
36 |
## Load GGUF models
|
37 |
|
|
|
|
|
38 |
|
39 |
```sh
|
40 |
+
./llama.cpp/main -m mode_name.Q2_K.gguf -p "<|im_start|>user\nJust say 1, 2, 3 hi and NOTHING else\n<|im_end|>\n<|im_start|>assistant\n" -n 1024
|
41 |
```
|
42 |
|
43 |
|