Transformers
GGUF
llama

Fix prompt format in command

#4
by nacs - opened
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -128,7 +128,7 @@ Make sure you are using `llama.cpp` from commit [6381d4e110bd0ec02843a60bbeb8b6f
128
  For compatibility with older versions of llama.cpp, or for use with third-party clients and libaries, please use GGML files instead.
129
 
130
  ```
131
- ./main -t 10 -ngl 32 -m airoboros-l2-70b-2.1.q4_K_M.gguf --color -c 4096 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "### Instruction: Write a story about llamas\n### Response:"
132
  ```
133
  Change `-t 10` to the number of physical CPU cores you have. For example if your system has 8 cores/16 threads, use `-t 8`.
134
 
 
128
  For compatibility with older versions of llama.cpp, or for use with third-party clients and libaries, please use GGML files instead.
129
 
130
  ```
131
+ ./main -t 10 -ngl 32 -m airoboros-l2-70b-2.1.q4_K_M.gguf --color -c 4096 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "A chat\nUSER: Write a story about llamas\nASSISTANT:\n"
132
  ```
133
  Change `-t 10` to the number of physical CPU cores you have. For example if your system has 8 cores/16 threads, use `-t 8`.
134