Mozilla
/

Meta-Llama-3.1-70B-Instruct-llamafile

Model card Files Files and versions Community

jartine commited on Aug 19

Commit

87c2197

•

1 Parent(s): 07df84d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -56,7 +56,7 @@ You then need to fill out the prompt / history template (see below).
 This model has a max context window size of 128k tokens. By default, a
 context window size of 8192 tokens is used. You can use a larger context
-window by passing the `-c 131072` flag.
 On GPUs with sufficient RAM, the `-ngl 999` flag may be passed to use
 the system's NVIDIA or AMD GPU(s). On Windows, only the graphics card

 This model has a max context window size of 128k tokens. By default, a
 context window size of 8192 tokens is used. You can use a larger context
+window by passing the `-c 0` flag.
 On GPUs with sufficient RAM, the `-ngl 999` flag may be passed to use
 the system's NVIDIA or AMD GPU(s). On Windows, only the graphics card