dora commited on
Commit
e5cb7bb
1 Parent(s): 2fda730

fix MODELS env (#663)

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -288,7 +288,7 @@ If you want to run chat-ui with llama.cpp, you can do the following, using Zephy
288
  3. Add the following to your `.env.local`:
289
 
290
  ```env
291
- MODELS=[
292
  {
293
  "name": "Local Zephyr",
294
  "chatPromptTemplate": "<|system|>\n{{preprompt}}</s>\n{{#each messages}}{{#ifUser}}<|user|>\n{{content}}</s>\n<|assistant|>\n{{/ifUser}}{{#ifAssistant}}{{content}}</s>\n{{/ifAssistant}}{{/each}}",
@@ -308,7 +308,7 @@ MODELS=[
308
  }
309
  ]
310
  }
311
- ]
312
  ```
313
 
314
  Start chat-ui with `npm run dev` and you should be able to chat with Zephyr locally.
@@ -324,7 +324,7 @@ ollama run mistral
324
  Then specify the endpoints like so:
325
 
326
  ```env
327
- MODELS=[
328
  {
329
  "name": "Ollama Mistral",
330
  "chatPromptTemplate": "<s>{{#each messages}}{{#ifUser}}[INST] {{#if @first}}{{#if @root.preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}} {{content}} [/INST]{{/ifUser}}{{#ifAssistant}}{{content}}</s> {{/ifAssistant}}{{/each}}",
@@ -345,7 +345,7 @@ MODELS=[
345
  }
346
  ]
347
  }
348
- ]
349
  ```
350
 
351
  #### Amazon
 
288
  3. Add the following to your `.env.local`:
289
 
290
  ```env
291
+ MODELS=`[
292
  {
293
  "name": "Local Zephyr",
294
  "chatPromptTemplate": "<|system|>\n{{preprompt}}</s>\n{{#each messages}}{{#ifUser}}<|user|>\n{{content}}</s>\n<|assistant|>\n{{/ifUser}}{{#ifAssistant}}{{content}}</s>\n{{/ifAssistant}}{{/each}}",
 
308
  }
309
  ]
310
  }
311
+ ]`
312
  ```
313
 
314
  Start chat-ui with `npm run dev` and you should be able to chat with Zephyr locally.
 
324
  Then specify the endpoints like so:
325
 
326
  ```env
327
+ MODELS=`[
328
  {
329
  "name": "Ollama Mistral",
330
  "chatPromptTemplate": "<s>{{#each messages}}{{#ifUser}}[INST] {{#if @first}}{{#if @root.preprompt}}{{@root.preprompt}}\n{{/if}}{{/if}} {{content}} [/INST]{{/ifUser}}{{#ifAssistant}}{{content}}</s> {{/ifAssistant}}{{/each}}",
 
345
  }
346
  ]
347
  }
348
+ ]`
349
  ```
350
 
351
  #### Amazon