Lewdiculous commited on
Commit
81d9caf
1 Parent(s): 28fb9ae

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +47 -3
README.md CHANGED
@@ -1,3 +1,47 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - safetensors
5
+ - llama
6
+ - rp
7
+ - roleplay
8
+ - sillytavern
9
+ language:
10
+ - en
11
+ ---
12
+ # #llama-3 #roleplay
13
+
14
+ GGUF-IQ-Imatrix quants for [Endevor/InfinityRP-v2-8B](https://huggingface.co/Endevor/InfinityRP-v2-8B). <br> Back at it!
15
+
16
+ > [!IMPORTANT]
17
+ > These quants have been done after the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920). <br>
18
+ > Use **KoboldCpp version 1.64** or higher.
19
+
20
+ > [!NOTE]
21
+ > **Prompt formatting...** <br>
22
+ > Alpaca prompt format recommended. <br>
23
+ > A safe starting SillyTavern preset can be found [here (simple)](https://huggingface.co/Lewdiculous/Model-Requests/tree/main/data/presets/lewdicu-3.0.2-mistral-0.2).
24
+
25
+ # Original model information by the author:
26
+
27
+ ![example](https://files.catbox.moe/joazop.png)
28
+
29
+ The idea is the same as [InfinityRP v1](https://huggingface.co/Endevor/InfinityRP-v1-7B), but this one is Llama 3 with 16k ctx! Have fun...
30
+
31
+ ### Prompt format: Alpaca.
32
+ ``"You are now in roleplay chat mode. Engage in an endless chat, always with a creative response. Follow lengths very precisely and create paragraphs accurately. Always wait your turn, next actions and responses. Your internal thoughts are wrapped with ` marks."``
33
+
34
+ **User Message Prefix = ### Input:**
35
+
36
+ **Assistant Message Prefix = ### Response:**
37
+
38
+ **System Message Prefix = ### Instruction:**
39
+
40
+ **Turn on "Include Names"** (optional)
41
+
42
+ ### Text Length: (use on your System Prompt or ### Response:)
43
+ Response: (length = medium) <- [tiny, micro, short, medium, long, enormous, huge, massive, humongous]
44
+
45
+ ### Example:
46
+
47
+ ![example](https://files.catbox.moe/t3hcez.png)