Update README.md
Browse files
README.md
CHANGED
@@ -1,15 +1,35 @@
|
|
1 |
---
|
2 |
-
|
|
|
|
|
|
|
|
|
3 |
library_name: transformers
|
4 |
tags:
|
5 |
- mergekit
|
6 |
- merge
|
7 |
|
8 |
---
|
9 |
-
#
|
10 |
|
11 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
## Merge Details
|
14 |
### Merge Method
|
15 |
|
@@ -162,3 +182,7 @@ slices:
|
|
162 |
density: 1.0
|
163 |
weight: 0.30838472094518804
|
164 |
```
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
license: cc-by-nc-4.0
|
3 |
+
base_model:
|
4 |
+
- vicgalle/Roleplay-Llama-3-8B
|
5 |
+
- Undi95/Llama-3-Unholy-8B-e4
|
6 |
+
- Undi95/Llama-3-LewdPlay-8B
|
7 |
library_name: transformers
|
8 |
tags:
|
9 |
- mergekit
|
10 |
- merge
|
11 |
|
12 |
---
|
13 |
+
# LewdPlay-8B
|
14 |
|
15 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
16 |
|
17 |
+
The new EVOLVE merge method was used (on MMLU specifically), see below for more information!
|
18 |
+
|
19 |
+
Unholy was used for uncensoring, Roleplay Llama 3 for the DPO train he got on top, and LewdPlay for the... lewd side.
|
20 |
+
|
21 |
+
## Prompt template: Llama3
|
22 |
+
|
23 |
+
```
|
24 |
+
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
|
25 |
+
|
26 |
+
{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
|
27 |
+
|
28 |
+
{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
29 |
+
|
30 |
+
{output}<|eot_id|>
|
31 |
+
```
|
32 |
+
|
33 |
## Merge Details
|
34 |
### Merge Method
|
35 |
|
|
|
182 |
density: 1.0
|
183 |
weight: 0.30838472094518804
|
184 |
```
|
185 |
+
|
186 |
+
## Support
|
187 |
+
|
188 |
+
If you want to support me, you can [here](https://ko-fi.com/undiai).
|