MarinaraSpaghetti commited on
Commit
5f17436
1 Parent(s): 999d38f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -1
README.md CHANGED
@@ -1,4 +1,29 @@
1
  An attempt to make @ParasiticRogue model a tad better on longer contexts. I just ran the script, all credit for the merge goes to my friend.
2
 
3
  Exl2 quants already being updated by him:
4
- https://huggingface.co/ParasiticRogue/RP-Stew-v2.5-34B-exl2-4.65
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  An attempt to make @ParasiticRogue model a tad better on longer contexts. I just ran the script, all credit for the merge goes to my friend.
2
 
3
  Exl2 quants already being updated by him:
4
+ https://huggingface.co/ParasiticRogue/RP-Stew-v2.5-34B-exl2-4.65
5
+
6
+ ```
7
+ models:
8
+ - model: F:\Merge\ParasiticRogue_Nontoxic-PiVoT-Bagel-RP-34b
9
+ parameters:
10
+ weight: 0.16
11
+ density: 0.42
12
+ - model: F:\Merge\ParasiticRogue_Nyakura-CausalLM-RP-34B
13
+ parameters:
14
+ weight: 0.22
15
+ density: 0.54
16
+ - model: F:\Merge\migtissera_Tess-34B-v1.5b
17
+ parameters:
18
+ weight: 0.28
19
+ density: 0.66
20
+ - model: F:\Merge\brucethemoose_Capybara-Fixed-Temp
21
+ parameters:
22
+ weight: 0.34
23
+ density: 0.78
24
+ merge_method: dare_ties
25
+ base_model: F:\Merge\chargoddard_Yi-34B-200K-Llama
26
+ parameters:
27
+ int8_mask: true
28
+ dtype: bfloat16
29
+ ```