heyuan commited on
Commit
cfc088b
1 Parent(s): e5f75ea

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -7
README.md CHANGED
@@ -3,23 +3,24 @@ license: apache-2.0
3
  tags:
4
  - merge
5
  - mergekit
6
- - lazymergekit
7
- - uproai/RosMistral-2x7B
8
  - NeverSleep/Noromaid-7b-v0.2
9
  base_model:
10
- - uproai/RosMistral-2x7B
11
- - NeverSleep/Noromaid-7b-v0.2
12
  ---
13
 
14
  # ros-7b-v1
15
 
16
  ros-7b-v1 is a merge of the following models using [Mergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
17
- * [uproai/RosMistral-2x7B](https://huggingface.co/uproai/RosMistral-2x7B)
 
 
18
  * [NeverSleep/Noromaid-7b-v0.2](https://huggingface.co/NeverSleep/Noromaid-7b-v0.2)
19
 
20
  ## 🧩 Configuration
21
 
22
- ```yamlslices:
 
23
  - sources:
24
  - model: uproai/RosMistral-2x7B
25
  layer_range: [0, 32]
@@ -36,7 +37,8 @@ parameters:
36
  - filter: mlp
37
  value: [1, 0.5, 0.7, 0.3, 0]
38
  - value: 0.5
39
- dtype: bfloat16```
 
40
 
41
  ## 💻 Usage
42
 
 
3
  tags:
4
  - merge
5
  - mergekit
6
+ - OpenPipe/mistral-ft-optimized-1227
 
7
  - NeverSleep/Noromaid-7b-v0.2
8
  base_model:
9
+ - OpenPipe/mistral-ft-optimized-1227
 
10
  ---
11
 
12
  # ros-7b-v1
13
 
14
  ros-7b-v1 is a merge of the following models using [Mergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
15
+ * Base Model [OpenPipe/mistral-ft-optimized-1227](https://huggingface.co/OpenPipe/mistral-ft-optimized-1227)
16
+ * [cgato/Thespis-Mistral-7b-v0.6](https://huggingface.co/cgato/Thespis-Mistral-7b-v0.6)
17
+ * [saishf/West-Hermes-7B](https://huggingface.co/saishf/West-Hermes-7B)
18
  * [NeverSleep/Noromaid-7b-v0.2](https://huggingface.co/NeverSleep/Noromaid-7b-v0.2)
19
 
20
  ## 🧩 Configuration
21
 
22
+ ```yaml
23
+ slices:
24
  - sources:
25
  - model: uproai/RosMistral-2x7B
26
  layer_range: [0, 32]
 
37
  - filter: mlp
38
  value: [1, 0.5, 0.7, 0.3, 0]
39
  - value: 0.5
40
+ dtype: bfloat16
41
+ ```
42
 
43
  ## 💻 Usage
44