EdBerg commited on
Commit
4d79b1c
1 Parent(s): e75a508

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -3,30 +3,30 @@ tags:
3
  - merge
4
  - mergekit
5
  - lazymergekit
6
- - cerebras/Cerebras-GPT-2.7B
7
- - LLM360/AmberChat
8
  base_model:
9
- - cerebras/Cerebras-GPT-2.7B
10
- - LLM360/AmberChat
11
  ---
12
 
13
  # GreatRag-13B-slerp
14
 
15
  GreatRag-13B-slerp is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
16
- * [cerebras/Cerebras-GPT-2.7B](https://huggingface.co/cerebras/Cerebras-GPT-2.7B)
17
- * [LLM360/AmberChat](https://huggingface.co/LLM360/AmberChat)
18
 
19
  ## 🧩 Configuration
20
 
21
  ```yaml
22
  slices:
23
  - sources:
24
- - model: cerebras/Cerebras-GPT-2.7B
25
  layer_range: [0, 32]
26
- - model: LLM360/AmberChat
27
  layer_range: [0, 32]
28
  merge_method: slerp
29
- base_model: cerebras/Cerebras-GPT-2.7B
30
  parameters:
31
  t:
32
  - filter: self_attn
 
3
  - merge
4
  - mergekit
5
  - lazymergekit
6
+ - inception-mbzuai/jais-13b
7
+ - google/gemma-2b
8
  base_model:
9
+ - inception-mbzuai/jais-13b
10
+ - google/gemma-2b
11
  ---
12
 
13
  # GreatRag-13B-slerp
14
 
15
  GreatRag-13B-slerp is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
16
+ * [inception-mbzuai/jais-13b](https://huggingface.co/inception-mbzuai/jais-13b)
17
+ * [google/gemma-2b](https://huggingface.co/google/gemma-2b)
18
 
19
  ## 🧩 Configuration
20
 
21
  ```yaml
22
  slices:
23
  - sources:
24
+ - model: inception-mbzuai/jais-13b
25
  layer_range: [0, 32]
26
+ - model: google/gemma-2b
27
  layer_range: [0, 32]
28
  merge_method: slerp
29
+ base_model: inception-mbzuai/jais-13b
30
  parameters:
31
  t:
32
  - filter: self_attn