Update README.md
Browse files
README.md
CHANGED
@@ -1,16 +1,19 @@
|
|
1 |
---
|
2 |
-
base_model: []
|
3 |
tags:
|
4 |
-
-
|
5 |
- merge
|
6 |
license: apache-2.0
|
7 |
---
|
|
|
|
|
|
|
8 |
# mhm-7-3
|
9 |
|
10 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
11 |
|
12 |
|
13 |
Merged model based on mistral. created using dare_ties and models from top of openllm leaderboard.
|
|
|
14 |
Mixed 7 models into 1. 3 times merging.
|
15 |
|
16 |
Just an experiment.
|
|
|
1 |
---
|
|
|
2 |
tags:
|
3 |
+
- moe
|
4 |
- merge
|
5 |
license: apache-2.0
|
6 |
---
|
7 |
+
|
8 |
+
![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6589d7e6586088fd2784a12c/ey84O7VrsOnsE7Ra8prgH.jpeg)
|
9 |
+
|
10 |
# mhm-7-3
|
11 |
|
12 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
13 |
|
14 |
|
15 |
Merged model based on mistral. created using dare_ties and models from top of openllm leaderboard.
|
16 |
+
|
17 |
Mixed 7 models into 1. 3 times merging.
|
18 |
|
19 |
Just an experiment.
|