Update README.md
Browse files
README.md
CHANGED
|
@@ -13,6 +13,10 @@ base_model:
|
|
| 13 |
- aloobun/Cypher-CoT-Laser-1.8B
|
| 14 |
---
|
| 15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
# Cypher-Laser-Mixtral-2x1.8B-v0.1
|
| 17 |
|
| 18 |
Cypher-Laser-Mixtral-2x1.8B-v0.1 is a Mixure of Experts (MoE) made with the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
|
|
|
| 13 |
- aloobun/Cypher-CoT-Laser-1.8B
|
| 14 |
---
|
| 15 |
|
| 16 |
+
This work is based on implementation of the LASER technique, by @fernandofernandes & @ehartford.
|
| 17 |
+
|
| 18 |
+
I 'lasered' two models first and then merged them.
|
| 19 |
+
|
| 20 |
# Cypher-Laser-Mixtral-2x1.8B-v0.1
|
| 21 |
|
| 22 |
Cypher-Laser-Mixtral-2x1.8B-v0.1 is a Mixure of Experts (MoE) made with the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|