Update README.md
Browse files
README.md
CHANGED
|
@@ -5,10 +5,12 @@ language:
|
|
| 5 |
tags:
|
| 6 |
- moe
|
| 7 |
---
|
| 8 |
-
# Aegolius Acadicus
|
| 9 |
|
| 10 |
|
| 11 |
|
|
|
|
|
|
|
| 12 |
# Prompting
|
| 13 |
|
| 14 |
## Prompt Template for alpaca style
|
|
|
|
| 5 |
tags:
|
| 6 |
- moe
|
| 7 |
---
|
| 8 |
+
# Aegolius Acadicus 30B
|
| 9 |
|
| 10 |
|
| 11 |
|
| 12 |
+
I like to call this model "The little professor". It is simply a MOE merge of lora merged models across Llama2 and Mistral. I am using this as a test case to move to larger models and get my gate discrimination set correctly. This model is best suited for knowledge related use cases, I did not give it a specific workload target as I did with some of the other models in the "Owl Series".
|
| 13 |
+
|
| 14 |
# Prompting
|
| 15 |
|
| 16 |
## Prompt Template for alpaca style
|