Fizzarolli commited on
Commit
f73df71
1 Parent(s): 926b2ba

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md CHANGED
@@ -5,7 +5,29 @@ base_model: allenai/OLMoE-1B-7B-0924
5
  tags:
6
  - axolotl
7
  - moe
 
8
  model-index:
9
  - name: MoE-girl_1BA_7BT
10
  results: []
11
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  tags:
6
  - axolotl
7
  - moe
8
+ - roleplay
9
  model-index:
10
  - name: MoE-girl_1BA_7BT
11
  results: []
12
  ---
13
+ # MoE Girl 1bA 7bT
14
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634262af8d8089ebaefd410e/kTXXSSSqpb21rfyOX7FUa.jpeg)
15
+
16
+ A finetune of OLMoE by AllenAI designed for roleplaying (and maybe general usecases if you try hartd enough).
17
+
18
+ ## Disclaimer
19
+ PLEASE do not expect godliness out of this, it's a model with 1 billion active parameters at once. Expect something more akin to Gemma 2 2B, not Llama 3 8B.
20
+
21
+ ## Prompting
22
+ Use ChatML.
23
+ ```
24
+ <|im_start|>system
25
+ You are a helpful assistant who talks like a pirate.<|im_end|>
26
+ <|im_start|>user
27
+ Hello there!<|im_end|>
28
+ <|im_start|>assistant
29
+ Yarr harr harr, me matey!<|im_end|>
30
+ ```
31
+
32
+ ## Thanks
33
+ Special thanks to the members of Allura for testing and emotional support, as well as the creators of all the datasets that were used in the Special Sauce used to train this model. I love you all <3 - Fizz