BlinkDL
/

rwkv-4-world

Text Generation

Model card Files Files and versions Community

BlinkDL commited on Jun 10, 2023

Commit

4ccf1d2

•

1 Parent(s): a6b6a11

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -34,7 +34,7 @@ How to use:
 * use https://github.com/BlinkDL/ChatRWKV/blob/main/v2/benchmark_world.py to test it
 * larger models are stronger even though not fully trained yet
-The difference between World & Raven:
 * set pipeline = PIPELINE(model, "rwkv_vocab_v20230424") instead of 20B_tokenizer.json (EXACTLY AS WRITTEN HERE. "rwkv_vocab_v20230424" is included in rwkv 0.7.4+)
 * use Question/Answer or User/AI or Human/Bot for chat. **DO NOT USE Bob/Alice or Q/A**
 * use **fp32** (will overflow in fp16 at this moment - fixable in future) or bf16 (slight degradation)

 * use https://github.com/BlinkDL/ChatRWKV/blob/main/v2/benchmark_world.py to test it
 * larger models are stronger even though not fully trained yet
+The differences between World & Raven:
 * set pipeline = PIPELINE(model, "rwkv_vocab_v20230424") instead of 20B_tokenizer.json (EXACTLY AS WRITTEN HERE. "rwkv_vocab_v20230424" is included in rwkv 0.7.4+)
 * use Question/Answer or User/AI or Human/Bot for chat. **DO NOT USE Bob/Alice or Q/A**
 * use **fp32** (will overflow in fp16 at this moment - fixable in future) or bf16 (slight degradation)