rccmsu commited on
Commit
01fa45b
1 Parent(s): 69b3004

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -3
README.md CHANGED
@@ -1,9 +1,14 @@
1
  ---
2
  library_name: peft
 
 
3
  ---
4
- ## Training procedure
 
5
 
6
- ### Framework versions
7
 
 
8
 
9
- - PEFT 0.5.0
 
 
1
  ---
2
  library_name: peft
3
+ language:
4
+ - ru
5
  ---
6
+ Use in the same way as IlyaGusev/saiga2_7b_lora.
7
+ WARNING! Load tokenizer as AutoTokenizer.from_pretrained(model_path, use_fast=True)
8
 
9
+ Up to 60% faster generation and 35% training with HF because of different tokenizer.
10
 
11
+ ## Model description
12
 
13
+ Instruction version (Saiga datasets) of Russian adaptation of LLaMa-2-7B by replacing the tokenizer.
14
+ Paper: Tikhomirov M.M., Chernyshev D.I., Impact of Tokenization on LLaMa Russian Adaptation (will be soon)