EddyGiusepe commited on
Commit
dd49dec
1 Parent(s): 250eaf7

End of training

Browse files
Files changed (1) hide show
  1. README.md +10 -5
README.md CHANGED
@@ -1,8 +1,11 @@
1
  ---
2
  license: mit
3
- base_model: TheBloke/zephyr-7B-alpha-GPTQ
4
  tags:
 
 
5
  - generated_from_trainer
 
6
  model-index:
7
  - name: zephyr-support-chatbot
8
  results: []
@@ -39,6 +42,7 @@ The following hyperparameters were used during training:
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: cosine
41
  - training_steps: 250
 
42
 
43
  ### Training results
44
 
@@ -46,7 +50,8 @@ The following hyperparameters were used during training:
46
 
47
  ### Framework versions
48
 
49
- - Transformers 4.34.1
50
- - Pytorch 2.1.0+cu118
51
- - Datasets 2.14.5
52
- - Tokenizers 0.14.1
 
 
1
  ---
2
  license: mit
3
+ library_name: peft
4
  tags:
5
+ - trl
6
+ - sft
7
  - generated_from_trainer
8
+ base_model: TheBloke/zephyr-7B-alpha-GPTQ
9
  model-index:
10
  - name: zephyr-support-chatbot
11
  results: []
 
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: cosine
44
  - training_steps: 250
45
+ - mixed_precision_training: Native AMP
46
 
47
  ### Training results
48
 
 
50
 
51
  ### Framework versions
52
 
53
+ - PEFT 0.7.1
54
+ - Transformers 4.36.2
55
+ - Pytorch 2.1.0+cu121
56
+ - Datasets 2.16.1
57
+ - Tokenizers 0.15.0