Update README.md
Browse files
README.md
CHANGED
@@ -35,7 +35,7 @@ lora_target_modules:
|
|
35 |
- o_proj
|
36 |
```
|
37 |
|
38 |
-
The model is coherent even with training the "zeroed"
|
39 |
the recommendation from [Charles Goddard](https://huggingface.co/chargoddard) - thank you for sharing the method of merging as well as Toasty
|
40 |
Pigeon for bringing it to my attention!
|
41 |
|
|
|
35 |
- o_proj
|
36 |
```
|
37 |
|
38 |
+
The model is coherent even with training the "zeroed" layers and can write well. In the next experiment, all layers will be finetuned as this was
|
39 |
the recommendation from [Charles Goddard](https://huggingface.co/chargoddard) - thank you for sharing the method of merging as well as Toasty
|
40 |
Pigeon for bringing it to my attention!
|
41 |
|