bhavinjawade
commited on
Commit
•
669f8f7
1
Parent(s):
d90f510
Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ datasets:
|
|
7 |
## SOLAR-10B-Nector-Orca-DPO-LoRA-Jawade
|
8 |
|
9 |
### Overview
|
10 |
-
This model
|
11 |
|
12 |
![model_card_image](SOLAR_ORCA.png)
|
13 |
|
|
|
7 |
## SOLAR-10B-Nector-Orca-DPO-LoRA-Jawade
|
8 |
|
9 |
### Overview
|
10 |
+
This model is DPO optimized and aligned version of `upstage/SOLAR-10.7B-Instruct-v1.0` model. Trained on a mixture of Berkeley-nest Nectar dataset and Intel DPO Orca dataset using LoRA.
|
11 |
|
12 |
![model_card_image](SOLAR_ORCA.png)
|
13 |
|