Update README.md
Browse files
README.md
CHANGED
@@ -1,7 +1,8 @@
|
|
1 |
-
---
|
2 |
-
datasets:
|
3 |
-
- PJMixers/antiven0m_catboros-3.2-dpo-PreferenceShareGPT
|
4 |
-
|
|
|
5 |
![Chosen/Rejected Reward Graph](https://huggingface.co/PJMixers/LLaMa-3-Instruct-Catboros-3.2-ORPO-8B-QDoRA/resolve/main/chosen_rejected_reward_graph.png)
|
6 |
|
7 |
Trained on [antiven0m/catboros-3.2-dpo](https://huggingface.co/datasets/antiven0m/catboros-3.2-dpo).
|
|
|
1 |
+
---
|
2 |
+
datasets:
|
3 |
+
- PJMixers/antiven0m_catboros-3.2-dpo-PreferenceShareGPT
|
4 |
+
- antiven0m/catboros-3.2-dpo
|
5 |
+
---
|
6 |
![Chosen/Rejected Reward Graph](https://huggingface.co/PJMixers/LLaMa-3-Instruct-Catboros-3.2-ORPO-8B-QDoRA/resolve/main/chosen_rejected_reward_graph.png)
|
7 |
|
8 |
Trained on [antiven0m/catboros-3.2-dpo](https://huggingface.co/datasets/antiven0m/catboros-3.2-dpo).
|