Update README.md
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ widget:
|
|
17 |
example_title: Solve Problem
|
18 |
---
|
19 |
|
20 |
-
|
21 |
|
22 |
To create it, we started with the Phi-3-Mini-4K-Instruct model and applied DPO alignment using the distilabel-capybara-dpo-7k-binarized dataset.
|
23 |
|
|
|
17 |
example_title: Solve Problem
|
18 |
---
|
19 |
|
20 |
+
You can see the process with instructions for creating the model in the notebook: [Aligning_DPO_phi3.ipynb](https://github.com/peremartra/Large-Language-Model-Notebooks-Course/blob/main/P2-MHF/Aligning_DPO_phi3.ipynb)
|
21 |
|
22 |
To create it, we started with the Phi-3-Mini-4K-Instruct model and applied DPO alignment using the distilabel-capybara-dpo-7k-binarized dataset.
|
23 |
|