End of training

README.md

@@ -1,6 +1,7 @@
 ---
 library_name: peft
 tags:
+- axolotl
 - generated_from_trainer
 base_model: NousResearch/Llama-2-7b-hf
 model-index:
@@ -96,7 +97,9 @@ special_tokens:
 
 # neocortex
 
-This model is a fine-tuned version of [NousResearch/Llama-2-7b-hf](https://huggingface.co/NousResearch/Llama-2-7b-hf) on an unknown dataset.
+This model is a fine-tuned version of [NousResearch/Llama-2-7b-hf](https://huggingface.co/NousResearch/Llama-2-7b-hf) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.4558
 
 ## Model description
 
@@ -129,6 +132,22 @@ The following hyperparameters were used during training:
 - lr_scheduler_warmup_steps: 10
 - num_epochs: 3
 
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 1.5181        | 0.29  | 20   | 1.5627          |
+| 1.437         | 0.58  | 40   | 1.4861          |
+| 1.5196        | 0.87  | 60   | 1.4610          |
+| 1.4037        | 1.16  | 80   | 1.4512          |
+| 1.372         | 1.45  | 100  | 1.4493          |
+| 1.3853        | 1.74  | 120  | 1.4424          |
+| 1.2367        | 2.03  | 140  | 1.4460          |
+| 1.283         | 2.32  | 160  | 1.4602          |
+| 1.2933        | 2.61  | 180  | 1.4583          |
+| 1.2397        | 2.9   | 200  | 1.4558          |
+
+
 ### Framework versions
 
 - PEFT 0.8.2

adapter_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eb191d2c40b3c451e98d773c7f145ad7b2f67633a0fc059ef4a9b495d992467d
+size 319977229