Model save

README.md

@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [EleutherAI/pythia-410m-deduped](https://huggingface.co/EleutherAI/pythia-410m-deduped) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 2.5805
+- Loss: 2.5290
 
 ## Model description
 
@@ -34,7 +34,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 3e-06
+- learning_rate: 1e-05
 - train_batch_size: 32
 - eval_batch_size: 8
 - seed: 42
@@ -47,17 +47,17 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss |
-|:-------------:|:-----:|:----:|:---------------:|
-| 2.7228        | 0.2   | 183  | 2.6403          |
-| 2.6244        | 0.4   | 366  | 2.6018          |
-| 2.5986        | 0.6   | 549  | 2.5865          |
-| 2.5808        | 0.8   | 732  | 2.5805          |
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 2.6789        | 0.2007 | 183  | 2.5844          |
+| 2.5737        | 0.4013 | 366  | 2.5528          |
+| 2.5499        | 0.6020 | 549  | 2.5367          |
+| 2.5298        | 0.8026 | 732  | 2.5290          |
 
 
 ### Framework versions
 
-- Transformers 4.38.2
-- Pytorch 2.1.2+cu121
-- Datasets 2.17.0
-- Tokenizers 0.15.2
+- Transformers 4.40.2
+- Pytorch 2.2.1+cu121
+- Datasets 2.19.1
+- Tokenizers 0.19.1

generation_config.json

@@ -2,5 +2,5 @@
   "_from_model_config": true,
   "bos_token_id": 0,
   "eos_token_id": 0,
-  "transformers_version": "4.38.2"
+  "transformers_version": "4.40.2"
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e8dc7b15194ef9e3c3d20e8665d638a3ebf3235fdf77b95e45334a8edb52643e
+oid sha256:ed928d9fbdd2e9501b8015cf372708f73f9e95583a3d73f4370fab8815afb3e1
 size 1621370224