Training in progress, step 3000

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:acfde6812ec52d58edd0f322dd43d7a40cc7c51df248e3a62b6b25ca9cb07b4a
+oid sha256:2879cb08959ad221b66c21ab4d4a493e4c88388cffc24e734cebf848dc86db1d
 size 305452744

runs/Jul19_15-13-23_8df4908137f9/events.out.tfevents.1721402005.8df4908137f9.35.1

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:278933a2a2abb99e3d8ebe06b0cbb84204f2b50e9e3f9bc049be54c8846071e5
-size 9751
+oid sha256:fc17085243a662bf817d7b60895d82b3e643bc4691b248a3edea859e4ca73dc2
+size 10332

wandb/run-20240719_150308-wq61zns9/files/output.log

@@ -7,3 +7,5 @@ Non-default generation parameters: {'max_length': 512, 'num_beams': 4, 'bad_word
 Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
 Non-default generation parameters: {'max_length': 512, 'num_beams': 4, 'bad_words_ids': [[62801]], 'forced_eos_token_id': 0}
 Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.
+Non-default generation parameters: {'max_length': 512, 'num_beams': 4, 'bad_words_ids': [[62801]], 'forced_eos_token_id': 0}
+Some non-default generation parameters are set in the model config. These should go into a GenerationConfig file (https://huggingface.co/docs/transformers/generation_strategies#save-a-custom-decoding-strategy-with-your-model) instead. This warning will be raised to an exception in v4.41.

wandb/run-20240719_150308-wq61zns9/files/wandb-summary.json

@@ -1 +1 @@
-{"eval/loss": 0.11479848623275757, "eval/bleu": 21.4563, "eval/gen_len": 67.4739, "eval/runtime": 282.2418, "eval/samples_per_second": 4.418, "eval/steps_per_second": 0.276, "train/epoch": 8.012820512820513, "train/global_step": 2500, "_timestamp": 1721406065.5486827, "_runtime": 4677.009863615036, "_step": 12, "train/loss": 0.0859, "train/grad_norm": 0.31690147519111633, "train/learning_rate": 3.974358974358974e-06}
+{"eval/loss": 0.11444152891635895, "eval/bleu": 21.8952, "eval/gen_len": 67.3031, "eval/runtime": 280.9076, "eval/samples_per_second": 4.439, "eval/steps_per_second": 0.278, "train/epoch": 9.615384615384615, "train/global_step": 3000, "_timestamp": 1721406708.9238005, "_runtime": 5320.384981393814, "_step": 14, "train/loss": 0.0814, "train/grad_norm": 0.2923108637332916, "train/learning_rate": 7.692307692307694e-07}