Training in progress, step 75, checkpoint

checkpoint-75/README.md

@@ -0,0 +1,202 @@
+---
+base_model: microsoft/Phi-3-mini-4k-instruct
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.11.1

checkpoint-75/adapter_config.json

@@ -0,0 +1,34 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "microsoft/Phi-3-mini-4k-instruct",
+  "bias": "none",
+  "fan_in_fan_out": null,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_dropout": 0.05,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": [
+    "embed_tokens",
+    "lm_head"
+  ],
+  "peft_type": "LORA",
+  "r": 512,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "o_proj",
+    "qkv_proj",
+    "down_proj",
+    "gate_up_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "use_dora": false,
+  "use_rslora": false
+}

checkpoint-75/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7fd786fb02f9df57284528f424d9c5096fb494614df8a7384707163721ddbdd0
+size 2004651224

checkpoint-75/added_tokens.json

@@ -0,0 +1,17 @@
+{
+  "</plan>": 32014,
+  "</thinking>": 32012,
+  "<plan>": 32013,
+  "<thinking>": 32011,
+  "<|assistant|>": 32001,
+  "<|endoftext|>": 32000,
+  "<|end|>": 32007,
+  "<|placeholder1|>": 32002,
+  "<|placeholder2|>": 32003,
+  "<|placeholder3|>": 32004,
+  "<|placeholder4|>": 32005,
+  "<|placeholder5|>": 32008,
+  "<|placeholder6|>": 32009,
+  "<|system|>": 32006,
+  "<|user|>": 32010
+}

checkpoint-75/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd80b24feedaf233ad69a09d92a1b6affd72cff923568f84ed66718cad751657
+size 4009448634

checkpoint-75/rng_state_0.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d8cc9014cf36259f3c513e5c5fc897df69ac7ea9b388c12cae5f0a11ccb9c9fc
+size 15984

checkpoint-75/rng_state_1.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:44be4815aeb7bb702bd6453a057e70b52635cd8b3cba140e0368581bd56b098d
+size 15984

checkpoint-75/rng_state_2.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bb1facf518858e3a03f66aaf2d88d071eb4aee17eb1e9988793518f71574fec3
+size 15984

checkpoint-75/rng_state_3.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a8413721d4c06bffc4326befe35dc7ee8d08104e1a88257421c3c7cf2e64202e
+size 15984

checkpoint-75/rng_state_4.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e430090ac75315ba41c64c78346e313a508a822ac6e55c8efb4468a1f44d91df
+size 15984

checkpoint-75/rng_state_5.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:83ace4130150aa83942bb9127bebfe6165548ab50143f981f3694a2458c6062d
+size 15984

checkpoint-75/rng_state_6.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1418a581fd07561510940237aa823e318a3e88bda121be9b0a854f3d088d0755
+size 15984

checkpoint-75/rng_state_7.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e0c861a637f0e12be4293f0c63a5f56344bf3c4b8143450502997df1f93abf68
+size 15984

checkpoint-75/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3b12bc69afdd94ad849575074e52e02f343ade47c46bc2e039c323acf04a738d
+size 1064

checkpoint-75/special_tokens_map.json

@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-75/tokenizer.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
+size 499723

checkpoint-75/tokenizer_config.json

@@ -0,0 +1,163 @@
+{
+  "add_bos_token": false,
+  "add_eos_token": false,
+  "add_prefix_space": null,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": false
+    },
+    "32000": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32001": {
+      "content": "<|assistant|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32002": {
+      "content": "<|placeholder1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32003": {
+      "content": "<|placeholder2|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32004": {
+      "content": "<|placeholder3|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32005": {
+      "content": "<|placeholder4|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32006": {
+      "content": "<|system|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32007": {
+      "content": "<|end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32008": {
+      "content": "<|placeholder5|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32009": {
+      "content": "<|placeholder6|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32010": {
+      "content": "<|user|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": true,
+      "single_word": false,
+      "special": true
+    },
+    "32011": {
+      "content": "<thinking>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "32012": {
+      "content": "</thinking>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "32013": {
+      "content": "<plan>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "32014": {
+      "content": "</plan>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "bos_token": "<s>",
+  "chat_template": "{{ bos_token }}{% for message in messages %}{% if (message['role'] == 'system') %}{{'<|system|>' + '\n' + message['content'] + '<|end|>' + '\n'}}{% elif (message['role'] == 'user') %}{{'<|user|>' + '\n' + message['content'] + '<|end|>' + '\n' + '<|assistant|>' + '\n'}}{% elif message['role'] == 'assistant' %}{{message['content'] + '<|end|>' + '\n'}}{% endif %}{% endfor %}",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|endoftext|>",
+  "legacy": false,
+  "model_max_length": 4096,
+  "pad_token": "<|endoftext|>",
+  "padding_side": "left",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}

checkpoint-75/trainer_state.json

@@ -0,0 +1,574 @@
+{
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.25252525252525254,
+  "eval_steps": 38,
+  "global_step": 75,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.003367003367003367,
+      "grad_norm": 2.0,
+      "learning_rate": 4.5454545454545457e-07,
+      "loss": 1.0833,
+      "step": 1
+    },
+    {
+      "epoch": 0.003367003367003367,
+      "eval_loss": 1.032954454421997,
+      "eval_runtime": 8.7786,
+      "eval_samples_per_second": 56.957,
+      "eval_steps_per_second": 3.645,
+      "step": 1
+    },
+    {
+      "epoch": 0.006734006734006734,
+      "grad_norm": 2.265625,
+      "learning_rate": 9.090909090909091e-07,
+      "loss": 0.996,
+      "step": 2
+    },
+    {
+      "epoch": 0.010101010101010102,
+      "grad_norm": 1.6484375,
+      "learning_rate": 1.3636363636363636e-06,
+      "loss": 1.0487,
+      "step": 3
+    },
+    {
+      "epoch": 0.013468013468013467,
+      "grad_norm": 2.046875,
+      "learning_rate": 1.8181818181818183e-06,
+      "loss": 1.0554,
+      "step": 4
+    },
+    {
+      "epoch": 0.016835016835016835,
+      "grad_norm": 2.4375,
+      "learning_rate": 2.2727272727272728e-06,
+      "loss": 1.0341,
+      "step": 5
+    },
+    {
+      "epoch": 0.020202020202020204,
+      "grad_norm": 1.9609375,
+      "learning_rate": 2.7272727272727272e-06,
+      "loss": 1.0132,
+      "step": 6
+    },
+    {
+      "epoch": 0.02356902356902357,
+      "grad_norm": 2.625,
+      "learning_rate": 3.181818181818182e-06,
+      "loss": 1.0298,
+      "step": 7
+    },
+    {
+      "epoch": 0.026936026936026935,
+      "grad_norm": 2.296875,
+      "learning_rate": 3.6363636363636366e-06,
+      "loss": 1.0216,
+      "step": 8
+    },
+    {
+      "epoch": 0.030303030303030304,
+      "grad_norm": 2.234375,
+      "learning_rate": 4.0909090909090915e-06,
+      "loss": 1.0736,
+      "step": 9
+    },
+    {
+      "epoch": 0.03367003367003367,
+      "grad_norm": 2.1875,
+      "learning_rate": 4.5454545454545455e-06,
+      "loss": 1.0216,
+      "step": 10
+    },
+    {
+      "epoch": 0.037037037037037035,
+      "grad_norm": 2.359375,
+      "learning_rate": 5e-06,
+      "loss": 1.0075,
+      "step": 11
+    },
+    {
+      "epoch": 0.04040404040404041,
+      "grad_norm": 1.890625,
+      "learning_rate": 5.4545454545454545e-06,
+      "loss": 1.051,
+      "step": 12
+    },
+    {
+      "epoch": 0.04377104377104377,
+      "grad_norm": 1.90625,
+      "learning_rate": 5.90909090909091e-06,
+      "loss": 1.0655,
+      "step": 13
+    },
+    {
+      "epoch": 0.04713804713804714,
+      "grad_norm": 1.6484375,
+      "learning_rate": 6.363636363636364e-06,
+      "loss": 1.0297,
+      "step": 14
+    },
+    {
+      "epoch": 0.050505050505050504,
+      "grad_norm": 1.6953125,
+      "learning_rate": 6.818181818181818e-06,
+      "loss": 1.0411,
+      "step": 15
+    },
+    {
+      "epoch": 0.05387205387205387,
+      "grad_norm": 1.9921875,
+      "learning_rate": 7.272727272727273e-06,
+      "loss": 1.0618,
+      "step": 16
+    },
+    {
+      "epoch": 0.05723905723905724,
+      "grad_norm": 1.4453125,
+      "learning_rate": 7.727272727272727e-06,
+      "loss": 1.0052,
+      "step": 17
+    },
+    {
+      "epoch": 0.06060606060606061,
+      "grad_norm": 1.390625,
+      "learning_rate": 8.181818181818183e-06,
+      "loss": 1.0053,
+      "step": 18
+    },
+    {
+      "epoch": 0.06397306397306397,
+      "grad_norm": 1.2734375,
+      "learning_rate": 8.636363636363637e-06,
+      "loss": 0.9786,
+      "step": 19
+    },
+    {
+      "epoch": 0.06734006734006734,
+      "grad_norm": 1.234375,
+      "learning_rate": 9.090909090909091e-06,
+      "loss": 1.0419,
+      "step": 20
+    },
+    {
+      "epoch": 0.0707070707070707,
+      "grad_norm": 1.1484375,
+      "learning_rate": 9.545454545454547e-06,
+      "loss": 1.0356,
+      "step": 21
+    },
+    {
+      "epoch": 0.07407407407407407,
+      "grad_norm": 1.28125,
+      "learning_rate": 1e-05,
+      "loss": 0.9778,
+      "step": 22
+    },
+    {
+      "epoch": 0.07744107744107744,
+      "grad_norm": 1.1875,
+      "learning_rate": 1.0454545454545455e-05,
+      "loss": 0.9691,
+      "step": 23
+    },
+    {
+      "epoch": 0.08080808080808081,
+      "grad_norm": 1.1953125,
+      "learning_rate": 1.0909090909090909e-05,
+      "loss": 1.0408,
+      "step": 24
+    },
+    {
+      "epoch": 0.08417508417508418,
+      "grad_norm": 1.078125,
+      "learning_rate": 1.1363636363636366e-05,
+      "loss": 0.9799,
+      "step": 25
+    },
+    {
+      "epoch": 0.08754208754208755,
+      "grad_norm": 1.0390625,
+      "learning_rate": 1.181818181818182e-05,
+      "loss": 0.9756,
+      "step": 26
+    },
+    {
+      "epoch": 0.09090909090909091,
+      "grad_norm": 1.1875,
+      "learning_rate": 1.2272727272727274e-05,
+      "loss": 1.0451,
+      "step": 27
+    },
+    {
+      "epoch": 0.09427609427609428,
+      "grad_norm": 1.0546875,
+      "learning_rate": 1.2727272727272728e-05,
+      "loss": 1.0093,
+      "step": 28
+    },
+    {
+      "epoch": 0.09764309764309764,
+      "grad_norm": 0.96484375,
+      "learning_rate": 1.3181818181818183e-05,
+      "loss": 0.99,
+      "step": 29
+    },
+    {
+      "epoch": 0.10101010101010101,
+      "grad_norm": 1.0703125,
+      "learning_rate": 1.3636363636363637e-05,
+      "loss": 1.0079,
+      "step": 30
+    },
+    {
+      "epoch": 0.10437710437710437,
+      "grad_norm": 0.89453125,
+      "learning_rate": 1.4090909090909092e-05,
+      "loss": 0.9653,
+      "step": 31
+    },
+    {
+      "epoch": 0.10774410774410774,
+      "grad_norm": 1.0546875,
+      "learning_rate": 1.4545454545454546e-05,
+      "loss": 0.9926,
+      "step": 32
+    },
+    {
+      "epoch": 0.1111111111111111,
+      "grad_norm": 0.96875,
+      "learning_rate": 1.5000000000000002e-05,
+      "loss": 0.9857,
+      "step": 33
+    },
+    {
+      "epoch": 0.11447811447811448,
+      "grad_norm": 1.1484375,
+      "learning_rate": 1.5454545454545454e-05,
+      "loss": 0.9676,
+      "step": 34
+    },
+    {
+      "epoch": 0.11784511784511785,
+      "grad_norm": 1.078125,
+      "learning_rate": 1.590909090909091e-05,
+      "loss": 0.9686,
+      "step": 35
+    },
+    {
+      "epoch": 0.12121212121212122,
+      "grad_norm": 0.8203125,
+      "learning_rate": 1.6363636363636366e-05,
+      "loss": 0.9182,
+      "step": 36
+    },
+    {
+      "epoch": 0.12457912457912458,
+      "grad_norm": 0.8515625,
+      "learning_rate": 1.681818181818182e-05,
+      "loss": 0.9506,
+      "step": 37
+    },
+    {
+      "epoch": 0.12794612794612795,
+      "grad_norm": 0.86328125,
+      "learning_rate": 1.7272727272727274e-05,
+      "loss": 0.9533,
+      "step": 38
+    },
+    {
+      "epoch": 0.12794612794612795,
+      "eval_loss": 0.9329763054847717,
+      "eval_runtime": 8.7095,
+      "eval_samples_per_second": 57.409,
+      "eval_steps_per_second": 3.674,
+      "step": 38
+    },
+    {
+      "epoch": 0.13131313131313133,
+      "grad_norm": 0.7890625,
+      "learning_rate": 1.772727272727273e-05,
+      "loss": 0.9225,
+      "step": 39
+    },
+    {
+      "epoch": 0.13468013468013468,
+      "grad_norm": 0.890625,
+      "learning_rate": 1.8181818181818182e-05,
+      "loss": 0.9378,
+      "step": 40
+    },
+    {
+      "epoch": 0.13804713804713806,
+      "grad_norm": 1.046875,
+      "learning_rate": 1.8636363636363638e-05,
+      "loss": 0.8982,
+      "step": 41
+    },
+    {
+      "epoch": 0.1414141414141414,
+      "grad_norm": 0.94921875,
+      "learning_rate": 1.9090909090909094e-05,
+      "loss": 0.8958,
+      "step": 42
+    },
+    {
+      "epoch": 0.1447811447811448,
+      "grad_norm": 0.9765625,
+      "learning_rate": 1.9545454545454546e-05,
+      "loss": 0.8796,
+      "step": 43
+    },
+    {
+      "epoch": 0.14814814814814814,
+      "grad_norm": 0.92578125,
+      "learning_rate": 2e-05,
+      "loss": 0.8808,
+      "step": 44
+    },
+    {
+      "epoch": 0.15151515151515152,
+      "grad_norm": 0.94921875,
+      "learning_rate": 1.9999931213623708e-05,
+      "loss": 0.8638,
+      "step": 45
+    },
+    {
+      "epoch": 0.15488215488215487,
+      "grad_norm": 1.0390625,
+      "learning_rate": 1.999972485544114e-05,
+      "loss": 0.9124,
+      "step": 46
+    },
+    {
+      "epoch": 0.15824915824915825,
+      "grad_norm": 1.046875,
+      "learning_rate": 1.999938092829122e-05,
+      "loss": 0.8757,
+      "step": 47
+    },
+    {
+      "epoch": 0.16161616161616163,
+      "grad_norm": 0.73046875,
+      "learning_rate": 1.999889943690545e-05,
+      "loss": 0.885,
+      "step": 48
+    },
+    {
+      "epoch": 0.16498316498316498,
+      "grad_norm": 0.86328125,
+      "learning_rate": 1.9998280387907845e-05,
+      "loss": 0.8664,
+      "step": 49
+    },
+    {
+      "epoch": 0.16835016835016836,
+      "grad_norm": 0.87109375,
+      "learning_rate": 1.9997523789814827e-05,
+      "loss": 0.8512,
+      "step": 50
+    },
+    {
+      "epoch": 0.1717171717171717,
+      "grad_norm": 0.80859375,
+      "learning_rate": 1.9996629653035128e-05,
+      "loss": 0.8428,
+      "step": 51
+    },
+    {
+      "epoch": 0.1750841750841751,
+      "grad_norm": 0.71875,
+      "learning_rate": 1.9995597989869625e-05,
+      "loss": 0.8536,
+      "step": 52
+    },
+    {
+      "epoch": 0.17845117845117844,
+      "grad_norm": 0.6171875,
+      "learning_rate": 1.9994428814511205e-05,
+      "loss": 0.82,
+      "step": 53
+    },
+    {
+      "epoch": 0.18181818181818182,
+      "grad_norm": 0.71875,
+      "learning_rate": 1.999312214304453e-05,
+      "loss": 0.8043,
+      "step": 54
+    },
+    {
+      "epoch": 0.18518518518518517,
+      "grad_norm": 0.8046875,
+      "learning_rate": 1.9991677993445832e-05,
+      "loss": 0.8525,
+      "step": 55
+    },
+    {
+      "epoch": 0.18855218855218855,
+      "grad_norm": 0.6015625,
+      "learning_rate": 1.9990096385582682e-05,
+      "loss": 0.7958,
+      "step": 56
+    },
+    {
+      "epoch": 0.1919191919191919,
+      "grad_norm": 0.79296875,
+      "learning_rate": 1.998837734121369e-05,
+      "loss": 0.8001,
+      "step": 57
+    },
+    {
+      "epoch": 0.19528619528619529,
+      "grad_norm": 0.7109375,
+      "learning_rate": 1.9986520883988233e-05,
+      "loss": 0.805,
+      "step": 58
+    },
+    {
+      "epoch": 0.19865319865319866,
+      "grad_norm": 0.84375,
+      "learning_rate": 1.9984527039446093e-05,
+      "loss": 0.7821,
+      "step": 59
+    },
+    {
+      "epoch": 0.20202020202020202,
+      "grad_norm": 1.1015625,
+      "learning_rate": 1.998239583501714e-05,
+      "loss": 0.7932,
+      "step": 60
+    },
+    {
+      "epoch": 0.2053872053872054,
+      "grad_norm": 0.6953125,
+      "learning_rate": 1.9980127300020946e-05,
+      "loss": 0.7925,
+      "step": 61
+    },
+    {
+      "epoch": 0.20875420875420875,
+      "grad_norm": 0.60546875,
+      "learning_rate": 1.9977721465666365e-05,
+      "loss": 0.7846,
+      "step": 62
+    },
+    {
+      "epoch": 0.21212121212121213,
+      "grad_norm": 0.7265625,
+      "learning_rate": 1.9975178365051123e-05,
+      "loss": 0.7671,
+      "step": 63
+    },
+    {
+      "epoch": 0.21548821548821548,
+      "grad_norm": 0.70703125,
+      "learning_rate": 1.997249803316136e-05,
+      "loss": 0.8194,
+      "step": 64
+    },
+    {
+      "epoch": 0.21885521885521886,
+      "grad_norm": 0.81640625,
+      "learning_rate": 1.9969680506871138e-05,
+      "loss": 0.7607,
+      "step": 65
+    },
+    {
+      "epoch": 0.2222222222222222,
+      "grad_norm": 0.61328125,
+      "learning_rate": 1.9966725824941933e-05,
+      "loss": 0.7858,
+      "step": 66
+    },
+    {
+      "epoch": 0.2255892255892256,
+      "grad_norm": 0.66015625,
+      "learning_rate": 1.9963634028022133e-05,
+      "loss": 0.7546,
+      "step": 67
+    },
+    {
+      "epoch": 0.22895622895622897,
+      "grad_norm": 0.6875,
+      "learning_rate": 1.9960405158646425e-05,
+      "loss": 0.7915,
+      "step": 68
+    },
+    {
+      "epoch": 0.23232323232323232,
+      "grad_norm": 0.59765625,
+      "learning_rate": 1.9957039261235263e-05,
+      "loss": 0.7324,
+      "step": 69
+    },
+    {
+      "epoch": 0.2356902356902357,
+      "grad_norm": 0.65625,
+      "learning_rate": 1.9953536382094218e-05,
+      "loss": 0.7735,
+      "step": 70
+    },
+    {
+      "epoch": 0.23905723905723905,
+      "grad_norm": 0.984375,
+      "learning_rate": 1.9949896569413368e-05,
+      "loss": 0.7356,
+      "step": 71
+    },
+    {
+      "epoch": 0.24242424242424243,
+      "grad_norm": 0.8125,
+      "learning_rate": 1.9946119873266615e-05,
+      "loss": 0.7407,
+      "step": 72
+    },
+    {
+      "epoch": 0.24579124579124578,
+      "grad_norm": 0.76953125,
+      "learning_rate": 1.9942206345611008e-05,
+      "loss": 0.7124,
+      "step": 73
+    },
+    {
+      "epoch": 0.24915824915824916,
+      "grad_norm": 0.6640625,
+      "learning_rate": 1.9938156040286027e-05,
+      "loss": 0.7295,
+      "step": 74
+    },
+    {
+      "epoch": 0.25252525252525254,
+      "grad_norm": 0.5546875,
+      "learning_rate": 1.993396901301283e-05,
+      "loss": 0.733,
+      "step": 75
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 891,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 3,
+  "save_steps": 75,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 1.36437672443904e+17,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-75/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3fe3399e1833e4baeabfb150d83c5b0e5f796c95cfa06424bda5f2c881c0a1e7
+size 6392