DIBT Prompt collective SPIN
Collection
This collection contains resources related to the replication of SPIN with the dibt prompt collective dataset
•
8 items
•
Updated
•
7
This model is a fine-tuned version of argilla/zephyr-7b-spin-iter0-v0 on the argilla/10k_prompts_SPIN_iter1_zephyr_top and argilla/10k_prompts_SPIN_iter0_zephyr_top dataset.
It achieves the following results on the evaluation set:
Model | 1st Turn Score | 2nd Turn Score | Average Score |
---|---|---|---|
zephyr-7b-sft-full | 6.6625 | 6.0250 | 6.34375 |
zephyr-7b-spin-iter0-v0 | 6.64375 | 6.1750 | 6.409375 |
zephyr-7b-spin-iter1-v0 | 6.90625 | 6.3000 | 6.603125 |
zephyr-7b-spin-iter2-v0 | 7.1375 | 6.3125 | 6.725000 |
zephyr-7b-spin-iter3-v0 | 7.09375 | 6.4500 | 6.771875 |
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
Training Loss | Epoch | Step | Validation Loss | Rewards/real | Rewards/generated | Rewards/accuracies | Rewards/margins | Logps/generated | Logps/real | Logits/generated | Logits/real |
---|---|---|---|---|---|---|---|---|---|---|---|
0.1827 | 0.49 | 25 | 0.1651 | 0.1714 | -3.3650 | 0.9688 | 3.5364 | -524.2469 | -283.6962 | -2.7482 | -2.7944 |
0.0462 | 0.97 | 50 | 0.0835 | 1.4823 | -4.4998 | 1.0 | 5.9821 | -535.5947 | -270.5871 | -2.6963 | -2.7356 |
0.0047 | 1.46 | 75 | 0.0837 | 1.3725 | -5.2500 | 0.9896 | 6.6225 | -543.0965 | -271.6846 | -2.6847 | -2.7211 |
0.0034 | 1.94 | 100 | 0.0831 | 1.3037 | -5.4434 | 0.9792 | 6.7471 | -545.0309 | -272.3726 | -2.6844 | -2.7197 |
Base model
mistralai/Mistral-7B-v0.1