Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-prometheus_consistent-reward-scale-1-rpo

Safetensors
mistral
trl
dpo
alignment-handbook
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
69d707b
•
1 Parent(s): 458b6c5

Training in progress, step 437

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d93991a56be6c3ccbbf833c0473b57059fffc079c7b2e72353fcbca995b9ae09
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a16996512c2f0318b313acd5cbbd2955f2de60f80643fe3362509213fc4b96e
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0be3e23405f48c20587c8a0bb9d9b1dd3839ff30064f10dd2ae6b342ed420e2f
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a50856b4422d2977f2685ab7f0f05f160b22d5953300d21883994a161722a20
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:daac7eb4018866a9722faca5e74a0e8924f50374e2b25d8ae6a76ad2b03703d6
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c01b4a827fe28570eefef7140f3d2290f7897751116084c5469bd9ec2b5d1d0f
3
  size 4540516344