Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-ultrabin-reward-scale-01

Safetensors
mistral
alignment-handbook
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
c8790c2
•
1 Parent(s): fe5df90

Training in progress, step 478

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:594dd29f4a7a79bda232895c72e3953eeb5b3661ca589a2d04e190d3874a53cf
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8aa5fc0651eb10a5594a5754df7418b1c5255859e3b555d13536fbaff78fef9a
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3b5ced36e2d93535fc7569061271738d6d0c0c774e74e6d01e53b5e3471318f8
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15b56feedf0fa0e6ecf2e69bc3c1e94346a1f28442e6cd42aadc950b1c55510d
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f6e2745cabab6726e894f1eba7fb220e411e889feda43553e74de262330c22a8
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa66766a05fbc36881d799edc05563fe945b176be087ec068a33e99f37ae7a67
3
  size 4540516344