Hugging Face's logo

sfulay
/
zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-2

Safetensors
mistral
trl
dpo
Generated from Trainer
Model card Files Community
sfulay commited on
Commit
aa34c83
•
1 Parent(s): 73d237e

Training in progress, step 436

Browse files
Files changed (3) hide show
  1. model-00001-of-00003.safetensors +1 -1
  2. model-00002-of-00003.safetensors +1 -1
  3. model-00003-of-00003.safetensors +1 -1
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aef3257242d19cd67a4eceab920c8f6baf15b98032c92c5362078a6b7eb21ac5
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:944878d2d7afd4b14677a3ac8478d7f7b3b68865944fa7295ef25fdc14f8dfa7
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4889d4b59c14d621592bd6a9ae76581a0c87b18db694c79bca78f2ce4907429
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4653b73532c8fa36912ab814d96ff3bb4cc6f80f38602a3067fe56a03105ff24
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a59e8db4f26bd220f32fb9a9b09d98bf1d533a4a786417370f5d90c673dd6df7
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3dd00f85b02d0fe1e84424c1572306a4be381a021bd06eea06d5774e74b92b82
3
  size 4540516344