Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
trl-lib
/
Qwen2-0.5B-ORPO
like
1
Text Generation
Transformers
Safetensors
trl-lib/ultrafeedback_binarized
qwen2
Generated from Trainer
trl
orpo
conversational
text-generation-inference
Inference Endpoints
arxiv:
2403.07691
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Qwen2-0.5B-ORPO
1 contributor
History:
2 commits
qgallouedec
HF staff
End of training
5807863
verified
11 days ago
.gitattributes
1.57 kB
End of training
11 days ago
README.md
2.23 kB
End of training
11 days ago
added_tokens.json
80 Bytes
End of training
11 days ago
config.json
733 Bytes
End of training
11 days ago
generation_config.json
247 Bytes
End of training
11 days ago
merges.txt
1.67 MB
End of training
11 days ago
model.safetensors
1.98 GB
LFS
End of training
11 days ago
special_tokens_map.json
367 Bytes
End of training
11 days ago
tokenizer.json
11.4 MB
LFS
End of training
11 days ago
tokenizer_config.json
1.3 kB
End of training
11 days ago
training_args.bin
5.56 kB
LFS
End of training
11 days ago
vocab.json
2.78 MB
End of training
11 days ago