File size: 414 Bytes
c7fe260 2112d98 c7fe260 0849991 c7fe260 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
---
base_model: base_model
datasets: dataset_name
library_name: transformers
model_name: online-dpo-qwen2-2
tags:
- trl
- online-dpo
- generated_from_trainer
- peft
licence: license
---
# Model Card for online-dpo-qwen2-2
This model is a fine-tuned version of [Qwen/Qwen2-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2-0.5B-Instruct) on the https://huggingface.co/datasets/trl-lib/ultrafeedback-prompt dataset. |