Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ikimhope
/
pythia-1b-tldr-online-dpo-mark-peft
like
0
Transformers
Safetensors
trl-lib/tldr
Generated from Trainer
trl
online-dpo
Inference Endpoints
arxiv:
2402.04792
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
ec18679
pythia-1b-tldr-online-dpo-mark-peft
1 contributor
History:
2 commits
ikimhope
Training in progress, step 500
ec18679
verified
16 days ago
.gitattributes
Safe
1.52 kB
initial commit
17 days ago
adapter_config.json
Safe
654 Bytes
Training in progress, step 500
16 days ago
adapter_model.safetensors
33.6 MB
LFS
Training in progress, step 500
16 days ago
special_tokens_map.json
Safe
579 Bytes
Training in progress, step 500
16 days ago
tokenizer.json
3.56 MB
Training in progress, step 500
16 days ago
tokenizer_config.json
Safe
5.3 kB
Training in progress, step 500
16 days ago
training_args.bin
Suspicious
pickle
Detected Pickle imports (9)
"accelerate.utils.dataclasses.DistributedType"
,
"transformers.trainer_utils.SchedulerType"
,
"accelerate.state.PartialState"
,
"torch.device"
,
"transformers.trainer_utils.HubStrategy"
,
"trl.trainer.online_dpo_config.OnlineDPOConfig"
,
"transformers.trainer_utils.IntervalStrategy"
,
"transformers.trainer_pt_utils.AcceleratorConfig"
,
"transformers.training_args.OptimizerNames"
How to fix it?
5.5 kB
LFS
Training in progress, step 500
16 days ago