Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
pbevan11
/
Mistral-Nemo-MCAI-SFT-DPO
like
0
Text Generation
Transformers
TensorBoard
Safetensors
pbevan11/multilingual-constitutional-preference-pairs
pbevan11/ultrafeedback_binarized_multilingual
mistral
alignment-handbook
trl
dpo
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Metrics
Training metrics
Community
Train
Deploy
Use this model
93ba0d6
Mistral-Nemo-MCAI-SFT-DPO
1 contributor
History:
2 commits
pbevan11
Training in progress, step 83
93ba0d6
verified
14 days ago
runs
Training in progress, step 83
14 days ago
.gitattributes
1.57 kB
Training in progress, step 83
14 days ago
config.json
689 Bytes
Training in progress, step 83
14 days ago
model-00001-of-00005.safetensors
4.87 GB
LFS
Training in progress, step 83
14 days ago
model-00002-of-00005.safetensors
4.91 GB
LFS
Training in progress, step 83
14 days ago
model-00003-of-00005.safetensors
4.91 GB
LFS
Training in progress, step 83
14 days ago
model-00004-of-00005.safetensors
4.91 GB
LFS
Training in progress, step 83
14 days ago
model-00005-of-00005.safetensors
4.91 GB
LFS
Training in progress, step 83
14 days ago
model.safetensors.index.json
29.9 kB
Training in progress, step 83
14 days ago
special_tokens_map.json
551 Bytes
Training in progress, step 83
14 days ago
tokenizer.json
17.1 MB
LFS
Training in progress, step 83
14 days ago
tokenizer_config.json
178 kB
Training in progress, step 83
14 days ago
training_args.bin
pickle
Detected Pickle imports (14)
"alignment.configs.DPOConfig"
,
"transformers.trainer_utils.SchedulerType"
,
"torch.bfloat16"
,
"trl.trainer.dpo_config.FDivergenceType"
,
"transformers.trainer_utils.IntervalStrategy"
,
"transformers.training_args.OptimizerNames"
,
"transformers.trainer_utils.HubStrategy"
,
"accelerate.state.PartialState"
,
"torch.device"
,
"transformers.trainer_pt_utils.AcceleratorConfig"
,
"accelerate.utils.dataclasses.DeepSpeedPlugin"
,
"transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig"
,
"accelerate.utils.dataclasses.DistributedType"
,
"transformers.integrations.deepspeed.HfDeepSpeedConfig"
How to fix it?
7.54 kB
LFS
Training in progress, step 83
14 days ago