| 2023-06-26 20:18:16 - finetune_bloom.py[line:65] - INFO: args.__dict__ : {'model_config_file': 'run_config/Bloom_config.json', 'deepspeed': 'run_config/deepspeed_config.json', 'resume_from_checkpoint': False, 'lora_hyperparams_file': '', 'use_lora': False, 'local_rank': 0} | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: model_type : bloom | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: model_name_or_path : baichuan-inc/baichuan-7B | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: data_path : data/data_tmp.json | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: output_dir : checkpoints/baichuan_chat | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: batch_size : 64 | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: per_device_train_batch_size : 2 | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: num_epochs : 2 | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: learning_rate : 1e-05 | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: cutoff_len : 1024 | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: val_set_size : 0 | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: val_set_rate : 0 | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: save_steps : 3000 | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: eval_steps : 1000 | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: warmup_steps : 10 | |
| 2023-06-26 20:18:16 - finetune_bloom.py[line:67] - INFO: logging_steps : 10 | |
| 2023-06-28 14:13:45 - finetune_bloom.py[line:226] - INFO: Save checkpointing... | |
| 2023-06-28 14:19:46 - finetune_bloom.py[line:232] - INFO: Training succeeded | |