THUDM

/

glm-4-9b

like 109

Follow

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University 1,162

用transformers库吧，modelscope用不到呀
然后你这个是什么时候报错的

我在用swift微调的时候，会在模型加载过程中遇到相关报错

File "/home/jeeves/.local/lib/python3.10/site-packages/swift/utils/run_utils.py", line 27, in x_main

result = llm_x(args, **kwargs)

File "/local/apps/zai-model/model_llm_sft/nlp_v2/llm_sft.py", line 97, in llm_sft

model, tokenizer = get_model_tokenizer(

File "/home/jeeves/.local/lib/python3.10/site-packages/swift/llm/utils/model.py", line 4843, in get_model_tokenizer

model, tokenizer = get_function(model_dir, torch_dtype, model_kwargs, load_model, **kwargs)

File "/home/jeeves/.local/lib/python3.10/site-packages/swift/llm/utils/model.py", line 1474, in get_model_tokenizer_chatglm

tokenizer_cls = get_class_from_dynamic_module(class_ref, model_dir)

File "/home/jeeves/.local/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 501, in get_class_from_dynamic_module

return get_class_in_module(class_name, final_module)

File "/home/jeeves/.local/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 202, in get_class_in_module

return getattr(module, class_name)

AttributeError: module 'transformers_modules.GLM-4-9B.tokenization_chatglm' has no attribute 'ChatGLM4Tokenizer'

这种情况是偶发出现的，不确定是什么原因导致的