模型大小对不上呀

#2
by yinnxinn - opened

[size](RuntimeError: Error(s) in loading state_dict for GLMModel:
Unexpected key(s) in state_dict: "transformer.block_position_embeddings.weight".
size mismatch for transformer.position_embeddings.weight: copying a param with shape torch.Size([513, 1024]) from checkpoint, the shape in current model is torch.Size([512, 1024]).)

代码部分采用的这个项目:https://github.com/THUDM/GLM

您看看 config 那块配置是对的嘛

Sign up or log in to comment