RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'

#26
by macleginn - opened

In the model card, it is recommended to load the model with model = AutoModel.from_pretrained('facebook/opt-66b', torch_dtype=torch.float16), but then I get this error during the forward pass.

Sign up or log in to comment