In the model card, it is recommended to load the model with model = AutoModel.from_pretrained('facebook/opt-66b', torch_dtype=torch.float16), but then I get this error during the forward pass.
model = AutoModel.from_pretrained('facebook/opt-66b', torch_dtype=torch.float16)
· Sign up or log in to comment