Error: Task couldn't be inferenced from BertModel.Inference Toolkit
I've deployed this model to SageMaker with the HuggingFace DLC 763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-inference:2.0.0-transformers4.28.1-gpu-py310-cu118-ubuntu20.04, however I get this error when calling the model:
Task couldn't be inferenced from BertModel.Inference Toolkit can only inference tasks from architectures ending with ['TapasForQuestionAnswering', 'ForQuestionAnswering', 'ForTokenClassification', 'ForSequenceClassification', 'ForMultipleChoice', 'ForMaskedLM', 'ForCausalLM', 'ForConditionalGeneration', 'MTModel', 'EncoderDecoderModel', 'GPT2LMHeadModel', 'T5WithLMHeadModel'].Use env HF_TASK to define your task.
Thanks for your interest in our work! However, I'm not familiar with SageMaker. Sorry for that I cannot provide some useful suggestions.