Create a new Endpoint
#5
by
lenmon666
- opened
I tried to deploy teknium/Mistral-Trismegistus-7B in Inference Endpoints, and the following error occurred:
Same issue , tested on GPU 路 Nvidia A10G 路 1x GPU 路 24 GB
Try now
Merging the pr from @hk1730 here would most likely fix it
https://huggingface.co/teknium/Mistral-Trismegistus-7B/discussions/6
Deleted the added_tokens file and now should work
I tried to deploy teknium/Mistral-Trismegistus-7B in Inference Endpoints, and the following error occurred: