Task not specified in the repository
#3
by
captain-awesome
- opened
llm = HuggingFaceHub(repo_id="LLukas22/gpt4all-lora-quantized-ggjt", model_kwargs={"temperature":1,})
gives error -
ValidationError: 1 validation error for HuggingFaceHub
root
Task not specified in the repository. Please add it to the model card using pipeline_tag (https://huggingface.co/docs#how-is-a-models-type-of-inference-api-and-widget-determined) (type=value_error)
I tried:llm = HuggingFaceHub(repo_id="LLukas22/gpt4all-lora-quantized-ggjt", model_kwargs={"temperature":1, "pipeline_tag": "text-generation"})
but still the same
You can't run ggml based models directly via the HuggingFaceHub. Please look at llama.cpp or rustformers/llm.