how to access gated model

#5
by dk28 - opened

i use the sample code in the model card but unable to access the gated model data. although i have logged onto hugging face website and accepted the license terms, my sample code running in pycharm won't able to use the already authorized browser connction.

i tried to manully download all files of the model (except the .safetensor file which i believe the bin file shall work fine) and tried to load the model from a local directory. but i got a weird error : C:\Users\xxxx\anaconda3\lib\site-packages\transformers\generation\utils.py:1259: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation and will be removed soon, in a future version. Please use a generation configuration file (see https://huggingface.co/docs/transformers/main_classes/text_generation)

any thoughts?

after a bit of transformer code debug, i found i need remove a parameter "token_type_ids" from inputs = tokenizer("###Instruction\nGenerate a python function to find number of CPU cores###Response\n", return_tensors="pt").to("cuda") , then it worked

Sign up or log in to comment