Warning about padding does not disappear

#10
by dmitrijsk - opened

Hi! The code example from the model card results in a warning A decoder-only architecture is being used, but right-padding was detected! For correct generation results, please set padding_side='left' when initializing the tokenizer.. Adding padding_side='left' to the AutoTokenizer like this:

tokenizer = AutoTokenizer.from_pretrained(checkpint, padding_side='left')

does not remove this warning. Does anyone know how to fix this?

Sign up or log in to comment