Adjust generation verbosity

#29
by nzarif - opened

Is it possible to adjust model's generation verbosity? I couldn't find any input arguments for model.generate() to adjust verbosity. Let's say we are using the model for visual question answering and we want the answers to be short e.g. just one word, is there an easy way to get such generations? Right now the model generates full sentences for each question.

Sign up or log in to comment