Update generation_config.json
#81
by
nkasmanoff
- opened
No description provided.
The generation_config.json file was using the wrong tokens for BOS and EOS, I've updated it here. See https://huggingface.co/tiiuae/falcon-180B/blob/main/generation_config.json for example with the same tokenizer but correct token IDs.