Add "chat_template" to tokenizer_config.json
#2
by
mitmul
- opened
Since version 4.34.0, Transformers has added a feature called chat_template to its tokenizer. Like other LLMs, PLaMo also performs better in dialogues when inputs are provided according to the expected template. This Pull Request (PR) adds the necessary fields to tokenizer_config.json to use Transformers' apply_chat_template() function to transform inputs into the format expected by PLaMo.
LGTM!
torotoki
changed pull request status to
merged