Add "chat_template" to tokenizer_config.json

#2

Since version 4.34.0, Transformers has added a feature called chat_template to its tokenizer. Like other LLMs, PLaMo also performs better in dialogues when inputs are provided according to the expected template. This Pull Request (PR) adds the necessary fields to tokenizer_config.json to use Transformers' apply_chat_template() function to transform inputs into the format expected by PLaMo.

Preferred Networks, Inc. org

LGTM!

torotoki changed pull request status to merged

Sign up or log in to comment