tokenizer and chat template fix for .gguf only

#9

there may be a better way to do this so it does multiple chat templates for both function calling and chat and benchmarking.

I suspect the older tool use template got replaced by the system prompt. But this one I tested and works fine with .gguf only

nisten changed pull request title from tokenizer and chat template fix for .gguf only, don't merge to tokenizer and chat template fix for .gguf only
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment