Not generating [TOOL_CALLS]
#20
by
ShukantP
- opened
Is anyone else experiencing an issue where Mistral doesn't use [TOOL_CALLS] to start a function call, and instead simply outputs the JSON for the function call? This happens even after fine tuning
Apparently using an array for the tools is necessary for the model to respond with [TOOL_CALLS]. The formatting must be done precisely.
I have created a PR that allows available tools, tool calls and tool results to be added using the chat_template.
https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3/discussions/21
Keen to know if you still run into this issue when using that template.