mistralai/Mistral-7B-Instruct-v0.3 · String for the Function Calling Token

ckg

May 22

•

Good day!

Thank you folks for dropping yet another fantastic model, le mistral is le best. Would you be able to point me to where the function calling token is defined for this model? I would like to fine tune it on a dataset of function calling conversation dialogues and would ideally like to use the same token/string that was used to fine tune on function calls in this model.

I checked the generation/tokenizer configs as well as the mistral_inference repo – are you folks planning on making the string public? Or perhaps if I am looking in the wrong direction, how exactly does this model support function calling?

MaziyarPanahi

May 22

•

edited May 22

It should be similar to the 8x22B model:

     "5": {
      "content": "[TOOL_CALLS]",
      "lstrip": false,
      "normalized": false,
      "rstrip": false,
      "single_word": false,
      "special": true
    },
    "6": {
      "content": "[AVAILABLE_TOOLS]",
      "lstrip": false,
      "normalized": false,
      "rstrip": false,
      "single_word": false,
      "special": true
    },
    "7": {
      "content": "[/AVAILABLE_TOOLS]",
      "lstrip": false,
      "normalized": false,
      "rstrip": false,
      "single_word": false,
      "special": true
    },
    "8": {
      "content": "[TOOL_RESULTS]",
      "lstrip": false,
      "normalized": false,
      "rstrip": false,
      "single_word": false,
      "special": true
    },
    "9": {
      "content": "[/TOOL_RESULTS]",
      "lstrip": false,
      "normalized": false,
      "rstrip": false,
      "single_word": false,
      "special": true
    },

syleront

May 24

This comment has been hidden