mistralai

/

Mistral-7B-Instruct-v0.3

like 975

Here is the call I made:

prompt text:
 <s>[AVAILABLE_TOOLS]▁[{"type":▁"function",▁"function":▁{"name":▁"get_current_weather",▁"description":▁"Get▁the▁current▁weather",▁"parameters":▁{"type":▁"object",▁"properties":▁{"location":▁{"type":▁"string",▁"description":▁"The▁city▁and▁state,▁e.g.▁San▁Francisco,▁CA"},▁"format":▁{"type":▁"string",▁"enum":▁["celsius",▁"fahrenheit"],▁"description":▁"The▁temperature▁unit▁to▁use.▁Infer▁this▁from▁the▁users▁location."}},▁"required":▁["location",▁"format"]}}},▁{"type":▁"function",▁"function":▁{"name":▁"get_rain_probability",▁"description":▁"Get▁the▁current▁rain▁probability",▁"parameters":▁{"type":▁"object",▁"properties":▁{"location":▁{"type":▁"string",▁"description":▁"The▁city▁and▁state,▁e.g.▁San▁Francisco,▁CA"}},▁"required":▁["location"]}}}][/AVAILABLE_TOOLS][INST]▁What's▁the▁weather▁and▁rain▁probability▁today▁in▁Paris?[/INST]    


Decoded tokens:
 [{"type": "function", "function": {"name": "get_current_weather", "description": "Get the current weather", "parameters": {"type": "object", "properties": {"location": {"type": "string", "description": "The city and state, e.g. San Francisco, CA"}, "format": {"type": "string", 
"enum": ["celsius", "fahrenheit"], "description": "The temperature unit to use. Infer this from the users location."}}, "required": ["location", "format"]}}}, {"type": "function", "function": {"name": "get_rain_probability", "description": "Get the current rain probability", "parameters": {"type": "object", "properties": {"location": {"type": "string", "description": "The city and state, e.g. San Francisco, CA"}}, "required": ["location"]}}}] What's the weather and rain probability today in Paris?


Tokenization time
: 0.021998882293701172 seconds

Generation time
: 21.78401255607605 seconds


out_tokens:
 [[5, 1501, 7567, 1629, 2032, 1113, 1295, 29498, 3790, 29498, 1537, 1991, 1316, 1113, 17452, 2032, 10598, 3501, 2032, 1113, 4684, 1046, 29493, 28558, 1316, 1113, 4530, 2032, 1113, 29485, 1958, 3938, 29507, 1743, 29561, 781, 781, 5, 1501, 7567, 1629, 2032, 1113, 1295, 29498, 29480, 1194, 29498, 22851, 3205, 1316, 1113, 17452, 2032, 10598, 3501, 2032, 1113, 4684, 1046, 29493, 28558, 29507, 1743]]


Result:
 [{"name": "get_current_weather", "arguments": {"location": "Paris, FR", "format": "celsius"}}]

 [{"name": "get_rain_probability", "arguments": {"location": "Paris, FR"}}