Inconsistent parallel function calling
#25
by
SebastianS
- opened
Here is the call I made:
prompt text:
<s>[AVAILABLE_TOOLS]▁[{"type":▁"function",▁"function":▁{"name":▁"get_current_weather",▁"description":▁"Get▁the▁current▁weather",▁"parameters":▁{"type":▁"object",▁"properties":▁{"location":▁{"type":▁"string",▁"description":▁"The▁city▁and▁state,▁e.g.▁San▁Francisco,▁CA"},▁"format":▁{"type":▁"string",▁"enum":▁["celsius",▁"fahrenheit"],▁"description":▁"The▁temperature▁unit▁to▁use.▁Infer▁this▁from▁the▁users▁location."}},▁"required":▁["location",▁"format"]}}},▁{"type":▁"function",▁"function":▁{"name":▁"get_rain_probability",▁"description":▁"Get▁the▁current▁rain▁probability",▁"parameters":▁{"type":▁"object",▁"properties":▁{"location":▁{"type":▁"string",▁"description":▁"The▁city▁and▁state,▁e.g.▁San▁Francisco,▁CA"}},▁"required":▁["location"]}}}][/AVAILABLE_TOOLS][INST]▁What's▁the▁weather▁and▁rain▁probability▁today▁in▁Paris?[/INST]
Decoded tokens:
[{"type": "function", "function": {"name": "get_current_weather", "description": "Get the current weather", "parameters": {"type": "object", "properties": {"location": {"type": "string", "description": "The city and state, e.g. San Francisco, CA"}, "format": {"type": "string",
"enum": ["celsius", "fahrenheit"], "description": "The temperature unit to use. Infer this from the users location."}}, "required": ["location", "format"]}}}, {"type": "function", "function": {"name": "get_rain_probability", "description": "Get the current rain probability", "parameters": {"type": "object", "properties": {"location": {"type": "string", "description": "The city and state, e.g. San Francisco, CA"}}, "required": ["location"]}}}] What's the weather and rain probability today in Paris?
Tokenization time
: 0.021998882293701172 seconds
Generation time
: 21.78401255607605 seconds
out_tokens:
[[5, 1501, 7567, 1629, 2032, 1113, 1295, 29498, 3790, 29498, 1537, 1991, 1316, 1113, 17452, 2032, 10598, 3501, 2032, 1113, 4684, 1046, 29493, 28558, 1316, 1113, 4530, 2032, 1113, 29485, 1958, 3938, 29507, 1743, 29561, 781, 781, 5, 1501, 7567, 1629, 2032, 1113, 1295, 29498, 29480, 1194, 29498, 22851, 3205, 1316, 1113, 17452, 2032, 10598, 3501, 2032, 1113, 4684, 1046, 29493, 28558, 29507, 1743]]
Result:
[{"name": "get_current_weather", "arguments": {"location": "Paris, FR", "format": "celsius"}}]
[{"name": "get_rain_probability", "arguments": {"location": "Paris, FR"}}