YC-Chen commited on
Commit
a033654
1 Parent(s): e0110ac

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -4
README.md CHANGED
@@ -6,10 +6,17 @@ license: apache-2.0
6
 
7
  ## Function Calling Performance
8
 
 
 
 
 
 
 
 
9
  ### Berkeley function-calling leaderboard (EN)
10
 
11
- | Models | #Parameters | License | ↑ Overall | Relevance<br/>Detection | AST/<br/>Simple | AST/<br/>Multiple | AST/<br/>Parallel | AST/<br/>Parallel-Multiple | Exec/<br/>Simple | Exec/<br/>Multiple | Exec/<br/>Parallel | Exec/<br/>Parallel-Multiple |
12
- |-------------------------------------------------------------------------------------------------|-------------|-----------|----------|---------------------|------------|--------------|--------------|------------------------|--------------|---------------------|---------------------|-------------------------------|
13
- | [**Breeze-7B-FC-v1_0 (FC)**](https://huggingface.co/MediaTek-Research/Breeze-7B-FC-v1_0) | 7B | Apache 2.0 | 86.01 | 74.58 | 90.00 | 93.00 | 82.00 | 83.00 | 98.00 | 92.00 | 88.00 | 75.00 |
14
- | [GPT-3.5-Turbo-0125 (FC)](https://openai.com) | | Proprietary| 72.77 | 4.58 | 87.75 | 90.50 | 88.50 | 82.50 | 91.00 | 82.00 | 78.00 | 52.50 |
15
 
 
6
 
7
  ## Function Calling Performance
8
 
9
+ | Models | #Parameters | License | Function Calling? | Chatbot? |
10
+ |--------------------------------------------------------------------------------------------|-------------|------------|-------------------|----------|
11
+ | [Breeze-7B-Instruct-v1_0](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-v1_0)| 7B | Apache 2.0 | Yes | No |
12
+ | [**Breeze-7B-FC-v1_0**](https://huggingface.co/MediaTek-Research/Breeze-7B-FC-v1_0) | 7B | Apache 2.0 | Yes | Yes |
13
+ | [Gorilla-OpenFunctions-v2](https://huggingface.co/MediaTek-Research/Breeze-7B-FC-v1_0) | 7B | Apache 2.0 | Yes | No |
14
+ | [GPT-3.5-Turbo-0125](https://openai.com) | | Proprietary| Yes | Yes |
15
+
16
  ### Berkeley function-calling leaderboard (EN)
17
 
18
+ | Models | ↑ Overall | Relevance<br/>Detection | AST/<br/>Simple | AST/<br/>Multiple | AST/<br/>Parallel | AST/<br/>Parallel-Multiple | Exec/<br/>Simple | Exec/<br/>Multiple | Exec/<br/>Parallel | Exec/<br/>Parallel-Multiple |
19
+ |-------------------------------------------------------------------------------------------------|----------|---------------------|------------|--------------|--------------|------------------------|--------------|---------------------|---------------------|-------------------------------|
20
+ | [**Breeze-7B-FC-v1_0 (FC)**](https://huggingface.co/MediaTek-Research/Breeze-7B-FC-v1_0) | 86.01 | 74.58 | 90.00 | 93.00 | 82.00 | 83.00 | 98.00 | 92.00 | 88.00 | 75.00 |
21
+ | [GPT-3.5-Turbo-0125 (FC)](https://openai.com) | 72.77 | 4.58 | 87.75 | 90.50 | 88.50 | 82.50 | 91.00 | 82.00 | 78.00 | 52.50 |
22