金声玉亮2.0模型评测报告

问题

Please convert the Input Table from HTML format to TSV format. Please respond only with the table.
Input Table: <table border="1" class="dataframe">
<thead>
<tr style="text-align: right;">
<th>interaction_id</th>
<th>query_time</th>
<th>domain</th>
<th>question_type</th>
<th>static_or_dynamic</th>
<th>query</th>
<th>answer</th>
<th>alternative_answers</th>
</tr>
</thead>
<tbody>
<tr>
<td>ee0b351c-5a00-48e2-9</td>
<td>03/19/2024, 23:49:23</td>
<td>movie</td>
<td>simple</td>
<td>static</td>
<td>in 2008, which movie</td>
<td>the golden compass</td>
<td>[]</td>
</tr>
<tr>
<td>d660a07b-c598-4be9-b</td>
<td>03/19/2024, 23:34:54</td>
<td>movie</td>
<td>simple</td>
<td>static</td>
<td>which movie was reco</td>
<td>ratatouille</td>
<td>[]</td>
</tr>
<tr>
<td>42163b55-9bf6-4412-a</td>
<td>03/15/2024, 17:05:41</td>
<td>sports</td>
<td>comparison</td>
<td>static</td>
<td>during the 2022-12 s</td>
<td>true</td>
<td>[]</td>
</tr>
<tr>
<td>82e66a91-22eb-4806-a</td>
<td>03/05/2024, 23:19:09</td>
<td>music</td>
<td>simple_w_condition</td>
<td>static</td>
<td>what is the song tha</td>
<td>cold heart</td>
<td>[]</td>
</tr>
<tr>
<td>a91df871-089c-4b91-9</td>
<td>03/19/2024, 23:17:23</td>
<td>movie</td>
<td>simple</td>
<td>static</td>
<td>who directed bridget</td>
<td>beeban kidron</td>
<td>[]</td>
</tr>
</tbody>
</table>
Output:

答案

模型

模型答案

正确答案

金声玉亮2.0

interaction_id query_time domain question_type static_or_dynamic query answer alternative_answers
ee0b351c-5a00-48e2-9 03/19/2024, 23:49:23 movie simple static in 2008, which movie the golden compass []
d660a07b-c598-4be9-b 03/19/2024, 23:34:54 movie simple static which movie was reco ratatouille []
42163b55-9bf6-4412-a 03/15/2024, 17:05:41 sports comparison static during the 2022-12 s true []
82e66a91-22eb-4806-a 03/05/2024, 23:19:09 music simple_w_condition static what is the song tha cold heart []
a91df871-089c-4b91-9 03/19/2024, 23:17:23 movie simple static who directed bridget beeban kidron []

deepseek-r1

gpto1

gpt-4o-2024-08-06

```
interaction_id query_time domain question_type static_or_dynamic query answer alternative_answers
ee0b351c-5a00-48e2-9 03/19/2024, 23:49:23 movie simple static in 2008, which movie the golden compass []
d660a07b-c598-4be9-b 03/19/2024, 23:34:54 movie simple static which movie was reco ratatouille []
42163b55-9bf6-4412-a 03/15/2024, 17:05:41 sports comparison static during the 2022-12 s true []
82e66a91-22eb-4806-a 03/05/2024, 23:19:09 music simple_w_condition static what is the song tha cold heart []
a91df871-089c-4b91-9 03/19/2024, 23:17:23 movie simple static who directed bridget beeban kidron []
```

DeepSeek-Coder-V2-Lite-Instruct

interaction_id query_time domain question_type static_or_dynamic query answer alternative_answers
ee0b351c-5a00-48e2-9 03/19/2024, 23:49:23 movie simple static in 2008, which movie the golden compass []
d660a07b-c598-4be9-b 03/19/2024, 23:34:54 movie simple static which movie was reco the golden compass []
42163b55-9bf6-4412-a 03/15/2024, 17:05:41 sports comparison static during the 2022-12 s true []
82e66a91-22eb-4806-a 03/05/2024, 23:19:09 music simple_w_condition static what is the song tha the golden compass []
a91df871-089c-4b91-9 03/19/2024, 23:17:23 movie simple static who directed bridget the golden compass []

Meta-Llama-3.1-405B-Instruct-Turbo

Meta-Llama-3.1-70B-Instruct-Turbo

Qwen2-72B-Instruct

| interaction_id | query_time | domain | question_type | static_or_dynamic | query | answer | alternative_answers |
|----------------|----------------------|----------|------------------------|-------------------|--------------------------------------------|--------------------|---------------------|
| ee0b351c-5a00-48e2-9 | 03/19/2024, 23:49:23 | movie | simple | static | in 2008, which movie | the golden compass | [] |
| d660a07b-c598-4be9-b | 03/19/2024, 23:34:54 | movie | simple | static | which movie was reco | ratatouille | [] |
| 42163b55-9bf6-4412-a | 03/15/2024, 17:05:41 | sports | comparison | static | during the 2022-12 s | true | [] |
| 82e66a91-22eb-4806-a | 03/05/2024, 23:19:09 | music | simple_w_condition | static | what is the song that | cold heart | [] |
| a91df871-089c-4b91-9 | 03/19/2024, 23:17:23 | movie | simple | static | who directed bridget | beeban kidron | [] |

baichuan4

interaction_id\tquery_time\tdomain\tquestion_type\tstatic_or_dynamic\tquery\tanswer\talternative_answers
ee0b351c-5a00-48e2-9\t03/19/2024, 23:49:23\tmovie\tsimple\tstatic\tin 2008, which movie\tthe golden compass\t[]
d660a07b-c598-4be9-b\t03/19/2024, 23:34:54\tmovie\tsimple\tstatic\twhich movie was reco\tratatouille\t[]
42163b55-9bf6-4412-a\t03/15/2024, 17:05:41\tsports\tcomparison\tstatic\tduring the 2022-12 s\ttrue\t[]
82e66a91-22eb-4806-a\t03/05/2024, 23:19:09\tmusic\tsimple_w_condition\tstatic\twhat is the song tha\tcold heart\t[]
a91df871-089c-4b91-9\t03/19/2024, 23:17:23\tmovie\tsimple\tstatic\twho directed bridget\tbeeban kidron\t[]

doubao

gpto1

kimi

minimax

wenxinyiyan

zhipu

deepseek-v3