| 模型 | 模型答案 | 正确答案 |
|---|---|---|
| 金声玉亮2.0 | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 32.851421 1.0 0.254474 0.120420 0.074471 0.045632 0.031202 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| deepseek-r1 | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 32.851421 1.0 0.254474 0.120420 0.074471 0.045632 0.031202 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| gpto1 | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 32.851421 1.0 0.254474 0.120420 0.074471 0.045632 0.031202 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| gpt-4o-2024-08-06 | ``` Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 32.851421 1.0 0.254474 0.120420 0.074471 0.045632 0.031202 ``` |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| DeepSeek-Coder-V2-Lite-Instruct | ``` Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 32.851421 1.0 0.254474 0.120420 0.074471 0.045632 0.031202 ``` |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| Meta-Llama-3.1-405B-Instruct-Turbo | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 32.851421 1.0 0.254474 0.120420 0.074471 0.045632 0.031202 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| Meta-Llama-3.1-70B-Instruct-Turbo | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 32.851421 1.0 0.254474 0.120420 0.074471 0.045632 0.031202 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| Qwen2-72B-Instruct | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.08509 0.045319 0.033782 0.024511 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.851421 1.0 0.254474 0.12042 0.074471 0.045632 0.031202 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| baichuan4 | Areas\tfreq_1\tfreq_2\tfreq_3\tfreq_4\tfreq_5\tfreq_6 21.011988\t1.0\t0.500439\t0.251738\t0.078005\t0.093293\t0.018903 10.337971\t1.0\t0.466725\t0.419106\t0.274681\t0.267607\t0.157107 10.849468\t1.0\t0.202631\t0.085090\t0.045319\t0.033782\t0.024511 0.000000\t0.0\t0.000000\t0.000000\t0.000000\t0.000000\t0.000000 0.000000\t0.0\t0.000000\t0.000000\t0.000000\t0.000000\t0.000000 32.851421\t1.0\t0.254474\t0202020\20\t0.074471\t0.045632\t0.031202 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| doubao | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 32.851421 1.0 0.254474 0.120420 0.074471 0.045632 0.031202 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| gpto1 | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 32.851421 1.0 0.254474 0.120420 0.074471 0.045632 0.031202 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| kimi | Error code: 429 - {'error': {'message': 'Your account cs3nvljd8p8ij5ievlv0<ak-ew5r1oc3ryd111fksao1> request reached TPM rate limit, current: 128654, limit: 128000', 'type': 'rate_limit_reached_error'}} | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| minimax | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.*** **.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.*** **.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.00 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| wenxinyiyan | ``` Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.08509 0.045319 0.033782 0.024511 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.851421 1.0 0.254474 0.12042 0.074471 0.045632 0.031202 ``` |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| zhipu | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 32.851421 1.0 0.254474 0.120420 0.074471 0.045632 0.031202 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |
| deepseek-v3 | Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011988 1.0 0.500439 0.251738 0.078005 0.093293 0.018903 10.337971 1.0 0.466725 0.419106 0.274681 0.267607 0.157107 10.849468 1.0 0.202631 0.085090 0.045319 0.033782 0.024511 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 0.000000 0.0 0.000000 0.000000 0.000000 0.000000 0.000000 32.851421 1.0 0.254474 0.120420 0.074471 0.045632 0.031202 |
Areas freq_1 freq_2 freq_3 freq_4 freq_5 freq_6 21.011987996801384 1.0 0.5004387263728519 0.2517378735892901 0.078005199375179 0.093293367604831 0.0189026940475218 10.337970555779648 1.0 0.4667245036083286 0.4191063338191223 0.2746805132472518 0.2676071164217446 0.1571065760449514 10.84946821575966 1.0 0.2026312336424063 0.0850897545416327 0.0453185688575391 0.0337823596808117 0.0245107766664011 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 32.85142142890733 1.0 0.2544744562396613 0.1204201767574232 0.0744708623829048 0.0456319411571197 0.031201680845393 |