Search results

[需求] asibench需要支持更低的请求率，当前最低只支持0.1，希望支持到最低0.001

content_check_passedissue content check passedissue content check passed

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#147 In AISBench/benchmark;

· SoulPainter-zhang opened on Feb 12, 2026

[疑问] aisbench哪里可以控制 不发 penalties 在配置文件里已经注释掉了

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#146 In AISBench/benchmark;

· chenghaitao1987 opened on Feb 11, 2026

[Bug] 测试aime数据集，boxed{ } 中有除数字外的其他字符作为答案。

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#142 In AISBench/benchmark;

· DangKan2 opened on Feb 10, 2026

[Roadmap] AISBench 2026 Q1 Roadmap

Status: Open.

Feature

#140 In AISBench/benchmark;

· GaoHuaZhang opened on Feb 9, 2026

·  

AISBench 2026 Q1 Roadmap

[Bug] Qwen3-Coder-Next跑humanevalx数据集报错

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#139 In AISBench/benchmark;

· kurt739910017 opened on Feb 9, 2026

[Bug] Aime2025数据集开启思考后，同样的配置，lm_eval复现成功，Aisbench工具开启思考下无法复现精度分数

bugSomething isn't workingSomething isn't working

content_check_failedissue content check failedissue content check failed

Status: Open.

#138 In AISBench/benchmark;

· Sfeching opened on Feb 7, 2026

[Bug] AISbench不支持针对humanevals数据集指定输入数据量，只能进行全量数据测试

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#136 In AISBench/benchmark;

· zhangguinan opened on Feb 5, 2026

[Bug] mindIE2.3.0版本测试textvqa报错

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#135 In AISBench/benchmark;

· lmx668 opened on Feb 5, 2026

[文档] livecodebench的指导文档中目录结构缺失code_generation_lite.py文件

content_check_passedissue content check passedissue content check passed

documentationImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#134 In AISBench/benchmark;

· Mitchellax opened on Feb 4, 2026

[Bug] textqva多模态测试服务化后端vllm-ascend报错

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#132 In AISBench/benchmark;

· lmx668 opened on Feb 3, 2026

[Bug] mmlu_pro数据集评测精度结果都是0

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#125 In AISBench/benchmark;

· zhangguinan opened on Jan 29, 2026

[Bug] livecodebench测精度 测完解析有error有什么已知问题吗？

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#124 In AISBench/benchmark;

· zhangguinan opened on Jan 28, 2026