All issues

Search results

Interop idea: a VLMEvalKit-openeval-adapter for portable eval results

Status: Open.

#1652 In open-compass/VLMEvalKit;

· adhabnr-ux opened on Aug 23, 2026

Add Pluto-AI-Labs/Apollo-VL-Edge-3B to Leaderboard

Status: Open.

#1632 In open-compass/VLMEvalKit;

· SiddharthFX opened on Aug 14, 2026

Qwen2.5-VL-7B模型，对评测集LogicVista，从推理结果中提取答案错误，导致误判

Status: Open.

#1621 In open-compass/VLMEvalKit;

· suddenlee opened on Aug 6, 2026

MMMU Open-ended问题无法正确评测

Status: Open.

#1617 In open-compass/VLMEvalKit;

· identzz-ai opened on Aug 4, 2026

OpenVLM: one-decimal Overall makes the board un-checkable, and hides that 8 boards' #1 leads are under 1.2 sigma

Status: Open.

#1615 In open-compass/VLMEvalKit;

· ipezygj opened on Aug 1, 2026

有些基准没有放数据url

Status: Open.

#1614 In open-compass/VLMEvalKit;

· yangyangyang127 opened on Jul 31, 2026

LiveMMBench空链接

Status: Open.

#1600 In open-compass/VLMEvalKit;

· yangyangyang127 opened on Jul 16, 2026

请问flyai-vl模型的评测什么时候可以支持？

Status: Open.

#1598 In open-compass/VLMEvalKit;

· zhangxuewei-xirui opened on Jul 7, 2026

[Bug] run.py: LOCAL_RANK defaults to 1 instead of 0

Status: Open.

#1589 In open-compass/VLMEvalKit;

· Irisicy4 opened on Jun 28, 2026

[Bug] Thyme: sandbox image fed in assistant turn + KV-cache reused across re-encoded turns corrupts multi-round vision context

Status: Open.

#1590 In open-compass/VLMEvalKit;

· Irisicy4 opened on Jun 28, 2026

Adding [BenchCAD]: would you accept execution-based image→CadQuery-code tasks (heavier deps)?

Status: Open.

#1582 In open-compass/VLMEvalKit;

· HaozheZhang6 opened on Jun 25, 2026

[Bug] CharXiv_descriptive_val DATASET_MD5 appears to be incorrect after #1555

Status: Open.

#1580 In open-compass/VLMEvalKit;

· kail8 opened on Jun 23, 2026