All issues

Search results

Feature request: EvalPort import/export for CustomDataset (adapter already built and tested)

Status: Open.

#2604 In open-compass/opencompass;

· adhabnr-ux opened on Aug 21, 2026

CompassAcademic: 4 of 7 objective boards have an unseparated #1, two are exact ties broken by display order

Status: Open.

#2574 In open-compass/opencompass;

· ipezygj opened on Aug 1, 2026

[Bug] Qwen3.5 cannot run when using HuggingFacewithChatTemplate

Status: Open.

#2573 In open-compass/opencompass;

· hobbitlzy opened on Jul 31, 2026

MedFailBench integration proposal for clinical AI safety evaluation

Status: Open.

#2516 In open-compass/opencompass;

· goktugozkanmd opened on Jul 8, 2026

[Feature] DIK-structured Turkish syntactic dependency annotation dataset for structured linguistic evaluation

Status: Open.

#2508 In open-compass/opencompass;

· nane100503-gif opened on Jul 3, 2026

[Feature] 集成 ThinkCheck 作为 OpenCompass 的“推理健康度”评估维度

Status: Open.

#2475 In open-compass/opencompass;

· luoxuejian000 opened on Jun 8, 2026

[Feature] TruthfulQA mcq模式评测支持

Status: Open.

#2427 In open-compass/opencompass;

· IgorZan opened on Mar 31, 2026

[Bug] [Feature] 评测框架代码过于耦合，失误得重新跑推理，文档中没有看到可以复用推理结果从新评测的命令

Status: Open.

#2424 In open-compass/opencompass;

· mozhang-ah opened on Mar 30, 2026

[Feature] opencompass公开学术多模态榜单公布qwen3.5模型的结果

Status: Open.

#2413 In open-compass/opencompass;

· cobraheleah opened on Mar 13, 2026

[Feature] Question: where would a long horizon "tension crash test" TXT pack fit in OpenCompass?

Status: Open.

#2396 In open-compass/opencompass;

· onestardao opened on Feb 6, 2026

Feature Request: Add Judge Calibration Diagnostics for LLM-as-Judge Evaluation

Status: Open.

#2392 In open-compass/opencompass;

· elandesberg opened on Feb 3, 2026

[Feature] Add another OpenAISDK model using prompt completion API

Status: Open.

#2386 In open-compass/opencompass;

· tongl2 opened on Jan 14, 2026