-
Notifications
You must be signed in to change notification settings - Fork 767
Pull requests: open-compass/VLMEvalKit
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[Benchmark] Update SciDocBench official release and evaluation
#1688
opened Sep 15, 2026 by
Henryexcellentw
Loading…
[Model][Dataset] Add GRT profiles and DIVE-Bench educational/high-motion tasks
#1686
opened Sep 14, 2026 by
Hai-chao-Zhang
•
Draft
3 of 4 tasks
[Fix] Pass config keys through to dataset classes that forward **kwargs
#1684
opened Sep 12, 2026 by
reinainblood
•
Draft
[Benchmark] Add MET-Bench (ICML 2026, entity-state tracking)
#1683
opened Sep 11, 2026 by
vanyacohen
Loading…
Fix str(res) typo in post_check for non-numeric answers
#1680
opened Sep 9, 2026 by
rrrxxx0510
Loading…
Fall back to AutoModelForImageTextToText when AutoModelForVision2Seq is absent
#1676
opened Sep 8, 2026 by
rrrxxx0510
Loading…
fix(inference): unpack structured records per sample, not all-or-nothing
#1669
opened Sep 3, 2026 by
Anai-Guo
Contributor
Loading…
fix(molrecbench_wild): give the converter its required track column
#1668
opened Sep 3, 2026 by
Anai-Guo
Contributor
Loading…
[Fix] Molmo AI2D: map no-letter answers to the option letter, not its…
#1655
opened Aug 24, 2026 by
aarjunsrinivasan
Loading…
fix(dataset): preserve literal 'None' options in TSV loading and MCQ prompt building
#1651
opened Aug 23, 2026 by
Xayar145
Loading…
fix(distributed): default LOCAL_RANK to 0 instead of 1 in run.py
#1650
opened Aug 23, 2026 by
Xayar145
Loading…
[Fix] Keep Thyme sandbox images in user observation turns
#1645
opened Aug 18, 2026 by
reacher-z
Loading…
[Feature] Add multi-turn chat for Llama 4, Llama Vision, and Qwen3-VL
#1644
opened Aug 18, 2026 by
reacher-z
Loading…
Previous Next
ProTip!
Follow long discussions with comments:>50.