huggingface / lmms-eval
File Age & Freshness

File age measurements show the distribution of file ages (days since the first commit) and the file freshness (days since the latest commit).

Summary
File Change History Overall
File Age Distribution Overall
Days since first update
  • There are 161 files with 10,592 lines of code in files.
    • 161 files that are 366+ days old (10,592 lines of code)
    • 0 files that are 181-365 days old (0 lines of code)
    • 0 files that are 91-180 days old (0 lines of code)
    • 0 files that are 31-90 days old (0 lines of code)
    • 0 files that are 1-30 days old (0 lines of code)
100% | 0% | 0% | 0% | 0%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by age
File Freshness Distribution Overall
Days since last update
  • There are 161 files with 10,592 lines of code in files.
    • 161 files have been last changed 366+ days ago (10,592 lines of code)
    • 0 files have been last changed 181-365 days ago (0 lines of code)
    • 0 files have been last changed 91-180 days ago (0 lines of code)
    • 0 files have been last changed 31-90 days ago (0 lines of code)
    • 0 files have been last changed 1-30 days ago (0 lines of code)
100% | 0% | 0% | 0% | 0%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by freshness
File Change History per File Extension
yaml, py, md, txt, json, sh, gitignore, ipynb, toml
File Age Distribution per Extension
Days since first update
366+
181-365
91-180
31-90
1-30
py100% | 0% | 0% | 0% | 0%
yaml100% | 0% | 0% | 0% | 0%
ipynb100% | 0% | 0% | 0% | 0%
toml100% | 0% | 0% | 0% | 0%
File Freshness Distribution per Extension
Days since last update
366+
181-365
91-180
31-90
1-30
py100% | 0% | 0% | 0% | 0%
yaml100% | 0% | 0% | 0% | 0%
ipynb100% | 0% | 0% | 0% | 0%
toml100% | 0% | 0% | 0% | 0%
File Change History per Logical Decomposition
primary
primary (file age distribution)
Days since first update
366+
181-365
91-180
31-90
1-30
lmms_eval100% | 0% | 0% | 0% | 0%
tools100% | 0% | 0% | 0% | 0%
ROOT100% | 0% | 0% | 0% | 0%
primary (file freshness distribution)
Days since last update
366+
181-365
91-180
31-90
1-30
lmms_eval100% | 0% | 0% | 0% | 0%
tools100% | 0% | 0% | 0% | 0%
ROOT100% | 0% | 0% | 0% | 0%
Oldest Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
65 - 2023-12-24 2024-03-29 20 6 a1286225768@gmail.com drluodian@gmail.com
task.py
in lmms_eval/api
 750 53 2024-01-11 2024-03-11 15 5 a1286225768@gmail.com drluodian@gmail.com
utils.py
in lmms_eval
 507 48 2024-01-11 2024-02-26 11 4 a1286225768@gmail.com drluodian@gmail.com
evaluator.py
in lmms_eval
 403 3 2024-01-11 2024-03-05 17 4 a1286225768@gmail.com 92624596+kcz358@users.norep...
utils.py
in lmms_eval/tasks/mmmu
 328 19 2024-01-11 2024-02-26 6 4 a1286225768@gmail.com drluodian@gmail.com
__main__.py
in lmms_eval
 293 6 2024-01-11 2024-03-12 22 5 a1286225768@gmail.com drluodian@gmail.com
llava.py
in lmms_eval/models
 283 16 2024-01-11 2024-03-12 21 5 a1286225768@gmail.com drluodian@gmail.com
metrics.py
in lmms_eval/api
 279 35 2024-01-11 2024-03-11 8 4 a1286225768@gmail.com drluodian@gmail.com
__init__.py
in lmms_eval/tasks
 107 9 2024-01-11 2024-03-16 8 4 a1286225768@gmail.com fpu001@e.ntu.edu.sg
gpt4v.py
in lmms_eval/models
 99 5 2024-01-11 2024-03-11 8 5 a1286225768@gmail.com drluodian@gmail.com
registry.py
in lmms_eval/api
 97 9 2024-01-11 2024-03-05 3 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
model.py
in lmms_eval/api
 97 13 2024-01-11 2024-03-11 6 4 a1286225768@gmail.com drluodian@gmail.com
utils.py
in lmms_eval/tasks/mme
 88 5 2024-01-11 2024-02-27 7 4 a1286225768@gmail.com drluodian@gmail.com
samplers.py
in lmms_eval/api
 55 7 2024-01-11 2024-03-12 7 5 a1286225768@gmail.com fpu001@e.ntu.edu.sg
utils.py
in lmms_eval/tasks/scienceqa
 35 4 2024-01-11 2024-02-26 3 3 a1286225768@gmail.com drluodian@gmail.com
mme.yaml
in lmms_eval/tasks/mme
 35 - 2024-01-11 2024-03-03 8 4 a1286225768@gmail.com 92624596+kcz358@users.norep...
extraction.py
in lmms_eval/filters
 33 4 2024-01-11 2024-01-17 2 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
scienceqa.yaml
in lmms_eval/tasks/scienceqa
 33 - 2024-01-11 2024-02-26 3 3 a1286225768@gmail.com drluodian@gmail.com
gqa.yaml
in lmms_eval/tasks/gqa
 31 - 2024-01-11 2024-02-03 4 2 a1286225768@gmail.com a1286225768@gmail.com
__init__.py
in lmms_eval/filters
 28 2 2024-01-11 2024-01-17 2 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
transformation.py
in lmms_eval/filters
 24 6 2024-01-11 2024-01-17 2 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
selection.py
in lmms_eval/filters
 21 6 2024-01-11 2024-01-17 2 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
instance.py
in lmms_eval/api
 19 2 2024-01-11 2024-03-05 4 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
filter.py
in lmms_eval/api
 18 3 2024-01-11 2024-01-17 2 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
utils.py
in lmms_eval/tasks/gqa
 18 2 2024-01-11 2024-02-03 5 4 a1286225768@gmail.com a1286225768@gmail.com
__init__.py
in lmms_eval/models
 16 - 2024-01-11 2024-03-11 11 7 a1286225768@gmail.com drluodian@gmail.com
decontamination.py
in lmms_eval/filters
 7 2 2024-01-11 2024-01-27 2 1 a1286225768@gmail.com a1286225768@gmail.com
__init__.py
in lmms_eval/api
 1 - 2024-01-11 2024-01-11 1 1 a1286225768@gmail.com a1286225768@gmail.com
__init__.py
in lmms_eval
 1 - 2024-01-11 2024-01-11 1 1 a1286225768@gmail.com a1286225768@gmail.com
utils.py
in lmms_eval/tasks/mmvet
 158 5 2024-01-17 2024-03-05 7 3 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
utils.py
in lmms_eval/tasks/llava-bench-coco
 145 10 2024-01-17 2024-03-05 7 3 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
utils.py
in lmms_eval/tasks/llava-in-the-wild
 143 10 2024-01-17 2024-03-05 9 3 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
120 - 2024-01-17 2024-02-04 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
utils.py
in lmms_eval/tasks/refcocog
 78 13 2024-01-17 2024-01-27 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
utils.py
in lmms_eval/tasks/refcoco
 78 13 2024-01-17 2024-01-27 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
utils.py
in lmms_eval/tasks/refcoco+
 78 13 2024-01-17 2024-01-27 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
utils.py
in lmms_eval/tasks/vqav2
 69 6 2024-01-17 2024-02-26 4 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
utils.py
in lmms_eval/tasks/textvqa
 53 4 2024-01-17 2024-02-26 4 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
llava-in-the-wild.yaml
in lmms_eval/tasks/llava-in-the-wild
 39 - 2024-01-17 2024-03-12 8 3 92624596+kcz358@users.norep... drluodian@gmail.com
llava-bench-coco.yaml
in lmms_eval/tasks/llava-bench-coco
 38 - 2024-01-17 2024-02-26 5 3 92624596+kcz358@users.norep... drluodian@gmail.com
mmvet.yaml
in lmms_eval/tasks/mmvet
 29 - 2024-01-17 2024-02-26 4 3 92624596+kcz358@users.norep... drluodian@gmail.com
_generate_config.py
in lmms_eval/tasks/refcocog
 20 - 2024-01-17 2024-01-28 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
_generate_config.py
in lmms_eval/tasks/refcoco
 20 - 2024-01-17 2024-01-28 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
_generate_config.py
in lmms_eval/tasks/refcoco+
 20 - 2024-01-17 2024-01-28 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
_refcoco.yaml
in lmms_eval/tasks/refcoco
 10 - 2024-01-17 2024-01-27 2 2 92624596+kcz358@users.norep... drluodian@gmail.com
_refcoco.yaml
in lmms_eval/tasks/refcoco+
 8 - 2024-01-17 2024-01-27 2 2 92624596+kcz358@users.norep... drluodian@gmail.com
_refcoco.yaml
in lmms_eval/tasks/refcocog
 6 - 2024-01-17 2024-01-27 2 2 92624596+kcz358@users.norep... drluodian@gmail.com
refcocog_bbox_val.yaml
in lmms_eval/tasks/refcocog
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcocog_seg_val.yaml
in lmms_eval/tasks/refcocog
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco_bbox_testA.yaml
in lmms_eval/tasks/refcoco
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
Files Not Recently Changed (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
__init__.py
in lmms_eval
 1 - 2024-01-11 2024-01-11 1 1 a1286225768@gmail.com a1286225768@gmail.com
__init__.py
in lmms_eval/api
 1 - 2024-01-11 2024-01-11 1 1 a1286225768@gmail.com a1286225768@gmail.com
refcoco+_seg_testB.yaml
in lmms_eval/tasks/refcoco+
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco+_seg_testA.yaml
in lmms_eval/tasks/refcoco+
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco+_bbox_val.yaml
in lmms_eval/tasks/refcoco+
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco+_bbox_testB.yaml
in lmms_eval/tasks/refcoco+
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco+_bbox_testA.yaml
in lmms_eval/tasks/refcoco+
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco+_seg_val.yaml
in lmms_eval/tasks/refcoco+
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco_bbox_val.yaml
in lmms_eval/tasks/refcoco
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco_seg_testA.yaml
in lmms_eval/tasks/refcoco
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco_bbox_testB.yaml
in lmms_eval/tasks/refcoco
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco_seg_testB.yaml
in lmms_eval/tasks/refcoco
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco_seg_val.yaml
in lmms_eval/tasks/refcoco
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcoco_bbox_testA.yaml
in lmms_eval/tasks/refcoco
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcocog_seg_val.yaml
in lmms_eval/tasks/refcocog
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
refcocog_bbox_val.yaml
in lmms_eval/tasks/refcocog
 4 - 2024-01-17 2024-01-17 1 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
filter.py
in lmms_eval/api
 18 3 2024-01-11 2024-01-17 2 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
selection.py
in lmms_eval/filters
 21 6 2024-01-11 2024-01-17 2 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
transformation.py
in lmms_eval/filters
 24 6 2024-01-11 2024-01-17 2 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
__init__.py
in lmms_eval/filters
 28 2 2024-01-11 2024-01-17 2 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
extraction.py
in lmms_eval/filters
 33 4 2024-01-11 2024-01-17 2 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
pope.yaml
in lmms_eval/tasks/pope
 34 - 2024-01-21 2024-01-23 2 1 drluodian@gmail.com drluodian@gmail.com
utils.py
in lmms_eval/tasks/pope
 63 8 2024-01-21 2024-01-23 2 1 drluodian@gmail.com drluodian@gmail.com
seedbench.yaml
in lmms_eval/tasks/seedbench
 26 - 2024-01-23 2024-01-24 2 1 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
gpt_eval_utils.py
in lmms_eval/tasks/_task_utils
 1 - 2024-01-27 2024-01-27 1 1 a1286225768@gmail.com a1286225768@gmail.com
textcaps.yaml
in lmms_eval/tasks/textcaps
 4 - 2024-01-23 2024-01-27 2 2 92624596+kcz358@users.norep... drluodian@gmail.com
nocaps.yaml
in lmms_eval/tasks/nocaps
 4 - 2024-01-23 2024-01-27 2 2 92624596+kcz358@users.norep... drluodian@gmail.com
_refcoco.yaml
in lmms_eval/tasks/refcocog
 6 - 2024-01-17 2024-01-27 2 2 92624596+kcz358@users.norep... drluodian@gmail.com
decontamination.py
in lmms_eval/filters
 7 2 2024-01-11 2024-01-27 2 1 a1286225768@gmail.com a1286225768@gmail.com
mathvista.yaml
in lmms_eval/tasks/mathvista
 8 - 2024-01-27 2024-01-27 1 1 drluodian@gmail.com drluodian@gmail.com
_refcoco.yaml
in lmms_eval/tasks/refcoco+
 8 - 2024-01-17 2024-01-27 2 2 92624596+kcz358@users.norep... drluodian@gmail.com
_refcoco.yaml
in lmms_eval/tasks/refcoco
 10 - 2024-01-17 2024-01-27 2 2 92624596+kcz358@users.norep... drluodian@gmail.com
mathvista_testmini.yaml
in lmms_eval/tasks/mathvista
 28 - 2024-01-27 2024-01-27 1 1 drluodian@gmail.com drluodian@gmail.com
upload_chartqa.py
in lmms_eval/tasks/chartqa
 67 4 2024-01-27 2024-01-27 1 1 a1286225768@gmail.com a1286225768@gmail.com
upload_ai2d.py
in lmms_eval/tasks/ai2d
 69 4 2024-01-27 2024-01-27 1 2 drluodian@gmail.com a1286225768@gmail.com
utils.py
in lmms_eval/tasks/refcoco+
 78 13 2024-01-17 2024-01-27 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
utils.py
in lmms_eval/tasks/refcoco
 78 13 2024-01-17 2024-01-27 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
utils.py
in lmms_eval/tasks/refcocog
 78 13 2024-01-17 2024-01-27 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
mathvista_evals.py
in lmms_eval/tasks/mathvista
 311 11 2024-01-27 2024-01-27 1 1 drluodian@gmail.com drluodian@gmail.com
_generate_config.py
in lmms_eval/tasks/refcoco+
 20 - 2024-01-17 2024-01-28 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
_generate_config.py
in lmms_eval/tasks/refcoco
 20 - 2024-01-17 2024-01-28 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
_generate_config.py
in lmms_eval/tasks/refcocog
 20 - 2024-01-17 2024-01-28 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
mmmu_val.yaml
in lmms_eval/tasks/mmmu
 17 - 2024-01-29 2024-01-29 1 1 a1286225768@gmail.com a1286225768@gmail.com
utils.py
in lmms_eval/tasks/gqa
 18 2 2024-01-11 2024-02-03 5 4 a1286225768@gmail.com a1286225768@gmail.com
utils.py
in lmms_eval/tasks/ai2d
 23 3 2024-01-27 2024-02-03 2 1 a1286225768@gmail.com a1286225768@gmail.com
gqa.yaml
in lmms_eval/tasks/gqa
 31 - 2024-01-11 2024-02-03 4 2 a1286225768@gmail.com a1286225768@gmail.com
chartqa.yaml
in lmms_eval/tasks/chartqa
 33 - 2024-01-27 2024-02-03 3 2 a1286225768@gmail.com a1286225768@gmail.com
ai2d.yaml
in lmms_eval/tasks/ai2d
 33 - 2024-01-27 2024-02-03 2 1 a1286225768@gmail.com a1286225768@gmail.com
utils.py
in lmms_eval/tasks/chartqa
 34 4 2024-01-27 2024-02-03 2 1 a1286225768@gmail.com a1286225768@gmail.com
120 - 2024-01-17 2024-02-04 3 2 92624596+kcz358@users.norep... drluodian@gmail.com
Most Recently Created Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
setup.py
in root
 2 -
en_utils.py
in lmms_eval/tasks/olympiadbench
 58 4 2024-03-28 2024-03-29 2 2 joshuaadrianc@gmail.com drluodian@gmail.com
cn_utils.py
in lmms_eval/tasks/olympiadbench
 58 4 2024-03-28 2024-03-29 2 2 joshuaadrianc@gmail.com drluodian@gmail.com
olympiadbench_test_cn.yaml
in lmms_eval/tasks/olympiadbench
 25 - 2024-03-28 2024-03-29 2 2 joshuaadrianc@gmail.com drluodian@gmail.com
utils.py
in lmms_eval/tasks/ocrbench
 87 4 2024-03-24 2024-03-28 3 3 1731396519@qq.com drluodian@gmail.com
upload_ocrbench.py
in lmms_eval/tasks/ocrbench
 66 2 2024-03-24 2024-03-28 3 3 1731396519@qq.com drluodian@gmail.com
ocrbench.yaml
in lmms_eval/tasks/ocrbench
 22 - 2024-03-24 2024-03-28 3 2 1731396519@qq.com drluodian@gmail.com
olympiadbench_test_en.yaml
in lmms_eval/tasks/olympiadbench
 25 - 2024-03-18 2024-03-29 3 2 joshuaadrianc@gmail.com drluodian@gmail.com
olympiadbench_evals.py
in lmms_eval/tasks/olympiadbench
 249 13 2024-03-15 2024-03-29 2 2 joshuaadrianc@gmail.com drluodian@gmail.com
olympiadbench.yaml
in lmms_eval/tasks/olympiadbench
 6 - 2024-03-15 2024-03-29 5 2 joshuaadrianc@gmail.com drluodian@gmail.com
minicpm_v.py
in lmms_eval/models
 165 15 2024-02-29 2024-03-11 5 4 a1286225768@gmail.com drluodian@gmail.com
instructblip.py
in lmms_eval/models
 164 15 2024-02-29 2024-03-11 5 4 a1286225768@gmail.com drluodian@gmail.com
mmbench_evals.py
in lmms_eval/tasks/mmbench
 255 16 2024-02-25 2024-04-07 4 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
vqa_eval_metric.py
in lmms_eval/tasks/_task_utils
 199 5 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
cn_utils.py
in lmms_eval/tasks/mmbench
 102 6 2024-02-25 2024-04-07 9 3 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
en_utils.py
in lmms_eval/tasks/mmbench
 101 6 2024-02-25 2024-04-07 9 3 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
utils.py
in lmms_eval/tasks/coco_cap
 88 14 2024-02-25 2024-03-05 3 3 fpu001@e.ntu.edu.sg 92624596+kcz358@users.norep...
cc_utils.py
in lmms_eval/tasks/mmbench
 86 5 2024-02-25 2024-04-07 9 3 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
utils.py
in lmms_eval/tasks/ok_vqa
 56 4 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
coco2014_cap_val.yaml
in lmms_eval/tasks/coco_cap
 41 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
coco2017_cap_val.yaml
in lmms_eval/tasks/coco_cap
 41 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
scienceqa_img.yaml
in lmms_eval/tasks/scienceqa
 33 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
mmbench_cc.yaml
in lmms_eval/tasks/mmbench
 33 - 2024-02-25 2024-04-07 7 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
_generate_config.py
in lmms_eval/tasks/ok_vqa
 20 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
textvqa_val.yaml
in lmms_eval/tasks/textvqa
 12 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
mmbench.yaml
in lmms_eval/tasks/mmbench
 11 - 2024-02-25 2024-04-07 4 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
vqav2_val.yaml
in lmms_eval/tasks/vqav2
 10 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
mmbench_en_dev.yaml
in lmms_eval/tasks/mmbench
 10 - 2024-02-25 2024-04-07 7 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
mmbench_cn_dev.yaml
in lmms_eval/tasks/mmbench
 10 - 2024-02-25 2024-04-07 7 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
mmbench_cn.yaml
in lmms_eval/tasks/mmbench
 9 - 2024-02-25 2024-04-07 7 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
mmbench_en.yaml
in lmms_eval/tasks/mmbench
 8 - 2024-02-25 2024-04-07 7 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
file_utils.py
in lmms_eval/tasks/_task_utils
 6 1 2024-02-25 2024-03-28 4 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
coco_cap.yaml
in lmms_eval/tasks/coco_cap
 6 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
scienceqa_full.yaml
in lmms_eval/tasks/scienceqa
 4 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
_cmmmu.yaml
in lmms_eval/tasks/cmmmu
 4 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
coco2014_cap.yaml
in lmms_eval/tasks/coco_cap
 4 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
coco2017_cap.yaml
in lmms_eval/tasks/coco_cap
 4 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
_textvqa.yaml
in lmms_eval/tasks/textvqa
 4 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
infovqa.yaml
in lmms_eval/tasks/infovqa
 4 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
iconqa.yaml
in lmms_eval/tasks/iconqa
 4 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
_vqav2.yaml
in lmms_eval/tasks/vqav2
 4 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
ok_vqa_val2014.yaml
in lmms_eval/tasks/ok_vqa
 4 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
multidocvqa.yaml
in lmms_eval/tasks/multidocvqa
 4 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
_ok_vqa.yaml
in lmms_eval/tasks/ok_vqa
 3 - 2024-02-25 2024-02-26 2 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
utils.py
in lmms_eval/tasks/multidocvqa
 76 12 2024-02-13 2024-02-26 3 3 drluodian@gmail.com drluodian@gmail.com
utils.py
in lmms_eval/tasks/iconqa
 42 4 2024-02-13 2024-02-26 3 2 drluodian@gmail.com drluodian@gmail.com
multidocvqa_val.yaml
in lmms_eval/tasks/multidocvqa
 23 - 2024-02-13 2024-02-13 1 1 154438029+xinrundu@users.no... 154438029+xinrundu@users.no...
stvqa.yaml
in lmms_eval/tasks/stvqa
 19 - 2024-02-13 2024-02-13 1 1 154438029+xinrundu@users.no... 154438029+xinrundu@users.no...
utils.py
in lmms_eval/tasks/stvqa
 19 4 2024-02-13 2024-02-26 3 3 drluodian@gmail.com drluodian@gmail.com
iconqa_val.yaml
in lmms_eval/tasks/iconqa
 3 - 2024-02-13 2024-02-26 3 2 drluodian@gmail.com drluodian@gmail.com
Most Recently Changed Files (Top 50)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
setup.py
in root
 2 -
mmbench_evals.py
in lmms_eval/tasks/mmbench
 255 16 2024-02-25 2024-04-07 4 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
cn_utils.py
in lmms_eval/tasks/mmbench
 102 6 2024-02-25 2024-04-07 9 3 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
en_utils.py
in lmms_eval/tasks/mmbench
 101 6 2024-02-25 2024-04-07 9 3 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
cc_utils.py
in lmms_eval/tasks/mmbench
 86 5 2024-02-25 2024-04-07 9 3 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
mmbench_cc.yaml
in lmms_eval/tasks/mmbench
 33 - 2024-02-25 2024-04-07 7 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
mmbench.yaml
in lmms_eval/tasks/mmbench
 11 - 2024-02-25 2024-04-07 4 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
mmbench_en_dev.yaml
in lmms_eval/tasks/mmbench
 10 - 2024-02-25 2024-04-07 7 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
mmbench_cn_dev.yaml
in lmms_eval/tasks/mmbench
 10 - 2024-02-25 2024-04-07 7 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
mmbench_cn.yaml
in lmms_eval/tasks/mmbench
 9 - 2024-02-25 2024-04-07 7 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
mmbench_en.yaml
in lmms_eval/tasks/mmbench
 8 - 2024-02-25 2024-04-07 7 2 fpu001@e.ntu.edu.sg fpu001@e.ntu.edu.sg
olympiadbench_evals.py
in lmms_eval/tasks/olympiadbench
 249 13 2024-03-15 2024-03-29 2 2 joshuaadrianc@gmail.com drluodian@gmail.com
65 - 2023-12-24 2024-03-29 20 6 a1286225768@gmail.com drluodian@gmail.com
en_utils.py
in lmms_eval/tasks/olympiadbench
 58 4 2024-03-28 2024-03-29 2 2 joshuaadrianc@gmail.com drluodian@gmail.com
cn_utils.py
in lmms_eval/tasks/olympiadbench
 58 4 2024-03-28 2024-03-29 2 2 joshuaadrianc@gmail.com drluodian@gmail.com
olympiadbench_test_cn.yaml
in lmms_eval/tasks/olympiadbench
 25 - 2024-03-28 2024-03-29 2 2 joshuaadrianc@gmail.com drluodian@gmail.com
olympiadbench_test_en.yaml
in lmms_eval/tasks/olympiadbench
 25 - 2024-03-18 2024-03-29 3 2 joshuaadrianc@gmail.com drluodian@gmail.com
olympiadbench.yaml
in lmms_eval/tasks/olympiadbench
 6 - 2024-03-15 2024-03-29 5 2 joshuaadrianc@gmail.com drluodian@gmail.com
utils.py
in lmms_eval/tasks/ocrbench
 87 4 2024-03-24 2024-03-28 3 3 1731396519@qq.com drluodian@gmail.com
upload_ocrbench.py
in lmms_eval/tasks/ocrbench
 66 2 2024-03-24 2024-03-28 3 3 1731396519@qq.com drluodian@gmail.com
ocrbench.yaml
in lmms_eval/tasks/ocrbench
 22 - 2024-03-24 2024-03-28 3 2 1731396519@qq.com drluodian@gmail.com
file_utils.py
in lmms_eval/tasks/_task_utils
 6 1 2024-02-25 2024-03-28 4 2 fpu001@e.ntu.edu.sg drluodian@gmail.com
__init__.py
in lmms_eval/tasks
 107 9 2024-01-11 2024-03-16 8 4 a1286225768@gmail.com fpu001@e.ntu.edu.sg
__main__.py
in lmms_eval
 293 6 2024-01-11 2024-03-12 22 5 a1286225768@gmail.com drluodian@gmail.com
llava.py
in lmms_eval/models
 283 16 2024-01-11 2024-03-12 21 5 a1286225768@gmail.com drluodian@gmail.com
samplers.py
in lmms_eval/api
 55 7 2024-01-11 2024-03-12 7 5 a1286225768@gmail.com fpu001@e.ntu.edu.sg
llava-in-the-wild.yaml
in lmms_eval/tasks/llava-in-the-wild
 39 - 2024-01-17 2024-03-12 8 3 92624596+kcz358@users.norep... drluodian@gmail.com
task.py
in lmms_eval/api
 750 53 2024-01-11 2024-03-11 15 5 a1286225768@gmail.com drluodian@gmail.com
utils.py
in lmms_eval/tasks/cmmmu
 304 17 2024-02-10 2024-03-11 7 4 154438029+xinrundu@users.no... drluodian@gmail.com
metrics.py
in lmms_eval/api
 279 35 2024-01-11 2024-03-11 8 4 a1286225768@gmail.com drluodian@gmail.com
qwen_vl.py
in lmms_eval/models
 227 13 2024-01-27 2024-03-11 11 5 a1286225768@gmail.com drluodian@gmail.com
fuyu.py
in lmms_eval/models
 198 15 2024-01-31 2024-03-11 8 4 drluodian@gmail.com drluodian@gmail.com
minicpm_v.py
in lmms_eval/models
 165 15 2024-02-29 2024-03-11 5 4 a1286225768@gmail.com drluodian@gmail.com
instructblip.py
in lmms_eval/models
 164 15 2024-02-29 2024-03-11 5 4 a1286225768@gmail.com drluodian@gmail.com
gpt4v.py
in lmms_eval/models
 99 5 2024-01-11 2024-03-11 8 5 a1286225768@gmail.com drluodian@gmail.com
model.py
in lmms_eval/api
 97 13 2024-01-11 2024-03-11 6 4 a1286225768@gmail.com drluodian@gmail.com
__init__.py
in lmms_eval/models
 16 - 2024-01-11 2024-03-11 11 7 a1286225768@gmail.com drluodian@gmail.com
evaluator.py
in lmms_eval
 403 3 2024-01-11 2024-03-05 17 4 a1286225768@gmail.com 92624596+kcz358@users.norep...
logging_utils.py
in lmms_eval
 259 15 2024-02-04 2024-03-05 9 3 drluodian@gmail.com 92624596+kcz358@users.norep...
utils.py
in lmms_eval/tasks/mmvet
 158 5 2024-01-17 2024-03-05 7 3 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
utils.py
in lmms_eval/tasks/llava-bench-coco
 145 10 2024-01-17 2024-03-05 7 3 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
utils.py
in lmms_eval/tasks/llava-in-the-wild
 143 10 2024-01-17 2024-03-05 9 3 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
utils.py
in lmms_eval/tasks/mathvista
 99 4 2024-01-27 2024-03-05 4 3 drluodian@gmail.com 92624596+kcz358@users.norep...
registry.py
in lmms_eval/api
 97 9 2024-01-11 2024-03-05 3 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
utils.py
in lmms_eval/tasks/coco_cap
 88 14 2024-02-25 2024-03-05 3 3 fpu001@e.ntu.edu.sg 92624596+kcz358@users.norep...
utils.py
in lmms_eval/tasks/seedbench_2
 44 6 2024-02-10 2024-03-05 6 2 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
utils.py
in lmms_eval/tasks/seedbench
 42 8 2024-01-23 2024-03-05 7 3 92624596+kcz358@users.norep... 92624596+kcz358@users.norep...
instance.py
in lmms_eval/api
 19 2 2024-01-11 2024-03-05 4 2 a1286225768@gmail.com 92624596+kcz358@users.norep...
evaluate_hb.py
in lmms_eval/tasks/hallusion_bench
 97 11 2024-01-31 2024-03-03 5 3 drluodian@gmail.com 92624596+kcz358@users.norep...
mme.yaml
in lmms_eval/tasks/mme
 35 - 2024-01-11 2024-03-03 8 4 a1286225768@gmail.com 92624596+kcz358@users.norep...