huggingface / lmms-eval
File Size

The distribution of size of files (measured in lines of code).

Intro
Learn more...
File Size Overall
0% | 11% | 34% | 16% | 36%
Legend:
1001+
501-1000
201-500
101-200
1-100


explore: grouped by folders | grouped by size | sunburst | 3D view
File Size per Extension
1001+
501-1000
201-500
101-200
1-100
py0% | 13% | 40% | 17% | 28%
ipynb0% | 0% | 0% | 100% | 0%
yaml0% | 0% | 0% | 0% | 100%
toml0% | 0% | 0% | 0% | 100%
File Size per Logical Decomposition
primary
1001+
501-1000
201-500
101-200
1-100
lmms_eval0% | 12% | 35% | 15% | 36%
tools0% | 0% | 0% | 100% | 0%
ROOT0% | 0% | 0% | 0% | 100%
Longest Files (Top 50)
File# lines# units
task.py
in lmms_eval/api
750 53
utils.py
in lmms_eval
507 48
evaluator.py
in lmms_eval
403 3
utils.py
in lmms_eval/tasks/mmmu
328 19
mathvista_evals.py
in lmms_eval/tasks/mathvista
311 11
utils.py
in lmms_eval/tasks/cmmmu
304 17
__main__.py
in lmms_eval
293 6
llava.py
in lmms_eval/models
283 16
metrics.py
in lmms_eval/api
279 35
qwen_generate_utils.py
in lmms_eval/models/model_utils/qwen
264 15
logging_utils.py
in lmms_eval
259 15
mmbench_evals.py
in lmms_eval/tasks/mmbench
255 16
olympiadbench_evals.py
in lmms_eval/tasks/olympiadbench
249 13
utils.py
in lmms_eval/tasks/hallusion_bench
237 6
qwen_vl.py
in lmms_eval/models
227 13
vqa_eval_metric.py
in lmms_eval/tasks/_task_utils
199 5
fuyu.py
in lmms_eval/models
198 15
minicpm_v.py
in lmms_eval/models
165 15
instructblip.py
in lmms_eval/models
164 15
utils.py
in lmms_eval/tasks/mmvet
158 5
utils.py
in lmms_eval/tasks/ferret
153 10
utils.py
in lmms_eval/tasks/llava-bench-coco
145 10
utils.py
in lmms_eval/tasks/llava-in-the-wild
143 10
120 -
__init__.py
in lmms_eval/tasks
107 9
cn_utils.py
in lmms_eval/tasks/mmbench
102 6
en_utils.py
in lmms_eval/tasks/mmbench
101 6
gpt4v.py
in lmms_eval/models
99 5
utils.py
in lmms_eval/tasks/mathvista
99 4
registry.py
in lmms_eval/api
97 9
model.py
in lmms_eval/api
97 13
evaluate_hb.py
in lmms_eval/tasks/hallusion_bench
97 11
utils.py
in lmms_eval/tasks/coco_cap
88 14
utils.py
in lmms_eval/tasks/mme
88 5
utils.py
in lmms_eval/tasks/ocrbench
87 4
cc_utils.py
in lmms_eval/tasks/mmbench
86 5
utils.py
in lmms_eval/tasks/nocaps
84 14
utils.py
in lmms_eval/tasks/textcaps
82 14
utils.py
in lmms_eval/tasks/refcocog
78 13
utils.py
in lmms_eval/tasks/refcoco
78 13
utils.py
in lmms_eval/tasks/refcoco+
78 13
utils.py
in lmms_eval/tasks/flickr30k
76 13
utils.py
in lmms_eval/tasks/multidocvqa
76 12
upload_ai2d.py
in lmms_eval/tasks/ai2d
69 4
utils.py
in lmms_eval/tasks/vqav2
69 6
upload_chartqa.py
in lmms_eval/tasks/chartqa
67 4
upload_ocrbench.py
in lmms_eval/tasks/ocrbench
66 2
65 -
utils.py
in lmms_eval/tasks/pope
63 8
en_utils.py
in lmms_eval/tasks/olympiadbench
58 4
Files With Most Units (Top 50)
File# lines# units
task.py
in lmms_eval/api
750 53
utils.py
in lmms_eval
507 48
metrics.py
in lmms_eval/api
279 35
utils.py
in lmms_eval/tasks/mmmu
328 19
utils.py
in lmms_eval/tasks/cmmmu
304 17
llava.py
in lmms_eval/models
283 16
mmbench_evals.py
in lmms_eval/tasks/mmbench
255 16
fuyu.py
in lmms_eval/models
198 15
qwen_generate_utils.py
in lmms_eval/models/model_utils/qwen
264 15
minicpm_v.py
in lmms_eval/models
165 15
instructblip.py
in lmms_eval/models
164 15
logging_utils.py
in lmms_eval
259 15
utils.py
in lmms_eval/tasks/nocaps
84 14
utils.py
in lmms_eval/tasks/coco_cap
88 14
utils.py
in lmms_eval/tasks/textcaps
82 14
model.py
in lmms_eval/api
97 13
qwen_vl.py
in lmms_eval/models
227 13
utils.py
in lmms_eval/tasks/refcocog
78 13
utils.py
in lmms_eval/tasks/refcoco
78 13
olympiadbench_evals.py
in lmms_eval/tasks/olympiadbench
249 13
utils.py
in lmms_eval/tasks/refcoco+
78 13
utils.py
in lmms_eval/tasks/flickr30k
76 13
utils.py
in lmms_eval/tasks/multidocvqa
76 12
evaluate_hb.py
in lmms_eval/tasks/hallusion_bench
97 11
mathvista_evals.py
in lmms_eval/tasks/mathvista
311 11
utils.py
in lmms_eval/tasks/ferret
153 10
utils.py
in lmms_eval/tasks/llava-in-the-wild
143 10
utils.py
in lmms_eval/tasks/llava-bench-coco
145 10
registry.py
in lmms_eval/api
97 9
__init__.py
in lmms_eval/tasks
107 9
utils.py
in lmms_eval/tasks/seedbench
42 8
utils.py
in lmms_eval/tasks/pope
63 8
samplers.py
in lmms_eval/api
55 7
__main__.py
in lmms_eval
293 6
selection.py
in lmms_eval/filters
21 6
transformation.py
in lmms_eval/filters
24 6
utils.py
in lmms_eval/tasks/hallusion_bench
237 6
utils.py
in lmms_eval/tasks/seedbench_2
44 6
utils.py
in lmms_eval/tasks/vqav2
69 6
en_utils.py
in lmms_eval/tasks/mmbench
101 6
cn_utils.py
in lmms_eval/tasks/mmbench
102 6
gpt4v.py
in lmms_eval/models
99 5
vqa_eval_metric.py
in lmms_eval/tasks/_task_utils
199 5
utils.py
in lmms_eval/tasks/mmvet
158 5
utils.py
in lmms_eval/tasks/mme
88 5
cc_utils.py
in lmms_eval/tasks/mmbench
86 5
extraction.py
in lmms_eval/filters
33 4
upload_ai2d.py
in lmms_eval/tasks/ai2d
69 4
utils.py
in lmms_eval/tasks/scienceqa
35 4
utils.py
in lmms_eval/tasks/docvqa
21 4
Files With Long Lines (Top 50)

There are 56 files with lines longer than 120 characters. In total, there are 193 long lines.

File# lines# units# long lines
task.py
in lmms_eval/api
750 53 19
mathvista_evals.py
in lmms_eval/tasks/mathvista
311 11 16
llava.py
in lmms_eval/models
283 16 13
__main__.py
in lmms_eval
293 6 10
evaluator.py
in lmms_eval
403 3 9
fuyu.py
in lmms_eval/models
198 15 8
utils.py
in lmms_eval/tasks/hallusion_bench
237 6 8
qwen_generate_utils.py
in lmms_eval/models/model_utils/qwen
264 15 7
minicpm_v.py
in lmms_eval/models
165 15 6
qwen_vl.py
in lmms_eval/models
227 13 6
utils.py
in lmms_eval/tasks/mathvista
99 4 6
instructblip.py
in lmms_eval/models
164 15 5
samplers.py
in lmms_eval/api
55 7 4
logging_utils.py
in lmms_eval
259 15 4
utils.py
in lmms_eval/tasks/pope
63 8 4
utils.py
in lmms_eval
507 48 4
registry.py
in lmms_eval/api
97 9 3
evaluate_hb.py
in lmms_eval/tasks/hallusion_bench
97 11 3
utils.py
in lmms_eval/tasks/ocrbench
87 4 3
utils.py
in lmms_eval/tasks/iconqa
42 4 3
olympiadbench_evals.py
in lmms_eval/tasks/olympiadbench
249 13 3
mmbench_evals.py
in lmms_eval/tasks/mmbench
255 16 3
gpt4v.py
in lmms_eval/models
99 5 2
utils.py
in lmms_eval/tasks/nocaps
84 14 2
upload_ai2d.py
in lmms_eval/tasks/ai2d
69 4 2
utils.py
in lmms_eval/tasks/mmvet
158 5 2
utils.py
in lmms_eval/tasks/cmmmu
304 17 2
utils.py
in lmms_eval/tasks/coco_cap
88 14 2
utils.py
in lmms_eval/tasks/llava-in-the-wild
143 10 2
en_utils.py
in lmms_eval/tasks/mmbench
101 6 2
cn_utils.py
in lmms_eval/tasks/mmbench
102 6 2
utils.py
in lmms_eval/tasks/llava-bench-coco
145 10 2
utils.py
in lmms_eval/tasks/textcaps
82 14 2
utils.py
in lmms_eval/tasks/multidocvqa
76 12 2
model.py
in lmms_eval/api
97 13 1
selection.py
in lmms_eval/filters
21 6 1
utils.py
in lmms_eval/tasks/docvqa
21 4 1
_generate_config.py
in lmms_eval/tasks/vizwiz_vqa
20 - 1
__init__.py
in lmms_eval/tasks
107 9 1
utils.py
in lmms_eval/tasks/ferret
153 10 1
utils.py
in lmms_eval/tasks/seedbench
42 8 1
_generate_config.py
in lmms_eval/tasks/refcocog
20 - 1
utils.py
in lmms_eval/tasks/refcocog
78 13 1
utils.py
in lmms_eval/tasks/seedbench_2
44 6 1
upload_ocrbench.py
in lmms_eval/tasks/ocrbench
66 2 1
_generate_config.py
in lmms_eval/tasks/refcoco
20 - 1
utils.py
in lmms_eval/tasks/refcoco
78 13 1
en_utils.py
in lmms_eval/tasks/olympiadbench
58 4 1
_generate_config.py
in lmms_eval/tasks/ok_vqa
20 - 1
upload_chartqa.py
in lmms_eval/tasks/chartqa
67 4 1