huggingface / lighteval
File Size

The distribution of size of files (measured in lines of code).

Intro
Learn more...
File Size Overall
28% | 24% | 23% | 12% | 10%
Legend:
1001+
501-1000
201-500
101-200
1-100


explore: grouped by folders | grouped by size | sunburst | 3D view
File Size per Extension
1001+
501-1000
201-500
101-200
1-100
py28% | 24% | 23% | 12% | 10%
toml0% | 0% | 0% | 100% | 0%
in0% | 0% | 0% | 0% | 100%
File Size per Logical Decomposition
primary
1001+
501-1000
201-500
101-200
1-100
src30% | 20% | 25% | 12% | 10%
community_tasks0% | 75% | 0% | 7% | 17%
ROOT0% | 0% | 0% | 96% | 3%
Longest Files (Top 50)
File# lines# units
tasks.py
in src/lighteval/tasks/multilingual
3872 1
instructions_utils.py
in src/lighteval/tasks/extended/ifeval
1634 6
translation_literals.py
in src/lighteval/tasks/templates/utils
1239 1
nanotron_model.py
in src/lighteval/models/nanotron
956 28
metrics_sample.py
in src/lighteval/metrics
813 63
metrics.py
in src/lighteval/metrics
776 4
instructions.py
in src/lighteval/tasks/extended/ifeval
757 123
transformers_model.py
in src/lighteval/models/transformers
731 28
arabic_evals.py
in community_tasks
725 28
serbian_eval.py
in community_tasks
526 4
evaluation_tracker.py
in src/lighteval/logging
520 17
endpoint_model.py
in src/lighteval/models/endpoints
453 18
codegen_metrics.py
in src/lighteval/tasks/extended/lcb
439 22
vllm_model.py
in src/lighteval/models/vllm
410 15
main_endpoint.py
in src/lighteval
409 4
extractive_match_utils.py
in src/lighteval/metrics/utils
360 16
language.py
in src/lighteval/utils
321 1
pipeline.py
in src/lighteval
311 17
bert_scorer.py
in src/lighteval/metrics/imports
309 17
math_comparison.py
in src/lighteval/metrics/utils
304 20
vlm_transformers_model.py
in src/lighteval/models/transformers
282 19
normalizations.py
in src/lighteval/metrics
275 11
llm_as_judge.py
in src/lighteval/metrics
262 11
sglang_model.py
in src/lighteval/models/sglang
257 13
summac.py
in src/lighteval/metrics/imports
251 22
lighteval_task.py
in src/lighteval/tasks
222 12
info_loggers.py
in src/lighteval/logging
219 11
linguistic_tokenizers.py
in src/lighteval/metrics/utils
218 24
prompt_manager.py
in src/lighteval/tasks
203 15
main.py
in src/lighteval/tasks/extended/tiny_benchmarks
201 7
litellm_model.py
in src/lighteval/models
194 11
main.py
in src/lighteval/tasks/extended/mix_eval
187 6
adapters.py
in src/lighteval/tasks/multilingual
185 10
main.py
in src/lighteval/tasks/extended/olympiade_bench
172 3
dynamic_metrics.py
in src/lighteval/metrics
167 8
registry.py
in src/lighteval/tasks
158 11
main.py
in src/lighteval/tasks/extended/hle
144 7
inference_providers_model.py
in src/lighteval/models/endpoints
137 7
utils.py
in src/lighteval/utils
131 11
nli.py
in src/lighteval/tasks/templates
124 6
german_rag_evals.py
in community_tasks
124 4
main_accelerate.py
in src/lighteval
123 1
model_loader.py
in src/lighteval/models
121 9
data.py
in src/lighteval
121 13
model_input.py
in src/lighteval/models
118 9
115 -
main_vllm.py
in src/lighteval
112 1
main.py
in src/lighteval/tasks/extended/ifeval
112 3
instructions_registry.py
in src/lighteval/tasks/extended/ifeval
111 1
main_sglang.py
in src/lighteval
108 1
Files With Most Units (Top 50)
File# lines# units
instructions.py
in src/lighteval/tasks/extended/ifeval
757 123
metrics_sample.py
in src/lighteval/metrics
813 63
nanotron_model.py
in src/lighteval/models/nanotron
956 28
transformers_model.py
in src/lighteval/models/transformers
731 28
arabic_evals.py
in community_tasks
725 28
linguistic_tokenizers.py
in src/lighteval/metrics/utils
218 24
summac.py
in src/lighteval/metrics/imports
251 22
codegen_metrics.py
in src/lighteval/tasks/extended/lcb
439 22
math_comparison.py
in src/lighteval/metrics/utils
304 20
vlm_transformers_model.py
in src/lighteval/models/transformers
282 19
endpoint_model.py
in src/lighteval/models/endpoints
453 18
bert_scorer.py
in src/lighteval/metrics/imports
309 17
pipeline.py
in src/lighteval
311 17
imports.py
in src/lighteval/utils
71 17
evaluation_tracker.py
in src/lighteval/logging
520 17
extractive_match_utils.py
in src/lighteval/metrics/utils
360 16
vllm_model.py
in src/lighteval/models/vllm
410 15
prompt_manager.py
in src/lighteval/tasks
203 15
sglang_model.py
in src/lighteval/models/sglang
257 13
data.py
in src/lighteval
121 13
lighteval_task.py
in src/lighteval/tasks
222 12
llm_as_judge.py
in src/lighteval/metrics
262 11
normalizations.py
in src/lighteval/metrics
275 11
utils.py
in src/lighteval/utils
131 11
litellm_model.py
in src/lighteval/models
194 11
abstract_model.py
in src/lighteval/models
82 11
info_loggers.py
in src/lighteval/logging
219 11
registry.py
in src/lighteval/tasks
158 11
sample_preparator.py
in src/lighteval/metrics
75 10
tgi_model.py
in src/lighteval/models/endpoints
88 10
adapters.py
in src/lighteval/tasks/multilingual
185 10
model_loader.py
in src/lighteval/models
121 9
model_input.py
in src/lighteval/models
118 9
data_stats_utils.py
in src/lighteval/metrics/imports
79 8
metrics_corpus.py
in src/lighteval/metrics
76 8
dynamic_metrics.py
in src/lighteval/metrics
167 8
stderr.py
in src/lighteval/metrics
63 7
data_stats_metric.py
in src/lighteval/metrics/imports
77 7
inference_providers_model.py
in src/lighteval/models/endpoints
137 7
dummy_model.py
in src/lighteval/models/dummy
50 7
utils.py
in src/lighteval/models
72 7
main.py
in src/lighteval/tasks/extended/hle
144 7
main.py
in src/lighteval/tasks/extended/tiny_benchmarks
201 7
nli.py
in src/lighteval/tasks/templates
124 6
main.py
in src/lighteval/tasks/extended/mix_eval
187 6
instructions_utils.py
in src/lighteval/tasks/extended/ifeval
1634 6
formatting_utils.py
in src/lighteval/tasks/templates/utils
39 5
metrics.py
in src/lighteval/metrics
776 4
main_endpoint.py
in src/lighteval
409 4
hellaswag.py
in src/lighteval/tasks/templates
91 4
Files With Long Lines (Top 33)

There are 33 files with lines longer than 120 characters. In total, there are 148 long lines.

File# lines# units# long lines
arabic_evals.py
in community_tasks
725 28 32
imports.py
in src/lighteval/utils
71 17 15
nanotron_model.py
in src/lighteval/models/nanotron
956 28 12
main_endpoint.py
in src/lighteval
409 4 10
evaluation_tracker.py
in src/lighteval/logging
520 17 9
transformers_model.py
in src/lighteval/models/transformers
731 28 8
endpoint_model.py
in src/lighteval/models/endpoints
453 18 7
metrics_sample.py
in src/lighteval/metrics
813 63 5
vllm_model.py
in src/lighteval/models/vllm
410 15 4
main_accelerate.py
in src/lighteval
123 1 3
sglang_model.py
in src/lighteval/models/sglang
257 13 3
litellm_model.py
in src/lighteval/models
194 11 3
vlm_transformers_model.py
in src/lighteval/models/transformers
282 19 3
main_sglang.py
in src/lighteval
108 1 3
main_vllm.py
in src/lighteval
112 1 3
data.py
in src/lighteval
121 13 3
main.py
in src/lighteval/tasks/extended/lcb
106 3 3
main.py
in src/lighteval/tasks/extended/olympiade_bench
172 3 3
metrics_corpus.py
in src/lighteval/metrics
76 8 2
pipeline.py
in src/lighteval
311 17 2
adapter_model.py
in src/lighteval/models/transformers
70 3 2
registry.py
in src/lighteval/tasks
158 11 2
sample_preparator.py
in src/lighteval/metrics
75 10 1
inference_providers_model.py
in src/lighteval/models/endpoints
137 7 1
main_custom.py
in src/lighteval
88 1 1
nli.py
in src/lighteval/tasks/templates
124 6 1
formatting_utils.py
in src/lighteval/tasks/templates/utils
39 5 1
prompt_manager.py
in src/lighteval/tasks
203 15 1
codegen_metrics.py
in src/lighteval/tasks/extended/lcb
439 22 1
prompts.py
in src/lighteval/tasks/extended/mix_eval
56 3 1
main.py
in src/lighteval/tasks/extended/tiny_benchmarks
201 7 1
115 - 1
german_rag_evals.py
in community_tasks
124 4 1