huggingface / yourbench File Size

Intro

File size measurements show the distribution of size of files.
Files are classified in four categories based on their size (lines of code): 1-100 (very small files), 101-200 (small files), 201-500 (medium size files), 501-1000 (long files), 1001+(very long files).
It is a good practice to keep files small. Long files may become "bloaters", code that have increased to such gargantuan proportions that they are hard to work with.

File Size Overall

Legend:

1001+

501-1000

201-500

101-200

1-100

File Size per Extension

1001+

501-1000

201-500

101-200

1-100

File Size per Logical Decomposition

primary

1001+

501-1000

201-500

101-200

1-100

Longest Files (Top 27)

File	# lines	# units
main.py in yourbench	519	16
dataset_engine.py in yourbench/utils	378	20
parsing_engine.py in yourbench/utils	249	11
inference_core.py in yourbench/utils/inference	204	3
lighteval.py in yourbench/pipeline	181	1
ingestion.py in yourbench/pipeline	162	8
summarization.py in yourbench/pipeline	152	5
question_models.py in yourbench/utils	138	10
the_bitter_lesson.html in example/data/raw	126	-
handler.py in yourbench/pipeline	119	4
question_generation.py in yourbench/pipeline	97	2
chunking.py in yourbench/pipeline	92	4
view_sample_questions.py in yourbench/analysis	88	8
upload_ingest_to_hub.py in yourbench/pipeline	84	3
inference_tracking.py in yourbench/utils/inference	80	7
citation_score_filtering.py in yourbench/pipeline	66	4
chunking_utils.py in yourbench/utils	64	5
advanced_example.yaml in example/configs	59	-
inference_builders.py in yourbench/utils/inference	57	2
pyproject.toml in root	55	-
loading_engine.py in yourbench/utils	39	3
prompts.py in yourbench/utils	34	-
__init__.py in yourbench/analysis	18	1
simple_example.yaml in example/configs	18	-
__init__.py in yourbench/pipeline	1	-
__init__.py in yourbench/utils	1	-
__init__.py in yourbench	1	-

Files With Most Units (Top 19)

File	# lines	# units
dataset_engine.py in yourbench/utils	378	20
main.py in yourbench	519	16
parsing_engine.py in yourbench/utils	249	11
question_models.py in yourbench/utils	138	10
ingestion.py in yourbench/pipeline	162	8
view_sample_questions.py in yourbench/analysis	88	8
inference_tracking.py in yourbench/utils/inference	80	7
summarization.py in yourbench/pipeline	152	5
chunking_utils.py in yourbench/utils	64	5
citation_score_filtering.py in yourbench/pipeline	66	4
handler.py in yourbench/pipeline	119	4
chunking.py in yourbench/pipeline	92	4
upload_ingest_to_hub.py in yourbench/pipeline	84	3
loading_engine.py in yourbench/utils	39	3
inference_core.py in yourbench/utils/inference	204	3
question_generation.py in yourbench/pipeline	97	2
inference_builders.py in yourbench/utils/inference	57	2
lighteval.py in yourbench/pipeline	181	1
__init__.py in yourbench/analysis	18	1

Files With Long Lines (Top 3)

There are 3 files with lines longer than 120 characters. In total, there are 6 long lines.

File	# lines	# units	# long lines
dataset_engine.py in yourbench/utils	378	20	3
main.py in yourbench	519	16	2
summarization.py in yourbench/pipeline	152	5	1