• File size measurements show the distribution of size of files.
• Files are classified in four categories based on their size (lines of code): 1-100 (very small files), 101-200 (small files), 201-500 (medium size files), 501-1000 (long files), 1001+(very long files).
• It is a good practice to keep files small. Long files may become "bloaters", code that have increased to such gargantuan proportions that they are hard to work with.

• There are 100 files with 12,804 lines of code.
• 1 very long files (4,106 lines of code)
• 0 long files (0 lines of code)
• 12 medium size files (3,809 lines of codeclsfd_ftr_w_mp_ins)
• 15 small files (2,176 lines of code)
• 72 very small files (2,713 lines of code)

There are 9 files with lines longer than 120 characters. In total, there are 11 long lines.

File	# lines	# units	# long lines
c4_filters.py in src/datatrove/pipeline/filters	197	8	2
jobs_status.py in src/datatrove/tools	71	1	2
pyproject.toml in root	152	-	1
huggingface.py in src/datatrove/pipeline/readers	95	4	1
bloom_filter.py in src/datatrove/pipeline/dedup	143	12	1
dataset.py in src/datatrove/utils	194	12	1
stats.py in src/datatrove/utils	297	41	1
local.py in src/datatrove/executor	101	4	1
check_dataset.py in src/datatrove/tools	58	4	1