huggingface / notebooks File Size

Intro

File size measurements show the distribution of size of files.
Files are classified in four categories based on their size (lines of code): 1-100 (very small files), 101-200 (small files), 201-500 (medium size files), 501-1000 (long files), 1001+(very long files).
It is a good practice to keep files small. Long files may become "bloaters", code that have increased to such gargantuan proportions that they are hard to work with.

Learn more...

File Size Overall

There are 1,226 files with 563,121 lines of code.

84 very long files (112,775 lines of code)
365 long files (254,611 lines of code)
470 medium size files (157,579 lines of codeclsfd_ftr_w_mp_ins)
187 small files (29,654 lines of code)
120 very small files (8,502 lines of code)

Legend:

1001+

501-1000

201-500

101-200

1-100

explore: grouped by folders | grouped by size | sunburst | 3D view

File Size per Extension

1001+

501-1000

201-500

101-200

1-100

File Size per Logical Decomposition

primary

1001+

501-1000

201-500

101-200

1-100

Longest Files (Top 50)

File	# lines	# units
section2.ipynb in course/en/chapter11	5741	-
section7.ipynb in course/en/chapter3	4968	-
section6_tf.ipynb in course/fr/chapter2	2372	-
object_detection.ipynb in transformers_doc/en/tensorflow	1875	-
object_detection.ipynb in transformers_doc/en/pytorch	1875	-
object_detection.ipynb in transformers_doc/en	1875	-
task_summary.ipynb in transformers_doc/en	1833	-
task_summary.ipynb in transformers_doc	1833	-
performance.ipynb in transformers_doc/en/tensorflow	1783	-
performance.ipynb in transformers_doc/en/pytorch	1783	-
performance.ipynb in transformers_doc/en	1783	-
task_summary.ipynb in transformers_doc/en/pytorch	1474	-
semantic_segmentation.ipynb in transformers_doc/en	1427	-
task_summary.ipynb in transformers_doc/en/tensorflow	1325	-
kandinsky.ipynb in diffusers_doc/en/tensorflow	1272	-
kandinsky.ipynb in diffusers_doc/en	1272	-
kandinsky.ipynb in diffusers_doc/en/pytorch	1272	-
kandinsky.ipynb in diffusers_doc/ko/tensorflow	1272	-
kandinsky.ipynb in diffusers_doc/ko	1272	-
kandinsky.ipynb in diffusers_doc/ko/pytorch	1272	-
preprocessing.ipynb in transformers_doc/es/tensorflow	1250	-
preprocessing.ipynb in transformers_doc/es/pytorch	1250	-
preprocessing.ipynb in transformers_doc/es	1250	-
inpaint.ipynb in diffusers_doc/en/tensorflow	1249	-
inpaint.ipynb in diffusers_doc/en/pytorch	1249	-
inpaint.ipynb in diffusers_doc/en	1249	-
text-to-speech.ipynb in transformers_doc/en/tensorflow	1229	-
text-to-speech.ipynb in transformers_doc/en	1229	-
text-to-speech.ipynb in transformers_doc/en/pytorch	1229	-
section7_pt.ipynb in course/ja/chapter7	1219	-
section7_pt.ipynb in course/en/chapter7	1219	-
section7_pt.ipynb in course/zh-CN/chapter7	1219	-
section7_pt.ipynb in course/vi/chapter7	1218	-
llm_tutorial_optimization.ipynb in transformers_doc/ar/tensorflow	1217	-
llm_tutorial_optimization.ipynb in transformers_doc/ar	1217	-
llm_tutorial_optimization.ipynb in transformers_doc/ar/pytorch	1217	-
text-to-speech.ipynb in transformers_doc/ja/tensorflow	1214	-
text-to-speech.ipynb in transformers_doc/ja	1214	-
text-to-speech.ipynb in transformers_doc/ja/pytorch	1214	-
llm_tutorial_optimization.ipynb in transformers_doc/en/tensorflow	1188	-
llm_tutorial_optimization.ipynb in transformers_doc/en	1188	-
llm_tutorial_optimization.ipynb in transformers_doc/en/pytorch	1188	-
preprocessing.ipynb in transformers_doc/de	1185	-
preprocessing.ipynb in transformers_doc	1181	-
preprocessing.ipynb in transformers_doc/it/tensorflow	1180	-
preprocessing.ipynb in transformers_doc/it/pytorch	1180	-
preprocessing.ipynb in transformers_doc/it	1180	-
semantic_segmentation.ipynb in transformers_doc/en/tensorflow	1167	-
llm_tutorial_optimization.ipynb in transformers_doc/ko/tensorflow	1164	-
llm_tutorial_optimization.ipynb in transformers_doc/ko	1164	-

Files With Most Units (Top 25)

File	# lines	# units
lfqa_utils.py in longform-qa	547	35
convert_doc_to_notebooks.py in utils	302	18
run_seq2seq_no_trainer.py in sagemaker/22_accelerate_sagemaker_examples/src/seq2seq	752	5
run_clm.py in sagemaker/25_pytorch_fsdp_model_parallelism/scripts	107	4
run_clm.py in sagemaker/28_train_llms_with_qlora/scripts	143	4
run_clm.py in sagemaker/24_train_bloom_peft_lora/scripts	127	4
train.py in sagemaker/26_document_ai_donut/scripts	103	3
inference.py in sagemaker/17_custom_inference_script/code	20	3
grpo_format.py in course/en/chapter13	87	3
grpo_math.py in course/en/chapter13	82	3
grpo_length.py in course/en/chapter13	46	3
train_using_s3_data.py in sagemaker/22_accelerate_sagemaker_examples/src/text-classification	184	2
inference.py in sagemaker/26_document_ai_donut/scripts	29	2
inference.py in sagemaker/23_stable_diffusion_inference/code	20	2
run_mnr.py in sagemaker/32_train_deploy_embedding_models/scripts	135	2
inference.py in sagemaker/18_inferentia_inference/code	26	2
train.py in sagemaker/07_tensorflow_distributed_training_data_parallelism/scripts	125	2
inference.py in sagemaker/24_train_bloom_peft_lora/scripts	17	2
train.py in sagemaker/15_training_compiler/scripts	84	1
train.py in sagemaker/02_getting_started_tensorflow/scripts	77	1
train.py in sagemaker/05_spot_instances/scripts	87	1
train.py in sagemaker/01_getting_started_pytorch/scripts	66	1
train.py in sagemaker/06_sagemaker_metrics/scripts	66	1
train.py in sagemaker/09_image_classification_vision_transformer/scripts	106	1
train.py in sagemaker/14_train_and_push_to_hub/scripts	94	1

Files With Long Lines (Top 50)

There are 1014 files with lines longer than 120 characters. In total, there are 23555 long lines.

File	# lines	# units	# long lines
llm_tutorial_optimization.ipynb in transformers_doc/en/tensorflow	1188	-	170
llm_tutorial_optimization.ipynb in transformers_doc/en	1188	-	170
llm_tutorial_optimization.ipynb in transformers_doc/en/pytorch	1188	-	170
llm_tutorial_optimization.ipynb in transformers_doc/ar/tensorflow	1217	-	154
llm_tutorial_optimization.ipynb in transformers_doc/ar	1217	-	154
llm_tutorial_optimization.ipynb in transformers_doc/ar/pytorch	1217	-	154
task_summary.ipynb in transformers_doc/en	1833	-	136
task_summary.ipynb in transformers_doc	1833	-	135
performance.ipynb in transformers_doc/en/tensorflow	1783	-	131
performance.ipynb in transformers_doc/en/pytorch	1783	-	131
performance.ipynb in transformers_doc/en	1783	-	131
task_summary.ipynb in transformers_doc/en/pytorch	1474	-	126
inpaint.ipynb in diffusers_doc/en/tensorflow	1249	-	126
inpaint.ipynb in diffusers_doc/en/pytorch	1249	-	126
inpaint.ipynb in diffusers_doc/en	1249	-	126
task_summary.ipynb in transformers_doc/en/tensorflow	1325	-	121
tokenizer_summary.ipynb in transformers_doc/en/tensorflow	527	-	107
tokenizer_summary.ipynb in transformers_doc/en	527	-	107
tokenizer_summary.ipynb in transformers_doc/en/pytorch	527	-	107
tokenizer_summary.ipynb in transformers_doc	527	-	106
llm_tutorial_optimization.ipynb in transformers_doc/ko/tensorflow	1164	-	105
llm_tutorial_optimization.ipynb in transformers_doc/ko	1164	-	105
llm_tutorial_optimization.ipynb in transformers_doc/ko/pytorch	1164	-	105
kandinsky.ipynb in diffusers_doc/en/tensorflow	1272	-	101
kandinsky.ipynb in diffusers_doc/en	1272	-	101
kandinsky.ipynb in diffusers_doc/en/pytorch	1272	-	101
reinforcement_learning_for_control.ipynb in diffusers	508	-	91
ip_adapter_face_id.ipynb in diffusers	466	-	87
preprocessing.ipynb in transformers_doc/es/tensorflow	1250	-	83
preprocessing.ipynb in transformers_doc/es/pytorch	1250	-	83
preprocessing.ipynb in transformers_doc/es	1250	-	83
loading.ipynb in diffusers_doc/en/tensorflow	892	-	78
loading.ipynb in diffusers_doc/en/pytorch	892	-	78
loading.ipynb in diffusers_doc/en	892	-	78
img2img.ipynb in diffusers_doc/en/tensorflow	979	-	77
img2img.ipynb in diffusers_doc/en	979	-	77
img2img.ipynb in diffusers_doc/en/pytorch	979	-	77
kandinsky.ipynb in diffusers_doc/ko/tensorflow	1272	-	77
kandinsky.ipynb in diffusers_doc/ko	1272	-	77
kandinsky.ipynb in diffusers_doc/ko/pytorch	1272	-	77
idefics.ipynb in transformers_doc/en/tensorflow	698	-	76
idefics.ipynb in transformers_doc/en	698	-	76
idefics.ipynb in transformers_doc/en/pytorch	698	-	76
quicktour.ipynb in transformers_doc/ja	1059	-	75
guided_tour.ipynb in smolagents_doc/en/tensorflow	966	-	74
guided_tour.ipynb in smolagents_doc/en/pytorch	966	-	74
guided_tour.ipynb in smolagents_doc/en	966	-	74
other-formats.ipynb in diffusers_doc/en/tensorflow	860	-	73
other-formats.ipynb in diffusers_doc/en/pytorch	860	-	73
other-formats.ipynb in diffusers_doc/en	860	-	73