huggingface / optimum-habana File Size

Intro

File size measurements show the distribution of size of files.
Files are classified in four categories based on their size (lines of code): 1-100 (very small files), 101-200 (small files), 201-500 (medium size files), 501-1000 (long files), 1001+(very long files).
It is a good practice to keep files small. Long files may become "bloaters", code that have increased to such gargantuan proportions that they are hard to work with.

Learn more...

File Size Overall

There are 251 files with 59,075 lines of code.

10 very long files (15,343 lines of code)
27 long files (17,953 lines of code)
54 medium size files (19,091 lines of codeclsfd_ftr_w_mp_ins)
21 small files (2,977 lines of code)
139 very small files (3,711 lines of code)

Legend:

1001+

501-1000

201-500

101-200

1-100

explore: grouped by folders | grouped by size | sunburst | 3D view

File Size per Extension

1001+

501-1000

201-500

101-200

1-100

File Size per Logical Decomposition

primary

1001+

501-1000

201-500

101-200

1-100

Longest Files (Top 50)

File	# lines	# units
utils.py in optimum/habana/transformers/generation	3035	31
trainer.py in optimum/habana/transformers	1901	32
modeling_deepseek_v2.py in optimum/habana/transformers/models/deepseek_v2	1773	82
modeling_chatglm.py in optimum/habana/transformers/models/chatglm	1434	70
modeling_deepseek_v3.py in optimum/habana/transformers/models/deepseek_v3	1374	75
modeling_chatglm.py in optimum/habana/transformers/models/glm4v	1310	70
modeling_llama.py in optimum/habana/transformers/models/llama	1306	63
modeling_baichuan.py in optimum/habana/transformers/models/baichuan	1149	68
modeling_mllama.py in optimum/habana/transformers/models/mllama	1031	27
modeling_minicpm.py in optimum/habana/transformers/models/minicpm	1030	47
modeling_qwen2_moe.py in optimum/habana/transformers/models/qwen2_moe	950	43
modeling_qwen2.py in optimum/habana/transformers/models/qwen2	931	41
modeling_falcon.py in optimum/habana/transformers/models/falcon	840	32
st_gaudi_trainer.py in optimum/habana/sentence_transformers	839	27
modeling_gemma2.py in optimum/habana/transformers/models/gemma2	835	43
training_args.py in optimum/habana/transformers	779	3
ppo_trainer.py in optimum/habana/trl/trainer	736	12
modeling_mixtral.py in optimum/habana/transformers/models/mixtral	728	23
modeling_gemma.py in optimum/habana/transformers/models/gemma	709	40
modeling_utils.py in optimum/habana/transformers	687	1
modeling_starcoder2.py in optimum/habana/transformers/models/starcoder2	675	34
pipeline_stable_diffusion_xl_inpaint.py in optimum/habana/diffusers/pipelines/stable_diffusion_xl	642	6
pipeline_stable_diffusion_xl_mlperf.py in optimum/habana/diffusers/pipelines/stable_diffusion_xl	639	8
modeling_gpt_bigcode.py in optimum/habana/transformers/models/gpt_bigcode	627	11
modeling_seamless_m4t.py in optimum/habana/transformers/models/seamless_m4t	626	10
pipeline_stable_diffusion_xl.py in optimum/habana/diffusers/pipelines/stable_diffusion_xl	617	6
modeling_bart.py in optimum/habana/transformers/models/bart	606	10
modeling_mistral.py in optimum/habana/transformers/models/mistral	599	26
pipeline_stable_diffusion_xl_img2img.py in optimum/habana/diffusers/pipelines/stable_diffusion_xl	595	6
pipeline_controlnet.py in optimum/habana/diffusers/pipelines/controlnet	581	7
dpo_trainer.py in optimum/habana/trl/trainer	562	8
modeling_qwen2_vl.py in optimum/habana/transformers/models/qwen2_vl	548	14
modeling_gpt2.py in optimum/habana/transformers/models/gpt2	538	9
modeling_gptj.py in optimum/habana/transformers/models/gptj	535	28
pipeline_stable_diffusion_inpaint.py in optimum/habana/diffusers/pipelines/stable_diffusion	515	5
modeling_whisper.py in optimum/habana/transformers/models/whisper	511	6
modeling_t5.py in optimum/habana/transformers/models/t5	503	10
pipeline_stable_video_diffusion_controlnet.py in optimum/habana/diffusers/pipelines/controlnet	493	8
accelerator.py in optimum/habana/accelerate	485	4
pipeline_stable_diffusion_3.py in optimum/habana/diffusers/pipelines/stable_diffusion_3	483	5
pipeline_stable_diffusion_img2img.py in optimum/habana/diffusers/pipelines/stable_diffusion	475	7
sft_trainer.py in optimum/habana/trl/trainer	472	8
modeling_phi.py in optimum/habana/transformers/models/phi	458	13
pipeline_stable_diffusion.py in optimum/habana/diffusers/pipelines/stable_diffusion	446	7
AI_HW_Summit_2022.ipynb in notebooks	442	-
pipeline_stable_diffusion_instruct_pix2pix.py in optimum/habana/diffusers/pipelines/stable_diffusion	440	6
modeling_decilm.py in optimum/habana/transformers/models/decilm	434	9
modeling_bloom.py in optimum/habana/transformers/models/bloom	432	12
modeling_wav2vec2.py in optimum/habana/transformers/models/wav2vec2	423	10
modeling_blip_text.py in optimum/habana/transformers/models/blip	413	7

Files With Most Units (Top 50)

File	# lines	# units
modeling_deepseek_v2.py in optimum/habana/transformers/models/deepseek_v2	1773	82
modeling_deepseek_v3.py in optimum/habana/transformers/models/deepseek_v3	1374	75
modeling_chatglm.py in optimum/habana/transformers/models/chatglm	1434	70
modeling_chatglm.py in optimum/habana/transformers/models/glm4v	1310	70
modeling_baichuan.py in optimum/habana/transformers/models/baichuan	1149	68
modeling_llama.py in optimum/habana/transformers/models/llama	1306	63
modeling_minicpm.py in optimum/habana/transformers/models/minicpm	1030	47
modeling_gemma2.py in optimum/habana/transformers/models/gemma2	835	43
modeling_qwen2_moe.py in optimum/habana/transformers/models/qwen2_moe	950	43
modeling_qwen2.py in optimum/habana/transformers/models/qwen2	931	41
modeling_gemma.py in optimum/habana/transformers/models/gemma	709	40
modeling_starcoder2.py in optimum/habana/transformers/models/starcoder2	675	34
modeling_falcon.py in optimum/habana/transformers/models/falcon	840	32
trainer.py in optimum/habana/transformers	1901	32
utils.py in optimum/habana/transformers/generation	3035	31
tokenization_chatglm.py in optimum/habana/transformers/models/chatglm	235	31
modeling_gptj.py in optimum/habana/transformers/models/gptj	535	28
utils.py in optimum/habana	236	28
st_gaudi_trainer.py in optimum/habana/sentence_transformers	839	27
modeling_mllama.py in optimum/habana/transformers/models/mllama	1031	27
modeling_mistral.py in optimum/habana/transformers/models/mistral	599	26
parallel_state.py in optimum/habana/distributed	274	25
modeling_mixtral.py in optimum/habana/transformers/models/mixtral	728	23
conftest.py in root	133	17
attention_processor.py in optimum/habana/diffusers/models	328	17
serialization.py in optimum/habana/distributed	265	16
strategy.py in optimum/habana/distributed	83	16
modeling_all_models.py in optimum/habana/transformers/models	156	16
visual.py in optimum/habana/transformers/models/glm4v	139	16
tokenization_chatglm.py in optimum/habana/transformers/models/glm4v	301	15
modeling_qwen2_vl.py in optimum/habana/transformers/models/qwen2_vl	548	14
modeling_phi.py in optimum/habana/transformers/models/phi	458	13
tokenization_baichuan.py in optimum/habana/transformers/models/baichuan	145	13
modeling_clip.py in optimum/habana/transformers/models/clip	268	12
modeling_bloom.py in optimum/habana/transformers/models/bloom	432	12
modeling_gpt_neox.py in optimum/habana/transformers/models/gpt_neox	396	12
modeling_siglip.py in optimum/habana/transformers/models/siglip	246	12
ppo_trainer.py in optimum/habana/trl/trainer	736	12
transformer_engine.py in optimum/habana/accelerate/utils	151	12
modeling_gpt_bigcode.py in optimum/habana/transformers/models/gpt_bigcode	627	11
tensorparallel.py in optimum/habana/distributed	63	10
distributed_runner.py in optimum/habana/distributed	164	10
modeling_t5.py in optimum/habana/transformers/models/t5	503	10
modeling_wav2vec2.py in optimum/habana/transformers/models/wav2vec2	423	10
modeling_bart.py in optimum/habana/transformers/models/bart	606	10
modeling_seamless_m4t.py in optimum/habana/transformers/models/seamless_m4t	626	10
gemm_hpu.py in optimum/habana/AutoAWQ	123	10
modeling_decilm.py in optimum/habana/transformers/models/decilm	434	9
modeling_gpt2.py in optimum/habana/transformers/models/gpt2	538	9
modeling_opt.py in optimum/habana/transformers/models/opt	413	9

Files With Long Lines (Top 50)

There are 62 files with lines longer than 120 characters. In total, there are 252 long lines.

File	# lines	# units	# long lines
dpo_trainer.py in optimum/habana/trl/trainer	562	8	31
sft_trainer.py in optimum/habana/trl/trainer	472	8	24
AI_HW_Summit_2022.ipynb in notebooks	442	-	17
trainer.py in optimum/habana/transformers	1901	32	11
training_args.py in optimum/habana/transformers	779	3	11
accelerator.py in optimum/habana/accelerate	485	4	11
bitsandbytes.py in optimum/habana/quantizers	183	6	8
unet_2d_condition.py in optimum/habana/diffusers/models	280	3	8
modeling_deepseek_v3.py in optimum/habana/transformers/models/deepseek_v3	1374	75	7
modeling_minicpm.py in optimum/habana/transformers/models/minicpm	1030	47	7
awq.py in optimum/habana/transformers/integrations	157	7	6
utils.py in optimum/habana/transformers/generation	3035	31	5
modeling_video_llava.py in optimum/habana/transformers/models/video_llava	336	5	5
pipeline_stable_diffusion_xl_inpaint.py in optimum/habana/diffusers/pipelines/stable_diffusion_xl	642	6	5
pipeline_stable_diffusion_inpaint.py in optimum/habana/diffusers/pipelines/stable_diffusion	515	5	5
controlnet_sdv.py in optimum/habana/diffusers/models	321	9	5
st_gaudi_trainer.py in optimum/habana/sentence_transformers	839	27	4
modeling_deepseek_v2.py in optimum/habana/transformers/models/deepseek_v2	1773	82	4
tokenization_chatglm.py in optimum/habana/transformers/models/glm4v	301	15	4
modeling_qwen2_vl.py in optimum/habana/transformers/models/qwen2_vl	548	14	3
modeling_llava_next.py in optimum/habana/transformers/models/llava_next	320	3	3
modeling_all_models.py in optimum/habana/transformers/models	156	16	3
processing_video_llava.py in optimum/habana/transformers/models/video_llava	85	2	3
modeling_llava_onevision.py in optimum/habana/transformers/models/llava_onevision	333	3	3
ppo_trainer.py in optimum/habana/trl/trainer	736	12	3
utils.py in optimum/habana	236	28	3
fast_ddp.py in optimum/habana/distributed	83	3	2
st_gaudi_training_args.py in optimum/habana/sentence_transformers	35	1	2
modeling_mllama.py in optimum/habana/transformers/models/mllama	1031	27	2
modeling_mistral.py in optimum/habana/transformers/models/mistral	599	26	2
modeling_whisper.py in optimum/habana/transformers/models/whisper	511	6	2
modeling_wav2vec2.py in optimum/habana/transformers/models/wav2vec2	423	10	2
modeling_utils.py in optimum/habana/transformers	687	1	2
gaudi_configuration.py in optimum/habana/transformers	64	3	2
trainer_seq2seq.py in optimum/habana/transformers	251	6	2
pipeline_stable_diffusion_xl.py in optimum/habana/diffusers/pipelines/stable_diffusion_xl	617	6	2
pipeline_stable_diffusion_xl_mlperf.py in optimum/habana/diffusers/pipelines/stable_diffusion_xl	639	8	2
pipeline_stable_diffusion_xl_img2img.py in optimum/habana/diffusers/pipelines/stable_diffusion_xl	595	6	2
pipeline_stable_diffusion_depth2img.py in optimum/habana/diffusers/pipelines/stable_diffusion	333	7	2
pipeline_stable_diffusion_img2img.py in optimum/habana/diffusers/pipelines/stable_diffusion	475	7	2
pipeline_stable_diffusion.py in optimum/habana/diffusers/pipelines/stable_diffusion	446	7	2
pipeline_stable_diffusion_instruct_pix2pix.py in optimum/habana/diffusers/pipelines/stable_diffusion	440	6	2
pipeline_controlnet.py in optimum/habana/diffusers/pipelines/controlnet	581	7	2
serialization.py in optimum/habana/distributed	265	16	1
distributed_runner.py in optimum/habana/distributed	164	10	1
st_gaudi_encoder.py in optimum/habana/sentence_transformers	150	1	1
tokenization_chatglm.py in optimum/habana/transformers/models/chatglm	235	31	1
tokenization_baichuan.py in optimum/habana/transformers/models/baichuan	145	13	1
modeling_xlm_roberta.py in optimum/habana/transformers/models/xlm_roberta	61	1	1
modeling_siglip.py in optimum/habana/transformers/models/siglip	246	12	1