huggingface / optimum-habana

Duplication

Places in code with 6 or more lines that are exactly the same.

Longest Duplicates

The list of 50 longest duplicates.

See data for all 10,351 duplicates...

Size	#	Folders	Files	Lines	Code
114	x 2	optimum/habana/diffusers...nes/stable_diffusion_xl optimum/habana/diffusers...nes/stable_diffusion_xl	pipeline_stable_diffusion_xl.py pipeline_stable_diffusion_xl_mlperf.py	178:317 (19%) 294:433 (18%)	view
102	x 2	optimum/habana/transformers/models/persimmon optimum/habana/transformers/models/stablelm	modeling_persimmon.py modeling_stablelm.py	347:476 (29%) 366:493 (28%)	view
102	x 2	optimum/habana/diffusers...nes/stable_diffusion_xl optimum/habana/diffusers...nes/stable_diffusion_xl	pipeline_stable_diffusion_xl.py pipeline_stable_diffusion_xl_img2img.py	834:956 (17%) 680:802 (17%)	view
94	x 2	optimum/habana/diffusers...nes/stable_diffusion_xl optimum/habana/diffusers...nes/stable_diffusion_xl	pipeline_stable_diffusion_xl_img2img.py pipeline_stable_diffusion_xl_mlperf.py	151:270 (16%) 294:413 (15%)	view
94	x 2	optimum/habana/diffusers...nes/stable_diffusion_xl optimum/habana/diffusers...nes/stable_diffusion_xl	pipeline_stable_diffusion_xl.py pipeline_stable_diffusion_xl_img2img.py	178:297 (15%) 151:270 (16%)	view
88	x 2	optimum/habana/diffusers/pipelines/flux optimum/habana/diffusers/pipelines/flux	pipeline_flux.py pipeline_flux_img2img.py	519:634 (24%) 551:666 (23%)	view
87	x 2	optimum/habana/transformers/models/deepseek_v2 optimum/habana/transformers/models/deepseek_v3	modeling_deepseek_v2.py modeling_deepseek_v3.py	719:829 (4%) 596:708 (6%)	view
82	x 2	optimum/habana/transformers/models/chatglm optimum/habana/transformers/models/glm4v	modeling_chatglm.py modeling_chatglm.py	540:648 (5%) 645:754 (6%)	view
76	x 2	optimum/habana/transformers/models/deepseek_v2 optimum/habana/transformers/models/deepseek_v3	modeling_deepseek_v2.py modeling_deepseek_v3.py	2271:2358 (4%) 1833:1920 (5%)	view
73	x 2	optimum/habana/transformers/models/llama optimum/habana/transformers/models/qwen2	modeling_llama.py modeling_qwen2.py	1503:1598 (5%) 1010:1104 (7%)	view
68	x 2	optimum/habana/transformers/models/chatglm optimum/habana/transformers/models/glm4v	modeling_chatglm.py modeling_chatglm.py	883:970 (4%) 942:1029 (5%)	view
64	x 2	optimum/habana/transformers/models/deepseek_v2 optimum/habana/transformers/models/qwen2_moe	modeling_deepseek_v2.py modeling_qwen2_moe.py	2157:2232 (3%) 1148:1223 (6%)	view
62	x 2	optimum/habana/diffusers...nes/stable_diffusion_xl optimum/habana/diffusers...nes/stable_diffusion_xl	pipeline_stable_diffusion_xl_img2img.py pipeline_stable_diffusion_xl_inpaint.py	733:802 (10%) 980:1049 (9%)	view
62	x 2	optimum/habana/diffusers...nes/stable_diffusion_xl optimum/habana/diffusers...nes/stable_diffusion_xl	pipeline_stable_diffusion_xl.py pipeline_stable_diffusion_xl_inpaint.py	887:956 (10%) 980:1049 (9%)	view
61	x 2	optimum/habana/transformers/models/llama optimum/habana/transformers/models/qwen2	modeling_llama.py modeling_qwen2.py	359:424 (4%) 206:271 (6%)	view
57	x 2	optimum/habana/transformers/models/phi optimum/habana/transformers/models/starcoder2	modeling_phi.py modeling_starcoder2.py	514:588 (12%) 737:803 (8%)	view
56	x 2	optimum/habana/transformers/models/llava_next optimum/habana/transformers/models/llava_onevision	modeling_llava_next.py modeling_llava_onevision.py	157:243 (17%) 161:247 (17%)	view
55	x 2	optimum/habana/transformers/models/llama optimum/habana/transformers/models/qwen2	modeling_llama.py modeling_qwen2.py	720:778 (4%) 488:545 (6%)	view
55	x 2	optimum/habana/transformers/models/gemma optimum/habana/transformers/models/starcoder2	modeling_gemma.py modeling_starcoder2.py	692:755 (7%) 600:662 (8%)	view
55	x 2	optimum/habana/transformers/models/qwen2 optimum/habana/transformers/models/qwen2_moe	modeling_qwen2.py modeling_qwen2_moe.py	650:708 (6%) 701:759 (5%)	view
54	x 2	optimum/habana/transformers/models/llava_next optimum/habana/transformers/models/llava_onevision	modeling_llava_next.py modeling_llava_onevision.py	348:422 (17%) 369:445 (16%)	view
53	x 2	optimum/habana/transformers/models/gemma2 optimum/habana/transformers/models/starcoder2	modeling_gemma2.py modeling_starcoder2.py	305:373 (6%) 156:224 (8%)	view
52	x 2	optimum/habana/diffusers/pipelines/flux optimum/habana/diffusers/pipelines/flux	pipeline_flux.py pipeline_flux_img2img.py	447:515 (14%) 479:547 (14%)	view
52	x 2	optimum/habana/diffusers...nes/stable_diffusion_xl optimum/habana/diffusers...nes/stable_diffusion_xl	pipeline_stable_diffusion_xl.py pipeline_stable_diffusion_xl_img2img.py	725:789 (8%) 571:635 (9%)	view
50	x 2	optimum/habana/diffusers/pipelines/flux optimum/habana/diffusers/pipelines/flux	pipeline_flux.py pipeline_flux_img2img.py	173:240 (14%) 177:244 (13%)	view
49	x 2	optimum/habana/transformers/models/persimmon optimum/habana/transformers/models/stablelm	modeling_persimmon.py modeling_stablelm.py	216:278 (14%) 232:293 (13%)	view
49	x 2	optimum/habana/transformers/models/deepseek_v2 optimum/habana/transformers/models/deepseek_v3	modeling_deepseek_v2.py modeling_deepseek_v3.py	1271:1331 (2%) 1067:1127 (3%)	view
49	x 2	optimum/habana/transformers/models/qwen2 optimum/habana/transformers/models/qwen2_moe	modeling_qwen2.py modeling_qwen2_moe.py	1034:1095 (5%) 1129:1191 (5%)	view
49	x 2	optimum/habana/transformers/models/llama optimum/habana/transformers/models/qwen2_moe	modeling_llama.py modeling_qwen2_moe.py	1527:1588 (3%) 1129:1191 (5%)	view
48	x 2	optimum/habana/transformers/models/llama optimum/habana/transformers/models/qwen2	modeling_llama.py modeling_qwen2.py	1238:1294 (3%) 797:853 (5%)	view
48	x 2	optimum/habana/transformers/models/gemma2 optimum/habana/transformers/models/qwen2	modeling_gemma2.py modeling_qwen2.py	730:786 (5%) 797:853 (5%)	view
48	x 2	optimum/habana/transformers/models/gemma2 optimum/habana/transformers/models/llama	modeling_gemma2.py modeling_llama.py	730:786 (5%) 1238:1294 (3%)	view
47	x 2	optimum/habana/diffusers...elines/stable_diffusion optimum/habana/diffusers...nes/stable_diffusion_xl	pipeline_stable_diffusion_img2img.py pipeline_stable_diffusion_xl.py	671:719 (10%) 876:924 (7%)	view
47	x 2	optimum/habana/transformers optimum/habana/transformers/models/gemma2	modeling_rope_utils.py modeling_gemma2.py	48:115 (60%) 103:171 (5%)	view
47	x 2	optimum/habana/diffusers...elines/stable_diffusion optimum/habana/diffusers...nes/stable_diffusion_xl	pipeline_stable_diffusion_img2img.py pipeline_stable_diffusion_xl_img2img.py	671:719 (10%) 722:770 (8%)	view
47	x 2	optimum/habana/diffusers...elines/stable_diffusion optimum/habana/diffusers...elines/stable_diffusion	pipeline_stable_diffusion.py pipeline_stable_diffusion_instruct_pi...	613:673 (11%) 503:561 (11%)	view
46	x 2	optimum/habana/transformers/models/deepseek_v2 optimum/habana/transformers/models/qwen2_moe	modeling_deepseek_v2.py modeling_qwen2_moe.py	779:829 (2%) 206:257 (4%)	view
46	x 2	optimum/habana/transformers/models/deepseek_v3 optimum/habana/transformers/models/qwen2_moe	modeling_deepseek_v3.py modeling_qwen2_moe.py	992:1040 (3%) 422:470 (4%)	view
46	x 2	optimum/habana/transformers/models/deepseek_v3 optimum/habana/transformers/models/qwen2_moe	modeling_deepseek_v3.py modeling_qwen2_moe.py	657:708 (3%) 206:257 (4%)	view
45	x 2	optimum/habana/diffusers...nes/stable_diffusion_xl optimum/habana/diffusers...nes/stable_diffusion_xl	pipeline_stable_diffusion_xl_img2img.py pipeline_stable_diffusion_xl_inpaint.py	345:395 (7%) 489:541 (7%)	view
45	x 2	optimum/habana/transformers/models/gemma optimum/habana/transformers/models/gemma2	modeling_gemma.py modeling_gemma2.py	117:171 (6%) 200:254 (5%)	view
44	x 2	optimum/habana/transformers/models/persimmon optimum/habana/transformers/models/stablelm	modeling_persimmon.py modeling_stablelm.py	68:119 (12%) 66:117 (12%)	view
44	x 2	optimum/habana/transformers/models/deepseek_v2 optimum/habana/transformers/models/deepseek_v3	modeling_deepseek_v2.py modeling_deepseek_v3.py	358:408 (2%) 274:324 (3%)	view
40	x 2	optimum/habana/transformers/models/deepseek_v2 optimum/habana/transformers/models/deepseek_v3	modeling_deepseek_v2.py modeling_deepseek_v3.py	953:1004 (2%) 834:886 (2%)	view
40	x 2	optimum/habana/transformers/models/deepseek_v2 optimum/habana/transformers/models/deepseek_v3	modeling_deepseek_v2.py modeling_deepseek_v3.py	667:715 (2%) 540:592 (2%)	view
39	x 2	optimum/habana/diffusers...elines/stable_diffusion optimum/habana/diffusers...text_to_video_synthesis	pipeline_stable_diffusion.py pipeline_text_to_video_synth.py	206:261 (9%) 137:192 (13%)	view
39	x 2	optimum/habana/transformers/models/speecht5 optimum/habana/transformers/models/xglm	modeling_speecht5.py modeling_xglm.py	29:94 (10%) 24:89 (10%)	view
39	x 2	optimum/habana/transformers/models/deepseek_v2 optimum/habana/transformers/models/deepseek_v3	modeling_deepseek_v2.py modeling_deepseek_v3.py	1034:1077 (2%) 933:975 (2%)	view
39	x 2	optimum/habana/transformers/models/deepseek_v2 optimum/habana/transformers/models/deepseek_v3	configuration_deepseek_v2.py configuration_deepseek_v3.py	165:206 (41%) 178:219 (40%)	view
39	x 2	optimum/habana/transformers/models/deepseek_v2 optimum/habana/transformers/models/deepseek_v3	modeling_deepseek_v2.py modeling_deepseek_v3.py	300:354 (2%) 216:270 (2%)	view

Duplicated Units

The list of top 5 duplicated units.

See data for all 5 unit duplicates...

Size	#	Folders	Files	Lines	Code
63	x 2	optimum/habana/transformers/models/llava_next optimum/habana/transformers/models/llava_onevision	modeling_llava_next.py modeling_llava_onevision.py	0:0  0:0	view
45	x 2	optimum/habana/diffusers/pipelines/flux optimum/habana/diffusers/pipelines/flux	pipeline_flux_img2img.py pipeline_flux.py	0:0  0:0	view
36	x 2	optimum/habana/diffusers...elines/stable_diffusion optimum/habana/diffusers...text_to_video_synthesis	pipeline_stable_diffusion.py pipeline_text_to_video_synth.py	0:0  0:0	view
24	x 2	optimum/habana/diffusers...elines/stable_diffusion optimum/habana/diffusers...elines/stable_diffusion	pipeline_stable_diffusion_ldm3d.py pipeline_stable_diffusion_instruct_pi...	0:0  0:0	view
13	x 2	optimum/habana/transformers/models/persimmon optimum/habana/transformers/models/stablelm	modeling_persimmon.py modeling_stablelm.py	0:0  0:0	view