huggingface / api-inference-community Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

40% duplication:

5,364 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
2,198 duplicated lines

799 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 799 duplicates...

Size	#	Folders	Files	Lines	Code
163	x 2	docker_images/diffusers/app docker_images/latent-to-image/app	healthchecks.py healthchecks.py	26:239 (100%) 26:239 (100%)	view
45	x 2	docker_images/diffusers/app docker_images/peft/app	main.py main.py	37:98 (90%) 36:97 (91%)	view
45	x 2	docker_images/latent-to-image/app docker_images/peft/app	main.py main.py	36:97 (91%) 36:97 (91%)	view
45	x 2	docker_images/diffusers/app docker_images/latent-to-image/app	main.py main.py	37:98 (90%) 36:97 (91%)	view
44	x 2	docker_images/diffusers/app docker_images/latent-to-image/app	offline.py offline.py	8:59 (100%) 8:59 (100%)	view
44	x 2	docker_images/mindspore/app docker_images/timm/app	main.py main.py	14:91 (100%) 14:90 (100%)	view
44	x 2	docker_images/fastai/app docker_images/mindspore/app	main.py main.py	14:76 (100%) 14:91 (100%)	view
44	x 2	docker_images/fastai/app docker_images/timm/app	main.py main.py	14:76 (100%) 14:90 (100%)	view
44	x 2	docker_images/span_marker/app docker_images/stanza/app	main.py main.py	14:91 (100%) 14:91 (100%)	view
44	x 2	docker_images/k2/app docker_images/nemo/app	main.py main.py	14:91 (100%) 17:94 (95%)	view
40	x 2	docker_images/sentence_transformers/app docker_images/spacy/app	main.py main.py	41:96 (81%) 44:99 (78%)	view
40	x 2	docker_images/espnet/app docker_images/nemo/app	main.py main.py	41:96 (81%) 39:94 (86%)	view
40	x 2	docker_images/espnet/app docker_images/k2/app	main.py main.py	41:96 (81%) 36:91 (90%)	view
39	x 2	docker_images/allennlp/app docker_images/fasttext/app	main.py main.py	37:91 (88%) 42:96 (79%)	view
39	x 2	docker_images/fasttext/app docker_images/open_clip/app	main.py main.py	42:96 (79%) 36:90 (88%)	view
39	x 2	docker_images/espnet/app docker_images/fairseq/app	main.py main.py	42:96 (79%) 38:92 (86%)	view
39	x 2	docker_images/bertopic/app docker_images/sentence_transformers/app	main.py main.py	22:76 (88%) 42:96 (79%)	view
39	x 2	docker_images/espnet/app docker_images/fasttext/app	main.py main.py	42:96 (79%) 42:96 (79%)	view
39	x 2	docker_images/allennlp/app docker_images/paddlenlp/app	main.py main.py	37:91 (88%) 46:100 (73%)	view
39	x 2	docker_images/espnet/app docker_images/open_clip/app	main.py main.py	42:96 (79%) 36:90 (88%)	view
39	x 2	docker_images/allennlp/app docker_images/pyannote_audio/app	main.py main.py	37:91 (88%) 37:91 (88%)	view
39	x 2	docker_images/paddlenlp/app docker_images/span_marker/app	main.py main.py	46:100 (73%) 37:91 (88%)	view
39	x 2	docker_images/sentence_transformers/app docker_images/stanza/app	main.py main.py	42:96 (79%) 37:91 (88%)	view
39	x 2	docker_images/fasttext/app docker_images/sentence_transformers/app	main.py main.py	42:96 (79%) 42:96 (79%)	view
39	x 2	docker_images/asteroid/app docker_images/fairseq/app	main.py main.py	38:92 (86%) 38:92 (86%)	view
39	x 2	docker_images/fairseq/app docker_images/span_marker/app	main.py main.py	38:92 (86%) 37:91 (88%)	view
39	x 2	docker_images/allennlp/app docker_images/spacy/app	main.py main.py	37:91 (88%) 45:99 (76%)	view
39	x 2	docker_images/mindspore/app docker_images/span_marker/app	main.py main.py	37:91 (88%) 37:91 (88%)	view
39	x 2	docker_images/pyannote_audio/app docker_images/spacy/app	main.py main.py	37:91 (88%) 45:99 (76%)	view
39	x 2	docker_images/bertopic/app docker_images/fastai/app	main.py main.py	22:76 (88%) 22:76 (88%)	view
39	x 2	docker_images/fastai/app docker_images/span_marker/app	main.py main.py	22:76 (88%) 37:91 (88%)	view
39	x 2	docker_images/fastai/app docker_images/stanza/app	main.py main.py	22:76 (88%) 37:91 (88%)	view
39	x 2	docker_images/asteroid/app docker_images/bertopic/app	main.py main.py	38:92 (86%) 22:76 (88%)	view
39	x 2	docker_images/pyannote_audio/app docker_images/stanza/app	main.py main.py	37:91 (88%) 37:91 (88%)	view
39	x 2	docker_images/allennlp/app docker_images/nemo/app	main.py main.py	37:91 (88%) 40:94 (84%)	view
39	x 2	docker_images/allennlp/app docker_images/common/app	main.py main.py	37:91 (88%) 37:91 (90%)	view
39	x 2	docker_images/asteroid/app docker_images/fasttext/app	main.py main.py	38:92 (86%) 42:96 (79%)	view
39	x 2	docker_images/allennlp/app docker_images/stanza/app	main.py main.py	37:91 (88%) 37:91 (88%)	view
39	x 2	docker_images/asteroid/app docker_images/open_clip/app	main.py main.py	38:92 (86%) 36:90 (88%)	view
39	x 2	docker_images/adapter_transformers/app docker_images/span_marker/app	main.py main.py	49:103 (70%) 37:91 (88%)	view
39	x 2	docker_images/asteroid/app docker_images/mindspore/app	main.py main.py	38:92 (86%) 37:91 (88%)	view
39	x 2	docker_images/adapter_transformers/app docker_images/espnet/app	main.py main.py	49:103 (70%) 42:96 (79%)	view
39	x 2	docker_images/asteroid/app docker_images/spacy/app	main.py main.py	38:92 (86%) 45:99 (76%)	view
39	x 2	docker_images/fairseq/app docker_images/fasttext/app	main.py main.py	38:92 (86%) 42:96 (79%)	view
39	x 2	docker_images/k2/app docker_images/sentence_transformers/app	main.py main.py	37:91 (88%) 42:96 (79%)	view
39	x 2	docker_images/bertopic/app docker_images/espnet/app	main.py main.py	22:76 (88%) 42:96 (79%)	view
39	x 2	docker_images/espnet/app docker_images/pyannote_audio/app	main.py main.py	42:96 (79%) 37:91 (88%)	view
39	x 2	docker_images/fastai/app docker_images/spacy/app	main.py main.py	22:76 (88%) 45:99 (76%)	view
39	x 2	docker_images/fasttext/app docker_images/timm/app	main.py main.py	42:96 (79%) 36:90 (88%)	view
39	x 2	docker_images/k2/app docker_images/spacy/app	main.py main.py	37:91 (88%) 45:99 (76%)	view

Duplicated Units

The list of top 4 duplicated units.

See data for all 4 unit duplicates...

Size	#	Folders	Files	Lines	Code
27	x 2	docker_images/latent-to-image/app docker_images/diffusers/app	offline.py offline.py	0:0 0:0	view
11	x 2	docker_images/latent-to-image/app docker_images/diffusers/app	healthchecks.py healthchecks.py	0:0 0:0	view
9	x 3	docker_images/peft/app docker_images/latent-to-image/app docker_images/diffusers/app	timing.py timing.py timing.py	0:0 0:0 0:0	view
6	x 3	docker_images/peft/app docker_images/latent-to-image/app docker_images/diffusers/app	idle.py idle.py idle.py	0:0 0:0 0:0	view