huggingface / transformers.js Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

4% duplication:

16,263 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
736 duplicated lines

104 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 104 duplicates...

Size	#	Folders	Files	Lines	Code
16	x 2	src/models/audio_spectrogram_transformer src/models/seamless_m4t	feature_extraction_audio_spectrogram_... feature_extraction_seamless_m4t.js	40:59 (30%) 41:60 (13%)	view
15	x 2	scripts/extra scripts/extra	speecht5.py vits.py	7:21 (13%) 65:79 (18%)	view
14	x 2	src/models/audio_spectrogram_transformer src/models/seamless_m4t	feature_extraction_audio_spectrogram_... feature_extraction_seamless_m4t.js	8:22 (26%) 7:21 (12%)	view
14	x 2	src/models/seamless_m4t src/models/wespeaker	feature_extraction_seamless_m4t.js feature_extraction_wespeaker.js	7:21 (12%) 8:22 (20%)	view
14	x 2	src/models/audio_spectrogram_transformer src/models/wespeaker	feature_extraction_audio_spectrogram_... feature_extraction_wespeaker.js	8:22 (26%) 8:22 (20%)	view
13	x 2	src src	models.js models.js	1116:1128 (<1%) 7561:7573 (<1%)	view
13	x 2	src/utils src/utils	maths.js maths.js	470:485 (1%) 644:659 (1%)	view
12	x 2	src/utils src/utils	maths.js maths.js	456:468 (1%) 626:638 (1%)	view
11	x 2	src/utils src/utils	maths.js maths.js	421:433 (1%) 591:603 (1%)	view
11	x 2	src src	models.js models.js	1131:1141 (<1%) 7576:7586 (<1%)	view
11	x 2	scripts/extra scripts/extra	speecht5.py speecht5.py	53:63 (10%) 67:77 (10%)	view
11	x 2	src/models/audio_spectrogram_transformer src/models/gemma3n	feature_extraction_audio_spectrogram_... feature_extraction_gemma3n.js	32:42 (21%) 29:39 (17%)	view
10	x 2	scripts/extra scripts/extra	speecht5.py speecht5.py	56:65 (9%) 82:91 (9%)	view
10	x 2	scripts scripts	utils.py utils.py	32:45 (21%) 50:63 (21%)	view
9	x 2	scripts/extra scripts/extra	vits.py wav2vec2.py	85:93 (10%) 38:46 (18%)	view
9	x 2	src/utils src/utils	maths.js maths.js	490:499 (1%) 664:673 (1%)	view
8	x 2	src src	models.js models.js	3648:3657 (<1%) 3785:3794 (<1%)	view
8	x 2	src src	models.js models.js	2946:2953 (<1%) 6938:6945 (<1%)	view
8	x 2	src src	models.js models.js	3785:3794 (<1%) 3799:3808 (<1%)	view
8	x 2	src/models/seamless_m4t src/models/wespeaker	feature_extraction_seamless_m4t.js feature_extraction_wespeaker.js	47:54 (6%) 46:53 (11%)	view
8	x 2	src/models/audio_spectrogram_transformer src/models/wespeaker	feature_extraction_audio_spectrogram_... feature_extraction_wespeaker.js	46:53 (15%) 46:53 (11%)	view
8	x 2	src/models/audio_spectrogram_transformer src/models/seamless_m4t	feature_extraction_audio_spectrogram_... feature_extraction_seamless_m4t.js	32:39 (15%) 28:35 (6%)	view
8	x 2	src/models/gemma3n src/models/seamless_m4t	feature_extraction_gemma3n.js feature_extraction_seamless_m4t.js	29:36 (12%) 28:35 (6%)	view
8	x 2	scripts/extra scripts/extra	speecht5.py speecht5.py	70:77 (7%) 82:89 (7%)	view
8	x 2	src src	pipelines.js pipelines.js	1772:1782 (<1%) 1915:1923 (<1%)	view
8	x 2	src src	models.js models.js	3648:3657 (<1%) 3799:3808 (<1%)	view
8	x 2	src src	tokenizers.js tokenizers.js	2715:2722 (<1%) 4401:4408 (<1%)	view
7	x 2	src src	models.js models.js	736:746 (<1%) 3985:3995 (<1%)	view
7	x 2	src src	tokenizers.js tokenizers.js	2725:2731 (<1%) 4411:4417 (<1%)	view
7	x 2	src src	pipelines.js pipelines.js	2039:2045 (<1%) 2583:2589 (<1%)	view
7	x 2	src src	models.js models.js	3635:3641 (<1%) 3774:3781 (<1%)	view
7	x 2	src src	pipelines.js pipelines.js	2378:2384 (<1%) 2477:2483 (<1%)	view
7	x 2	src src	pipelines.js pipelines.js	2378:2384 (<1%) 2613:2619 (<1%)	view
7	x 2	src src	pipelines.js pipelines.js	2477:2483 (<1%) 2613:2619 (<1%)	view
7	x 2	src src	pipelines.js pipelines.js	2053:2059 (<1%) 2613:2619 (<1%)	view
7	x 2	src src	pipelines.js pipelines.js	2053:2059 (<1%) 2477:2483 (<1%)	view
7	x 2	src src	models.js models.js	792:798 (<1%) 3887:3893 (<1%)	view
7	x 2	src src	pipelines.js pipelines.js	2053:2059 (<1%) 2378:2384 (<1%)	view
7	x 2	src src	models.js models.js	1207:1214 (<1%) 1220:1227 (<1%)	view
7	x 2	src src	models.js models.js	3896:3903 (<1%) 3943:3951 (<1%)	view
7	x 2	src/utils src/utils	audio.js audio.js	376:382 (1%) 399:405 (1%)	view
6	x 2	scripts/extra scripts/extra	vits.py wav2vec2.py	65:70 (7%) 14:19 (12%)	view
6	x 2	src src	pipelines.js pipelines.js	2051:2056 (<1%) 2566:2571 (<1%)	view
6	x 2	src src	pipelines.js pipelines.js	2051:2056 (<1%) 2572:2577 (<1%)	view
6	x 2	scripts/extra scripts/extra	clip.py siglip.py	17:24 (31%) 18:25 (28%)	view
6	x 2	src src	pipelines.js pipelines.js	2051:2056 (<1%) 2578:2583 (<1%)	view
6	x 2	src src	pipelines.js pipelines.js	2578:2583 (<1%) 2608:2613 (<1%)	view
6	x 2	src src	pipelines.js pipelines.js	285:294 (<1%) 1307:1316 (<1%)	view
6	x 2	src src	pipelines.js pipelines.js	2471:2476 (<1%) 2596:2601 (<1%)	view
6	x 2	src src	pipelines.js pipelines.js	2139:2144 (<1%) 2614:2619 (<1%)	view