huggingface / dataspeech Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

30% duplication:

1,522 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
462 duplicated lines

26 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 26 longest duplicates.

See data for all 26 duplicates...

Size	#	Folders	Files	Lines	Code
26	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	168:195 (5%) 155:181 (6%)	view
22	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	248:280 (4%) 200:232 (5%)	view
17	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	553:570 (3%) 409:426 (4%)	view
16	x 2	scripts/per_dataset_script scripts/per_dataset_script	add_gender_to_MLS.py add_gender_to_libritts_r.py	7:27 (50%) 7:27 (57%)	view
15	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	107:127 (3%) 90:110 (4%)	view
14	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	480:497 (3%) 365:382 (3%)	view
12	x 2	dataspeech/gpu_enrichments dataspeech/gpu_enrichments	pitch.py pitch.py	29:40 (27%) 49:60 (27%)	view
11	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	284:295 (2%) 236:247 (2%)	view
11	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	153:163 (2%) 138:148 (2%)	view
9	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	455:463 (2%) 474:482 (2%)	view
9	x 2	scripts/per_dataset_script scripts/per_dataset_script	add_gender_to_MLS.py add_gender_to_libritts_r.py	37:48 (28%) 33:44 (32%)	view
9	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	141:149 (2%) 130:138 (2%)	view
9	x 2	scripts scripts	metadata_to_text.py metadata_to_text.py	225:235 (3%) 245:255 (3%)	view
7	x 2	scripts/per_dataset_script scripts/per_dataset_script	add_gender_to_MLS.py clean_libritts_r.py	18:27 (21%) 20:29 (17%)	view
7	x 2	scripts scripts/per_dataset_script	merge_audio_to_metadata.py add_gender_to_MLS.py	55:61 (17%) 42:48 (21%)	view
7	x 2	dataspeech/gpu_enrichments dataspeech/gpu_enrichments	snr_and_reverb.py snr_and_reverb.py	38:45 (14%) 60:67 (14%)	view
7	x 2	scripts/per_dataset_script scripts/per_dataset_script	add_gender_to_libritts_r.py clean_libritts_r.py	38:44 (25%) 58:64 (17%)	view
7	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	466:472 (1%) 484:490 (1%)	view
7	x 2	scripts scripts/per_dataset_script	merge_audio_to_metadata.py add_gender_to_libritts_r.py	55:61 (17%) 38:44 (25%)	view
7	x 2	scripts/per_dataset_script scripts/per_dataset_script	add_gender_to_MLS.py clean_libritts_r.py	42:48 (21%) 58:64 (17%)	view
7	x 2	scripts scripts/per_dataset_script	merge_audio_to_metadata.py clean_libritts_r.py	55:61 (17%) 58:64 (17%)	view
7	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	444:453 (1%) 464:473 (1%)	view
7	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	90:96 (1%) 72:78 (1%)	view
7	x 2	scripts scripts	run_prompt_creation.py run_prompt_creation_llm_swarm.py	133:139 (1%) 120:126 (1%)	view
7	x 2	scripts/per_dataset_script scripts/per_dataset_script	add_gender_to_libritts_r.py clean_libritts_r.py	18:27 (25%) 20:29 (17%)	view
6	x 2	ROOT scripts	main.py filter_audio_separation.py	8:15 (6%) 53:59 (9%)	view