facebookresearch / voxpopuli

Places in code with 6 or more lines that are exactly the same.

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Duplication Overall

4% duplication:

1,947 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
91 duplicated lines

8 duplicates

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 8 longest duplicates.

See data for all 8 duplicates...

Size	#	Folders	Files	Lines	Code
8	x 2	voxpopuli voxpopuli/text	get_lm_data.py __init__.py	32:39 (3%) 11:18 (19%)	view
8	x 2	voxpopuli voxpopuli	get_asr_data.py get_lm_data.py	83:90 (11%) 254:261 (3%)	view
7	x 2	voxpopuli voxpopuli	get_lm_data.py get_s2s_data.py	254:260 (3%) 99:105 (7%)	view
7	x 2	voxpopuli voxpopuli	get_asr_data.py get_unlabelled_data.py	94:104 (10%) 95:105 (9%)	view
7	x 2	voxpopuli voxpopuli	get_asr_data.py get_s2s_data.py	83:89 (10%) 99:105 (7%)	view
7	x 2	voxpopuli/segmentation voxpopuli/segmentation	get_segment_pyannote_speaker.py get_segment_pyannote_speaker.py	42:48 (2%) 78:84 (2%)	view
6	x 2	voxpopuli/segmentation voxpopuli/text	__init__.py __init__.py	131:139 (5%) 49:57 (14%)	view
6	x 2	voxpopuli/segmentation voxpopuli/segmentation	cut_with_align_files.py cut_with_align_files.py	176:181 (1%) 212:217 (1%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
6	x 2	voxpopuli/segmentation voxpopuli/text	__init__.py __init__.py	0:0 0:0	view