G

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

29% duplication:

18,033 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
5,275 duplicated lines

954 duplicates

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
recipes/joint_training_vox_populi (6%) --> recipes/slimIPL (10%)	418	3 file pairs	details...
recipes/conv_glu (48%) --> recipes/lexicon_free (8%)	267	7 file pairs	details...
recipes/sota (2%) --> recipes/streaming_convnets (4%)	190	14 file pairs	details...
recipes/local_prior_match (6%) --> recipes/seq2seq_tds (42%)	175	4 file pairs	details...
recipes/seq2seq_tds (35%) --> recipes/utilities (13%)	146	1 file pair	details...
recipes/local_prior_match (3%) --> recipes/utilities (9%)	102	2 file pairs	details...
data/librispeech (21%) --> recipes/self_training (3%)	62	1 file pair	details...
recipes/lexicon_free (1%) --> recipes/seq2seq_tds (12%)	54	1 file pair	details...
recipes/conv_glu (9%) --> recipes/seq2seq_tds (12%)	54	1 file pair	details...
data/wsj (7%) --> recipes/data (6%)	53	2 file pairs	details...
recipes/local_prior_match (1%) --> recipes/self_training (2%)	51	2 file pairs	details...
recipes/lexicon_free (1%) --> recipes/utilities (4%)	50	1 file pair	details...
recipes/conv_glu (8%) --> recipes/utilities (4%)	50	1 file pair	details...

Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 954 duplicates...

Size	#	Folders	Files	Lines	Code
46	x 2	recipes/conv_glu/wsj recipes/lexicon_free/wsj	prepare.py prepare.py	43:91 (38%) 105:152 (25%)	view
37	x 2	recipes/local_prior_match/librispeech recipes/local_prior_match/librispeech	cfg train_init.cfg train_proposal.cfg	2:38 (94%) 2:38 (94%)	view
34	x 2	recipes/mls/train recipes/mls/train	cfg french.cfg german.cfg	1:34 (100%) 1:34 (100%)	view
34	x 2	recipes/mls/train recipes/mls/train	cfg polish.cfg portuguese.cfg	1:34 (100%) 1:34 (100%)	view
34	x 2	recipes/mls/train recipes/mls/train	cfg dutch.cfg spanish.cfg	1:34 (100%) 1:34 (100%)	view
34	x 2	recipes/mls/train recipes/mls/train	cfg french.cfg spanish.cfg	1:34 (100%) 1:34 (100%)	view
34	x 2	recipes/mls/train recipes/mls/train	cfg dutch.cfg french.cfg	1:34 (100%) 1:34 (100%)	view
34	x 2	recipes/mls/train recipes/mls/train	cfg dutch.cfg german.cfg	1:34 (100%) 1:34 (100%)	view
34	x 2	recipes/mls/train recipes/mls/train	cfg italian.cfg polish.cfg	1:34 (100%) 1:34 (100%)	view
34	x 2	recipes/mls/train recipes/mls/train	cfg italian.cfg portuguese.cfg	1:34 (100%) 1:34 (100%)	view
34	x 2	recipes/mls/train recipes/mls/train	cfg german.cfg spanish.cfg	1:34 (100%) 1:34 (100%)	view
31	x 2	recipes/slimIPL recipes/slimIPL	cfg 100h_supervised.cfg 100h_supervised_slimipl.cfg	6:36 (83%) 5:35 (70%)	view
30	x 2	recipes/conv_glu/librispeech recipes/lexicon_free/librispeech	prepare.py prepare.py	25:57 (46%) 29:61 (13%)	view
29	x 2	recipes/sota/2019/librivox recipes/sota/2019/librivox	cfg train_am_resnet_s2s.cfg train_am_tds_s2s.cfg	15:43 (58%) 15:43 (58%)	view
29	x 2	recipes/slimIPL recipes/slimIPL	cfg 100h_supervised_slimipl.cfg 10h_supervised.cfg	4:32 (65%) 4:32 (80%)	view
28	x 2	recipes/slimIPL recipes/slimIPL	cfg 10h_supervised.cfg 10h_supervised_slimipl.cfg	2:29 (77%) 2:29 (63%)	view
28	x 2	recipes/slimIPL recipes/slimIPL	cfg 100h_supervised.cfg 10h_supervised.cfg	6:33 (75%) 5:32 (77%)	view
27	x 2	recipes/slimIPL recipes/slimIPL	100h_supervised_slimipl.cpp 10h_supervised_slimipl.cpp	54:92 (43%) 61:99 (39%)	view
26	x 2	recipes/slimIPL recipes/slimIPL	cfg 100h_supervised_slimipl.cfg 10h_supervised_slimipl.cfg	4:29 (59%) 4:29 (59%)	view
25	x 2	recipes/slimIPL recipes/slimIPL	cfg 100h_supervised.cfg 10h_supervised_slimipl.cfg	6:30 (67%) 5:29 (56%)	view
24	x 2	recipes/slimIPL recipes/slimIPL	100h_supervised.cpp 100h_supervised_slimipl.cpp	13:40 (40%) 13:40 (38%)	view
24	x 2	recipes/slimIPL recipes/slimIPL	10h_supervised.cpp 10h_supervised_slimipl.cpp	13:40 (44%) 13:40 (35%)	view
24	x 2	recipes/slimIPL recipes/slimIPL	100h_supervised.cpp 10h_supervised.cpp	55:89 (40%) 48:82 (44%)	view
23	x 2	recipes/slimIPL recipes/slimIPL	100h_supervised_slimipl.cpp 10h_supervised.cpp	59:92 (37%) 49:82 (42%)	view
23	x 2	recipes/slimIPL recipes/slimIPL	100h_supervised.cpp 100h_supervised_slimipl.cpp	56:89 (38%) 59:92 (37%)	view
23	x 2	recipes/slimIPL recipes/slimIPL	100h_supervised.cpp 10h_supervised_slimipl.cpp	56:89 (38%) 66:99 (33%)	view
23	x 2	recipes/slimIPL recipes/slimIPL	10h_supervised.cpp 10h_supervised_slimipl.cpp	49:82 (42%) 66:99 (33%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg french.cfg portuguese.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg portuguese.cfg spanish.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg german.cfg polish.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg italian.cfg spanish.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg dutch.cfg portuguese.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg german.cfg italian.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg dutch.cfg polish.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg french.cfg polish.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/self_training/librispeech/lm recipes/sota/2019/lm	prepare_wp_data.py prepare_wp_data.py	25:48 (100%) 25:48 (100%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg dutch.cfg italian.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg polish.cfg spanish.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg german.cfg portuguese.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/mls/train recipes/mls/train	cfg french.cfg italian.cfg	13:34 (64%) 13:34 (64%)	view
22	x 2	recipes/self_training/librispeech/am recipes/self_training/librispeech/am	cfg decode_train-clean-100+train-clean-36... decode_train-clean-100+train-other-50...	1:22 (100%) 1:22 (100%)	view
21	x 2	recipes/joint_training_vox_populi/cpc recipes/slimIPL/src	Train.cpp Train.cpp	728:750 (1%) 300:322 (1%)	view
21	x 2	recipes/lexicon_free/utilities recipes/lexicon_free/utilities	compute_lower_ppl_convlm.py compute_lower_ppl_kenlm.py	187:211 (10%) 126:150 (16%)	view
20	x 2	recipes/sota/2019/librispeech recipes/sota/2019/librispeech	cfg decode_tds_ctc_gcnn_other.cfg decode_transformer_ctc_gcnn_other.cfg	4:23 (86%) 4:23 (86%)	view
20	x 2	recipes/sota/2019/librivox recipes/sota/2019/librivox	cfg decode_resnet_ctc_gcnn_other.cfg decode_transformer_ctc_gcnn_other.cfg	4:23 (86%) 4:23 (86%)	view
20	x 2	recipes/sota/2019/librispeech recipes/sota/2019/librivox	cfg decode_resnet_ctc_gcnn_other.cfg decode_transformer_ctc_gcnn_other.cfg	4:23 (86%) 4:23 (86%)	view
20	x 2	recipes/sota/2019/librispeech recipes/sota/2019/librispeech	cfg decode_tds_ctc_gcnn_clean.cfg decode_transformer_ctc_gcnn_clean.cfg	4:23 (86%) 4:23 (86%)	view
20	x 2	recipes/sota/2019/librispeech recipes/sota/2019/librivox	cfg decode_transformer_ctc_gcnn_clean.cfg decode_resnet_ctc_gcnn_clean.cfg	4:23 (86%) 4:23 (86%)	view
20	x 2	recipes/sota/2019/librispeech recipes/sota/2019/librispeech	cfg decode_resnet_ctc_gcnn_other.cfg decode_tds_ctc_gcnn_other.cfg	4:23 (86%) 4:23 (86%)	view
20	x 2	recipes/local_prior_match/librispeech recipes/seq2seq_tds/librispeech	prepare.py prepare.py	101:124 (20%) 83:106 (24%)	view

Duplicated Units

The list of top 2 duplicated units.

See data for all 2 unit duplicates...

Size	#	Folders	Files	Lines	Code
8	x 2	recipes/self_training/librispeech/lm data/librispeech	utils.py utils.py	0:0 0:0	view
8	x 4	recipes/slimIPL recipes/slimIPL recipes/slimIPL recipes/slimIPL	10h_supervised.cpp 10h_supervised_slimipl.cpp 100h_supervised.cpp 100h_supervised_slimipl.cpp	55:64 72:81 62:71 65:74	view