mozilla / REALISE-Performance

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

45% duplication:

17,454 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
7,984 duplicated lines

529 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
prediction_generation (6%) --> prediction_postprocessing_scripts (43%)	742	4 file pairs	details...
data_extraction_transformation (1%) --> prediction_generation (<1%)	93	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 529 duplicates...

Size	#	Folders	Files	Lines	Code
366	x 2	data_annotation_platform...esources/datatables/css data_annotation_platform...esources/datatables/css	dataTables.jqueryui.css jquery.dataTables.css	32:421 (82%) 59:448 (88%)	view
238	x 2	prediction_generation prediction_generation/or...roject/analysis/scripts	make_table.py make_table.py	35:359 (100%) 35:359 (100%)	view
233	x 2	prediction_generation prediction_postprocessing_scripts	summarize_metrics.py handpick_best.py	6:282 (100%) 7:283 (100%)	view
196	x 2	prediction_generation prediction_generation/old-code	cpdbench_mozilla_rep.py cpdbench_mozilla_rep_debug.py	26:369 (100%) 26:369 (100%)	view
150	x 2	prediction_generation/or...alysis/output/rankplots prediction_generation/or...alysis/output/rankplots	tex rankplot_default_cover_uni.tex rankplot_default_f1_uni.tex	1:160 (53%) 1:160 (53%)	view
144	x 2	prediction_generation/old-code prediction_generation/old-code	cpdbench_mozilla_rep_debug.py cpdbench_mozilla_rep_with_restart_on_...	26:272 (73%) 26:268 (68%)	view
144	x 2	prediction_generation prediction_generation/old-code	cpdbench_mozilla_rep.py cpdbench_mozilla_rep_with_restart_on_...	26:272 (73%) 26:268 (68%)	view
141	x 2	prediction_generation/or...alysis/output/rankplots prediction_generation/or...alysis/output/rankplots	tex rankplot_best_cover_uni.tex rankplot_best_f1_uni.tex	1:151 (53%) 1:151 (53%)	view
132	x 2	prediction_generation prediction_generation/old-code	cpdbench_mozilla_rep.py cpdbench_mozilla_rep copy.py	26:256 (67%) 26:256 (66%)	view
132	x 2	prediction_generation/old-code prediction_generation/old-code	cpdbench_mozilla_rep copy.py cpdbench_mozilla_rep_debug.py	26:256 (66%) 26:256 (67%)	view
132	x 2	prediction_generation/old-code prediction_generation/old-code	cpdbench_mozilla_rep copy.py cpdbench_mozilla_rep_with_restart_on_...	26:256 (66%) 26:252 (63%)	view
99	x 2	data_extraction_transformation/scripts data_extraction_transformation/scripts	extract-alerts.py update-still-processing-alerts.py	9:115 (48%) 8:113 (48%)	view
87	x 2	prediction_postprocessing_scripts prediction_postprocessing_scripts	merge_cpds.py merge_multiple_cpds_with_mozilla.py	33:131 (62%) 35:133 (60%)	view
86	x 2	prediction_generation/or...roject/analysis/scripts prediction_generation	summarize.py summarize.py	63:164 (90%) 69:170 (89%)	view
75	x 2	data_annotation_platform...esources/datatables/css data_annotation_platform...esources/datatables/css	dataTables.jqueryui.css jquery.dataTables_themeroller.css	160:235 (16%) 218:293 (18%)	view
75	x 2	data_annotation_platform...esources/datatables/css data_annotation_platform...esources/datatables/css	jquery.dataTables.css jquery.dataTables_themeroller.css	187:262 (18%) 218:293 (18%)	view
72	x 2	data_extraction_transformation/scripts data_extraction_transformation/scripts	extract-alerts.py update-still-processing-alerts.py	125:197 (35%) 127:198 (35%)	view
71	x 2	data_extraction_transfor...ts/one_time_use_scripts data_extraction_transfor...ts/one_time_use_scripts	rename_columns_alerts.py rename_columns_timeseries.py	19:89 (82%) 19:89 (73%)	view
69	x 2	data_extraction_transfor...ts/one_time_use_scripts data_extraction_transfor...ts/one_time_use_scripts	new_columns_names_mapping.py rename_columns_alerts.py	52:122 (61%) 19:87 (80%)	view
69	x 2	data_extraction_transfor...ts/one_time_use_scripts data_extraction_transfor...ts/one_time_use_scripts	new_columns_names_mapping.py rename_columns_timeseries.py	52:122 (61%) 19:87 (71%)	view
63	x 2	prediction_generation prediction_generation/or...roject/analysis/scripts	metrics.py metrics.py	13:174 (100%) 13:174 (100%)	view
62	x 2	prediction_generation/old-code prediction_generation	summarize_temp.py summarize.py	112:184 (65%) 111:183 (64%)	view
58	x 2	prediction_generation/old-code prediction_generation/old-code	cpdbench_mozilla_rep copy.py cpdbench_mozilla_rep_debug.py	258:343 (29%) 258:343 (29%)	view
58	x 2	prediction_generation prediction_generation/old-code	cpdbench_mozilla_rep.py cpdbench_mozilla_rep copy.py	258:343 (29%) 258:343 (29%)	view
53	x 2	data_extraction_transfor...ts/one_time_use_scripts data_extraction_transfor...ts/one_time_use_scripts	make_diagrams_per_compound.py make_diagrams_per_dtw_analysis.py	26:97 (48%) 17:88 (58%)	view
52	x 2	prediction_generation/old-code prediction_generation/or...roject/analysis/scripts	summarize_temp.py summarize.py	112:171 (54%) 105:164 (54%)	view
49	x 2	data_annotation_platform...resources/datatables/js data_annotation_platform...resources/datatables/js	dataTables.bootstrap4.js dataTables.semanticui.js	68:127 (41%) 77:136 (36%)	view
45	x 2	prediction_generation prediction_generation/original-project	abed_conf.py abed_conf.py	106:155 (22%) 99:147 (25%)	view
41	x 2	prediction_generation/old-code prediction_generation/old-code	summarize_metrics_new_debug.py summarize_metrics_old.py	232:277 (17%) 139:184 (21%)	view
39	x 2	prediction_generation/old-code prediction_generation/old-code	cpdbench_mozilla_rep_debug.py cpdbench_mozilla_rep_with_restart_on_...	281:343 (19%) 283:334 (18%)	view
39	x 2	prediction_generation/old-code prediction_generation/old-code	cpdbench_mozilla_rep copy.py cpdbench_mozilla_rep_with_restart_on_...	281:343 (19%) 283:334 (18%)	view
39	x 2	prediction_generation prediction_generation/old-code	cpdbench_mozilla_rep.py cpdbench_mozilla_rep_with_restart_on_...	281:343 (19%) 283:334 (18%)	view
39	x 2	data_annotation_platform...esources/datatables/css data_annotation_platform...esources/datatables/css	dataTables.bootstrap4.css dataTables.uikit.css	58:97 (19%) 55:94 (24%)	view
35	x 2	data_annotation_platform...esources/datatables/css data_annotation_platform...esources/datatables/css	dataTables.bootstrap4.css dataTables.uikit.css	99:135 (17%) 96:132 (22%)	view
34	x 2	prediction_generation/old-code prediction_generation	summarize_metrics_new_debug.py summarize_metrics.py	7:44 (14%) 6:43 (14%)	view
34	x 2	prediction_generation/old-code prediction_postprocessing_scripts	summarize_metrics_new_debug.py handpick_best.py	7:44 (14%) 7:44 (14%)	view
33	x 2	prediction_generation/old-code prediction_generation	summarize_metrics_new_debug.py summarize_metrics.py	61:97 (14%) 77:113 (14%)	view
33	x 2	prediction_generation/old-code prediction_postprocessing_scripts	summarize_metrics_new_debug.py handpick_best.py	61:97 (14%) 78:114 (14%)	view
32	x 2	prediction_generation/old-code prediction_generation/or...roject/analysis/scripts	summarize_temp.py summarize.py	69:106 (33%) 63:100 (33%)	view
32	x 2	prediction_generation prediction_generation/original-project	abed_conf.py abed_conf.py	6:70 (16%) 6:70 (17%)	view
32	x 2	prediction_generation/old-code prediction_generation	summarize_temp.py summarize.py	69:106 (33%) 69:106 (33%)	view
30	x 2	data_annotation_platform...esources/datatables/css data_annotation_platform...esources/datatables/css	dataTables.jqueryui.css jquery.dataTables_themeroller.css	342:371 (6%) 350:385 (7%)	view
30	x 2	data_annotation_platform...esources/datatables/css data_annotation_platform...esources/datatables/css	jquery.dataTables.css jquery.dataTables_themeroller.css	369:398 (7%) 350:385 (7%)	view
29	x 2	data_annotation_platform...esources/datatables/css data_annotation_platform...esources/datatables/css	dataTables.bootstrap4.css dataTables.material.css	68:97 (14%) 29:58 (33%)	view
29	x 2	prediction_generation/old-code prediction_postprocessing_scripts	summarize_metrics_new_debug.py handpick_best.py	240:268 (12%) 183:211 (12%)	view
29	x 2	data_extraction_transformation/scripts data_extraction_transfor...ts/one_time_use_scripts	jsonfy_specific_timeseries.py jsonfy-one-timeseries.py	24:52 (56%) 18:46 (67%)	view
29	x 2	data_annotation_platform...esources/datatables/css data_annotation_platform...esources/datatables/css	dataTables.material.css dataTables.uikit.css	29:58 (33%) 65:94 (18%)	view
29	x 2	prediction_generation prediction_generation/or...roject/analysis/scripts	aggregate_table_wide.py aggregate_table_wide.py	20:50 (20%) 19:49 (22%)	view
29	x 2	prediction_generation/old-code prediction_postprocessing_scripts	summarize_metrics_old.py handpick_best.py	147:175 (15%) 183:211 (12%)	view
29	x 2	prediction_generation/old-code prediction_generation	summarize_metrics_old.py summarize_metrics.py	147:175 (15%) 182:210 (12%)	view

Duplicated Units

The list of top 7 duplicated units.

See data for all 7 unit duplicates...

Size	#	Folders	Files	Lines	Code
114	x 2	prediction_generation prediction_generation/old-code	cpdbench_mozilla_rep.py cpdbench_mozilla_rep_debug.py	0:0 0:0	view
58	x 2	prediction_generation/old-code prediction_generation	summarize_temp.py summarize.py	0:0 0:0	view
56	x 2	prediction_postprocessing_scripts prediction_generation	handpick_best.py summarize_metrics.py	0:0 0:0	view
42	x 2	prediction_generation/or...roject/analysis/scripts prediction_generation	make_table.py make_table.py	0:0 0:0	view
30	x 2	prediction_generation/or...roject/analysis/scripts prediction_generation	metrics.py metrics.py	0:0 0:0	view
13	x 2	prediction_generation/old-code prediction_generation/old-code	cpdbench_ecp.py cpdbench_ecp copy.py	0:0 0:0	view
7	x 7	data_annotation_platform...resources/datatables/js data_annotation_platform...resources/datatables/js data_annotation_platform...resources/datatables/js data_annotation_platform...resources/datatables/js data_annotation_platform...resources/datatables/js data_annotation_platform...resources/datatables/js data_annotation_platform...resources/datatables/js	dataTables.jqueryui.js dataTables.foundation.js dataTables.bootstrap4.js dataTables.uikit.js dataTables.dataTables.js dataTables.semanticui.js dataTables.material.js	22:32 22:32 22:35 16:29 14:27 22:35 22:35	view