guardian / pluto-storagetier

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

15% duplication:

7,148 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,117 duplicated lines

85 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
online_nearline (11%) --> project_restorer (29%)	272	4 file pairs	details...
online_archive (8%) --> online_nearline (9%)	227	6 file pairs	details...
media_remover (7%) --> online_nearline (7%)	172	3 file pairs	details...
media_remover (5%) --> project_restorer (13%)	124	3 file pairs	details...
media_remover (3%) --> online_archive (3%)	90	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 85 duplicates...

Size	#	Folders	Files	Lines	Code
77	x 2	online_nearline/src/main/scala/matrixstore project_restorer/src/main/scala/matrixstore	CustomMXSMetadata.scala CustomMXSMetadata.scala	5:94 (100%) 5:94 (100%)	view
37	x 2	common/src/main/scala/co...models/nearline_archive common/src/main/scala/co...r/models/online_archive	FailureRecordDAO.scala FailureRecordDAO.scala	10:66 (100%) 10:66 (100%)	view
20	x 2	mxs-copy-components/src/...xscopy/streamcomponents mxs-copy-components/src/...xscopy/streamcomponents	OMFastContentSearchSource.scala OMFastSearchSource.scala	34:60 (42%) 34:60 (41%)	view
16	x 2	media_remover/src/main/scala/matrixstore project_restorer/src/main/scala/matrixstore	MatrixStoreEnvironmentConfigProvider.... MatrixStoreEnvironmentConfigProvider....	3:20 (100%) 3:20 (100%)	view
16	x 2	online_nearline/src/main/scala/matrixstore project_restorer/src/main/scala/matrixstore	MatrixStoreEnvironmentConfigProvider.... MatrixStoreEnvironmentConfigProvider....	3:20 (100%) 3:20 (100%)	view
16	x 2	online_archive/src/main/scala online_nearline/src/main/scala	VidispineFunctions.scala VidispineMessageProcessor.scala	209:234 (6%) 243:268 (3%)	view
16	x 2	media_remover/src/main/scala/matrixstore online_nearline/src/main/scala/matrixstore	MatrixStoreEnvironmentConfigProvider.... MatrixStoreEnvironmentConfigProvider....	3:20 (100%) 3:20 (100%)	view
14	x 2	media_remover/src/main/scala online_nearline/src/main/scala	Main.scala Main.scala	122:141 (13%) 112:131 (13%)	view
13	x 2	online_archive/src/main/scala online_nearline/src/main/scala	Main.scala Main.scala	147:159 (11%) 133:145 (12%)	view
13	x 2	online_nearline/src/main/scala online_nearline/src/main/scala	AssetSweeperMessageProcessor.scala VidispineMessageProcessor.scala	64:78 (13%) 188:202 (2%)	view
13	x 2	online_archive/src/main/scala online_nearline/src/main/scala	Main.scala Main.scala	126:144 (11%) 113:131 (12%)	view
13	x 2	media_remover/src/main/resources project_restorer/src/main/resources	logback.xml logback.xml	1:25 (100%) 1:24 (100%)	view
13	x 2	mxs-copy-components/src/...xscopy/streamcomponents mxs-copy-components/src/...xscopy/streamcomponents	OMFastContentSearchSource.scala OMFastSearchSource.scala	13:30 (27%) 12:29 (27%)	view
13	x 2	media_remover/src/main/scala online_archive/src/main/scala	Main.scala Main.scala	123:141 (12%) 126:144 (11%)	view
12	x 2	media_remover/src/main/scala online_nearline/src/main/scala	Main.scala Main.scala	143:154 (11%) 134:145 (11%)	view
12	x 2	online_nearline/src/main/scala project_restorer/src/main/scala	Main.scala Main.scala	46:62 (11%) 40:56 (15%)	view
12	x 2	media_remover/src/main/scala online_archive/src/main/scala	Main.scala Main.scala	143:154 (11%) 148:159 (10%)	view
12	x 2	media_remover/src/main/scala online_nearline/src/main/scala	Main.scala Main.scala	46:62 (11%) 44:60 (11%)	view
11	x 2	online_archive/src/main/scala online_nearline/src/main/scala	VidispineMessageProcessor.scala VidispineMessageProcessor.scala	348:358 (4%) 745:755 (2%)	view
11	x 2	media_remover/src/main/scala project_restorer/src/main/scala	Main.scala Main.scala	48:62 (10%) 40:54 (14%)	view
11	x 2	ROOT ROOT	build.sbt build.sbt	141:151 (5%) 171:181 (5%)	view
9	x 2	online_archive/src/main/scala online_nearline/src/main/scala	AssetSweeperMessageProcessor.scala AssetSweeperMessageProcessor.scala	93:102 (5%) 68:78 (9%)	view
9	x 2	online_nearline/src/main/resources project_restorer/src/main/resources	logback.xml logback.xml	9:24 (69%) 9:24 (69%)	view
9	x 2	media_remover/src/main/resources online_nearline/src/main/resources	logback.xml logback.xml	9:25 (69%) 9:24 (69%)	view
9	x 2	online_archive/src/main/scala online_nearline/src/main/scala	VidispineFunctions.scala VidispineMessageProcessor.scala	237:245 (3%) 270:278 (1%)	view
9	x 2	media_remover/src/main/scala media_remover/src/main/scala	MediaNotRequiredMessageProcessor.scala MediaNotRequiredMessageProcessor.scala	201:212 (2%) 253:263 (2%)	view
9	x 2	ROOT ROOT	build.sbt build.sbt	154:162 (4%) 184:192 (4%)	view
9	x 2	ROOT ROOT	build.sbt build.sbt	124:132 (4%) 184:192 (4%)	view
9	x 2	media_remover/src/main/scala media_remover/src/main/scala/helpers	MediaNotRequiredMessageProcessor.scala NearlineHelper.scala	30:38 (2%) 28:36 (5%)	view
9	x 2	ROOT ROOT	build.sbt build.sbt	124:132 (4%) 154:162 (4%)	view
9	x 2	online_archive/src/main/scala online_nearline/src/main/scala	AssetSweeperMessageProcessor.scala VidispineMessageProcessor.scala	93:102 (5%) 192:202 (1%)	view
9	x 2	ROOT ROOT	build.sbt build.sbt	171:179 (4%) 201:209 (4%)	view
9	x 2	ROOT ROOT	build.sbt build.sbt	141:149 (4%) 201:209 (4%)	view
9	x 2	online_archive/src/main/scala online_nearline/src/main/scala	VidispineFunctions.scala VidispineMessageProcessor.scala	262:270 (3%) 398:406 (1%)	view
8	x 2	online_archive/src/main/scala project_restorer/src/main/scala	Main.scala Main.scala	130:140 (7%) 91:101 (10%)	view
8	x 2	media_remover/src/main/scala media_remover/src/main/scala	MediaNotRequiredMessageProcessor.scala OnlineNearlineMessageProcessor.scala	41:50 (2%) 29:38 (5%)	view
8	x 2	mxs-copy-components/src/...m/gu/multimedia/mxscopy online_nearline/src/main/scala	ChecksumChecker.scala FileCopier.scala	19:32 (19%) 107:120 (8%)	view
8	x 2	media_remover/src/main/scala media_remover/src/main/scala	MediaNotRequiredMessageProcessor.scala OnlineArchiveMessageProcessor.scala	41:50 (2%) 29:38 (5%)	view
8	x 2	media_remover/src/main/scala project_restorer/src/main/scala	Main.scala Main.scala	127:137 (7%) 91:101 (10%)	view
8	x 2	mxs-copy-components/src/...xscopy/streamcomponents mxs-copy-components/src/...xscopy/streamcomponents	OMFastSearchSource.scala OMSearchSource.scala	36:43 (16%) 32:39 (17%)	view
8	x 2	media_remover/src/main/scala online_nearline/src/main/scala	Main.scala Main.scala	68:75 (7%) 65:72 (7%)	view
8	x 2	online_archive/src/main/scala online_nearline/src/main/scala	VidispineFunctions.scala VidispineMessageProcessor.scala	34:44 (3%) 297:307 (1%)	view
8	x 2	ROOT ROOT	build.sbt build.sbt	109:116 (4%) 203:210 (4%)	view
8	x 2	online_nearline/src/main/scala project_restorer/src/main/scala	Main.scala Main.scala	117:127 (7%) 91:101 (10%)	view
8	x 2	media_remover/src/main/scala media_remover/src/main/scala	OnlineArchiveMessageProcessor.scala OnlineNearlineMessageProcessor.scala	29:38 (5%) 29:38 (5%)	view
8	x 2	media_remover/src/main/scala online_nearline/src/main/scala	Main.scala Main.scala	29:43 (7%) 30:40 (7%)	view
8	x 2	mxs-copy-components/src/...xscopy/streamcomponents mxs-copy-components/src/...xscopy/streamcomponents	OMFastContentSearchSource.scala OMSearchSource.scala	36:43 (17%) 32:39 (17%)	view
8	x 2	online_nearline/src/main/scala online_nearline/src/main/scala	MediaRemoverMessageProcessor.scala VidispineMessageProcessor.scala	20:27 (40%) 36:43 (1%)	view
7	x 2	media_remover/src/main/scala project_restorer/src/main/scala	Main.scala Main.scala	20:27 (6%) 17:24 (9%)	view
7	x 2	ROOT ROOT	build.sbt build.sbt	91:97 (3%) 126:132 (3%)	view

Duplicated Units

The list of top 4 duplicated units.

See data for all 4 unit duplicates...

Size	#	Folders	Files	Lines	Code
26	x 2	online_nearline/src/main/scala/matrixstore project_restorer/src/main/scala/matrixstore	CustomMXSMetadata.scala CustomMXSMetadata.scala	29:60 29:60	view
16	x 2	common/src/main/scala/co...r/models/online_archive common/src/main/scala/co...models/nearline_archive	FailureRecordDAO.scala FailureRecordDAO.scala	20:37 20:37	view
13	x 3	online_nearline/src/main/scala/matrixstore project_restorer/src/main/scala/matrixstore media_remover/src/main/scala/matrixstore	MatrixStoreEnvironmentConfigProvider.... MatrixStoreEnvironmentConfigProvider.... MatrixStoreEnvironmentConfigProvider....	8:22 8:22 8:22	view
8	x 2	common/src/main/scala/co...r/models/online_archive common/src/main/scala/co...models/nearline_archive	FailureRecordDAO.scala FailureRecordDAO.scala	39:48 39:48	view