apache / incubator-samoaDuplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

15% duplication:

22,113 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
3,330 duplicated lines

268 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
samoa-api (<1%) --> samoa-instances (2%)	101	3 file pairs	details...

Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 268 duplicates...

Size	#	Folders	Files	Lines	Code
61	x 2	samoa-api/src/main/java/...fiers/rules/centralized samoa-api/src/main/java/...fiers/rules/distributed	AMRulesRegressorProcessor.java AMRulesAggregatorProcessor.java	406:498 (24%) 424:516 (21%)	view
56	x 2	samoa-api/src/main/java/...rners/classifiers/rules samoa-api/src/main/java/...rners/classifiers/rules	AMRulesRegressor.java HorizontalAMRulesRegressor.java	58:127 (60%) 58:127 (42%)	view
42	x 2	samoa-api/src/main/java/...rners/classifiers/rules samoa-api/src/main/java/...rners/classifiers/rules	HorizontalAMRulesRegressor.java VerticalAMRulesRegressor.java	81:132 (31%) 80:131 (38%)	view
38	x 2	samoa-api/src/main/java/...rners/classifiers/rules samoa-api/src/main/java/...rners/classifiers/rules	AMRulesRegressor.java VerticalAMRulesRegressor.java	81:127 (40%) 80:126 (34%)	view
29	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRLearnerProcessor.java AMRulesStatisticsProcessor.java	78:127 (24%) 70:118 (31%)	view
29	x 2	samoa-api/src/main/java/...oa/clusterers/clustream samoa-api/src/main/java/...oa/clusterers/clustream	Clustream.java WithKmeans.java	135:183 (17%) 127:175 (12%)	view
28	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRDefaultRuleProcessor.java AMRulesAggregatorProcessor.java	153:193 (16%) 261:301 (10%)	view
27	x 2	samoa-api/src/main/java/...fiers/rules/centralized samoa-api/src/main/java/...fiers/rules/distributed	AMRulesRegressorProcessor.java AMRDefaultRuleProcessor.java	426:468 (10%) 280:322 (15%)	view
27	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRDefaultRuleProcessor.java AMRulesAggregatorProcessor.java	280:322 (15%) 444:486 (9%)	view
22	x 2	samoa-api/src/main/java/...fiers/rules/centralized samoa-api/src/main/java/...fiers/rules/distributed	AMRulesRegressorProcessor.java AMRulesAggregatorProcessor.java	360:396 (8%) 378:414 (7%)	view
21	x 2	samoa-api/src/main/java/...fiers/rules/centralized samoa-api/src/main/java/...fiers/rules/distributed	AMRulesRegressorProcessor.java AMRLearnerProcessor.java	456:488 (8%) 204:236 (17%)	view
21	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRLearnerProcessor.java AMRulesAggregatorProcessor.java	204:236 (17%) 474:506 (7%)	view
20	x 2	samoa-api/src/main/java/...apache/samoa/evaluation samoa-api/src/main/java/...apache/samoa/evaluation	F1ClassificationPerformanceEvaluator.... WindowClassificationPerformanceEvalua...	109:133 (18%) 147:171 (16%)	view
19	x 2	samoa-api/src/main/java/...he/samoa/moa/clusterers samoa-api/src/main/java/...oa/clusterers/clustream	KMeans.java Clustream.java	58:88 (21%) 246:276 (11%)	view
18	x 2	samoa-api/src/main/java/...apache/samoa/evaluation samoa-api/src/main/java/...apache/samoa/evaluation	EvaluatorCVProcessor.java EvaluatorProcessor.java	134:155 (11%) 115:136 (11%)	view
18	x 2	samoa-api/src/main/java/...rners/classifiers/rules samoa-api/src/main/java/...rners/classifiers/rules	HorizontalAMRulesRegressor.java VerticalAMRulesRegressor.java	55:78 (13%) 54:77 (16%)	view
18	x 2	samoa-api/src/main/java/...e/samoa/moa/classifiers samoa-api/src/main/java/...he/samoa/moa/clusterers	AbstractClassifier.java AbstractClusterer.java	286:309 (11%) 214:244 (12%)	view
18	x 2	samoa-api/src/main/java/...fiers/rules/centralized samoa-api/src/main/java/...fiers/rules/distributed	AMRulesRegressorProcessor.java AMRulesAggregatorProcessor.java	90:114 (7%) 99:123 (6%)	view
17	x 2	samoa-api/src/main/java/...he/samoa/moa/clusterers samoa-api/src/main/java/...oa/clusterers/clustream	KMeans.java Clustream.java	100:127 (19%) 279:306 (10%)	view
17	x 2	samoa-api/src/main/java/org/apache/samoa/moa/core samoa-api/src/main/java/org/apache/samoa/moa/core	Utils.java Utils.java	1583:1608 (1%) 1624:1649 (1%)	view
17	x 2	samoa-instances/src/main.../apache/samoa/instances samoa-instances/src/main.../apache/samoa/instances	AttributesInformation.java SparseInstanceData.java	131:154 (13%) 245:268 (12%)	view
17	x 2	samoa-api/src/main/java/...rners/classifiers/rules samoa-api/src/main/java/...rners/classifiers/rules	AMRulesRegressor.java VerticalAMRulesRegressor.java	58:78 (18%) 57:77 (15%)	view
17	x 2	samoa-api/src/main/java/...fiers/rules/centralized samoa-api/src/main/java/...fiers/rules/distributed	AMRulesRegressorProcessor.java AMRulesAggregatorProcessor.java	276:305 (6%) 248:276 (6%)	view
16	x 2	samoa-api/src/main/java/...rs/classifiers/ensemble samoa-api/src/main/java/...rs/classifiers/ensemble	AdaptiveBagging.java Bagging.java	114:144 (29%) 111:141 (30%)	view
16	x 2	samoa-api/src/main/java/...fiers/rules/centralized samoa-api/src/main/java/...fiers/rules/distributed	AMRulesRegressorProcessor.java AMRulesAggregatorProcessor.java	61:82 (6%) 71:92 (5%)	view
16	x 2	samoa-api/src/main/java/org/apache/samoa/moa/core samoa-api/src/main/java/org/apache/samoa/moa/core	Statistics.java Statistics.java	940:958 (2%) 1023:1041 (2%)	view
15	x 2	samoa-api/src/main/java/...rners/classifiers/rules samoa-api/src/main/java/...rners/classifiers/rules	AMRulesRegressor.java VerticalAMRulesRegressor.java	143:157 (16%) 149:163 (13%)	view
15	x 2	samoa-api/src/main/java/...fiers/rules/centralized samoa-api/src/main/java/...fiers/rules/distributed	AMRulesRegressorProcessor.java AMRRuleSetProcessor.java	471:493 (5%) 336:358 (8%)	view
15	x 2	samoa-api/src/main/java/org/apache/samoa/tasks samoa-api/src/main/java/org/apache/samoa/tasks	PrequentialCVEvaluation.java PrequentialEvaluation.java	83:108 (20%) 137:167 (16%)	view
15	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRRuleSetProcessor.java AMRulesAggregatorProcessor.java	336:358 (8%) 489:511 (5%)	view
15	x 2	samoa-api/src/main/java/...rs/classifiers/ensemble samoa-api/src/main/java/...rs/classifiers/ensemble	BaggingDistributorProcessor.java ShardingDistributorProcessor.java	103:132 (26%) 93:141 (30%)	view
14	x 2	samoa-samza/src/main/java/org/apache/samoa samoa-threads/src/main/java/org/apache/samoa	SamzaDoTask.java LocalThreadsDoTask.java	89:106 (12%) 66:82 (43%)	view
14	x 2	samoa-api/src/main/java/org/apache/samoa/moa/core samoa-api/src/main/java/org/apache/samoa/moa/core	Statistics.java Statistics.java	964:981 (2%) 1047:1064 (2%)	view
14	x 2	samoa-api/src/main/java/...apache/samoa/evaluation samoa-api/src/main/java/...apache/samoa/evaluation	ClusteringEvaluatorProcessor.java EvaluatorProcessor.java	198:220 (8%) 161:183 (8%)	view
14	x 2	samoa-api/src/main/java/...ers/core/driftdetection samoa-api/src/main/java/...ers/core/driftdetection	CusumDM.java PageHinkleyDM.java	83:107 (31%) 89:111 (28%)	view
14	x 2	samoa-api/src/main/java/...ers/core/driftdetection samoa-api/src/main/java/...ers/core/driftdetection	CusumDM.java GeometricMovingAverageDM.java	83:107 (31%) 83:105 (31%)	view
14	x 2	samoa-api/src/main/java/...apache/samoa/streams/fs samoa-api/src/main/java/...apache/samoa/streams/fs	HDFSFileStreamSource.java LocalFileStreamSource.java	128:149 (18%) 91:112 (23%)	view
14	x 2	samoa-api/src/main/java/...rs/classifiers/ensemble samoa-api/src/main/java/...rs/classifiers/ensemble	BaggingDistributorProcessor.java ShardingDistributorProcessor.java	64:83 (25%) 58:77 (28%)	view
14	x 2	samoa-api/src/main/java/...ers/core/driftdetection samoa-api/src/main/java/...ers/core/driftdetection	GeometricMovingAverageDM.java PageHinkleyDM.java	83:105 (31%) 89:111 (28%)	view
13	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRLearnerProcessor.java AMRulesStatisticsProcessor.java	147:170 (11%) 123:146 (14%)	view
13	x 2	samoa-api/src/main/java/...e/samoa/moa/classifiers samoa-api/src/main/java/...he/samoa/moa/clusterers	AbstractClassifier.java AbstractClusterer.java	176:188 (8%) 163:175 (8%)	view
13	x 2	samoa-api/src/main/java/...oa/clusterers/clustream samoa-api/src/main/java/...oa/clusterers/clustream	Clustream.java WithKmeans.java	253:271 (7%) 310:328 (5%)	view
13	x 2	samoa-api/src/main/java/...he/samoa/moa/clusterers samoa-api/src/main/java/...oa/clusterers/clustream	KMeans.java WithKmeans.java	65:83 (14%) 310:328 (5%)	view
13	x 2	samoa-api/src/main/java/...rs/classifiers/ensemble samoa-api/src/main/java/...rners/classifiers/trees	BoostMAProcessor.java ModelAggregatorProcessor.java	176:193 (9%) 478:495 (3%)	view
13	x 2	samoa-api/src/main/java/...lassifiers/rules/common samoa-api/src/main/java/...lassifiers/rules/common	Perceptron.java Perceptron.java	113:127 (5%) 134:148 (5%)	view
12	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRRuleSetProcessor.java AMRulesAggregatorProcessor.java	173:198 (6%) 222:246 (4%)	view
12	x 2	samoa-api/src/main/java/...rners/classifiers/trees samoa-api/src/main/java/...rners/classifiers/trees	AttributeBatchContentEvent.java AttributeContentEvent.java	66:87 (19%) 67:88 (10%)	view
12	x 2	samoa-api/src/main/java/...e/samoa/moa/classifiers samoa-api/src/main/java/...he/samoa/moa/clusterers	AbstractClassifier.java AbstractClusterer.java	312:366 (7%) 248:272 (8%)	view
12	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRLearnerProcessor.java AMRRuleSetProcessor.java	219:236 (10%) 336:353 (6%)	view
12	x 2	samoa-apex/src/main/java...amoa/apex/topology/impl samoa-storm/src/main/jav...che/samoa/topology/impl	ApexComponentFactory.java StormComponentFactory.java	72:88 (36%) 66:82 (37%)	view

Duplicated Units

The list of top 22 duplicated units.

See data for all 22 unit duplicates...

Size	#	Folders	Files	Lines	Code
26	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRDefaultRuleProcessor.java AMRulesAggregatorProcessor.java	153:181 261:289	view
24	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRLearnerProcessor.java AMRulesStatisticsProcessor.java	97:130 90:121	view
20	x 2	samoa-instances/src/main.../apache/samoa/instances samoa-instances/src/main.../apache/samoa/instances	AttributesInformation.java SparseInstanceData.java	131:156 245:270	view
16	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/centralized	AMRulesAggregatorProcessor.java AMRulesRegressorProcessor.java	98:117 89:108	view
16	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/centralized	AMRulesAggregatorProcessor.java AMRulesRegressorProcessor.java	423:442 405:424	view
13	x 2	samoa-api/src/main/java/...he/samoa/moa/clusterers samoa-api/src/main/java/...e/samoa/moa/classifiers	AbstractClusterer.java AbstractClassifier.java	163:177 176:190	view
12	x 2	samoa-apex/src/main/java...amoa/apex/topology/impl samoa-storm/src/main/jav...che/samoa/topology/impl	ApexComponentFactory.java StormComponentFactory.java	72:89 66:83	view
11	x 2	samoa-api/src/main/java/...he/samoa/moa/clusterers samoa-api/src/main/java/...e/samoa/moa/classifiers	AbstractClusterer.java AbstractClassifier.java	87:99 93:105	view
11	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRLearnerProcessor.java AMRulesStatisticsProcessor.java	79:92 71:85	view
10	x 3	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/centralized	AMRLearnerProcessor.java AMRRuleSetProcessor.java AMRulesRegressorProcessor.java	132:145 195:208 271:284	view
10	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRDefaultRuleProcessor.java AMRulesAggregatorProcessor.java	183:194 291:302	view
9	x 2	samoa-apex/src/main/java/org/apache/samoa/apex samoa-storm/src/main/jav...che/samoa/topology/impl	ApexSamoaUtils.java StormSamoaUtils.java	50:60 103:113	view
9	x 2	samoa-api/src/main/java/org/apache/samoa/streams samoa-api/src/main/java/org/apache/samoa/streams	ArffFileStream.java FileStream.java	59:70 131:142	view
9	x 2	samoa-api/src/main/java/org/apache/samoa/moa/core samoa-instances/src/main.../apache/samoa/instances	MiscUtils.java Utils.java	81:94 23:36	view
9	x 2	samoa-api/src/main/java/...apache/samoa/evaluation samoa-api/src/main/java/...apache/samoa/evaluation	ClusteringEvaluatorProcessor.java EvaluatorProcessor.java	206:218 169:181	view
7	x 2	samoa-api/src/main/java/org/apache/samoa/moa/core samoa-instances/src/main.../apache/samoa/instances	DoubleVector.java MultiLabelPrediction.java	118:126 154:162	view
7	x 2	samoa-api/src/main/java/org/apache/samoa/moa/core samoa-instances/src/main.../apache/samoa/instances	DoubleVector.java MultiLabelPrediction.java	165:173 170:178	view
7	x 2	samoa-api/src/main/java/...oa/clusterers/clustream samoa-api/src/main/java/...oa/clusterers/clustream	Clustream.java WithKmeans.java	69:77 72:80	view
6	x 3	samoa-api/src/main/java/org/apache/samoa/streams samoa-api/src/main/java/org/apache/samoa/streams samoa-api/src/main/java/org/apache/samoa/streams	StreamSourceProcessor.java ClusteringEntranceProcessor.java PrequentialSourceProcessor.java	118:125 148:155 172:179	view
6	x 3	samoa-api/src/main/java/...he/samoa/moa/clusterers samoa-api/src/main/java/...oa/clusterers/clustream samoa-api/src/main/java/...oa/clusterers/clustream	KMeans.java Clustream.java WithKmeans.java	91:98 208:215 206:213	view
6	x 2	samoa-api/src/main/java/org/apache/samoa/learners samoa-api/src/main/java/org/apache/samoa/learners	InstanceContentEvent.java InstancesContentEvent.java	168:175 94:101	view
6	x 2	samoa-api/src/main/java/...fiers/rules/distributed samoa-api/src/main/java/...fiers/rules/distributed	AMRRuleSetProcessor.java AMRulesAggregatorProcessor.java	240:247 322:329	view