aliyun / aliyun-emapreduce-demo - Duplication

aliyun / aliyun-emapreduce-demo

Places in code with 6 or more lines that are exactly the same.

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Duplication Overall

14% duplication:

2,094 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
294 duplicated lines

18 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 18 longest duplicates.

See data for all 18 duplicates...

Size	#	Folders	Files	Lines	Code
22	x 2	src/main/java/com/aliyun...example/spark/streaming src/main/java/com/aliyun...example/spark/streaming	SparkMNSJavaDemo.java SparkRocketMQJavaDemo.java	59:85 (56%) 68:94 (51%)	view
18	x 2	src/main/scala/com/aliyun/emr/example/spark src/main/scala/com/aliyun/emr/example/spark/sql	SparkMaxComputeDemo.scala ODPSDataSourceSample.scala	31:50 (46%) 27:46 (32%)	view
16	x 2	src/main/java/com/aliyun...ple/spark/sql/streaming src/main/java/com/aliyun...ple/spark/sql/streaming	SparkSLSContinuousStructuredStreaming... SparkSLSStructuredStreamingJavaDemo.java	32:51 (38%) 34:53 (35%)	view
14	x 2	src/main/java/com/aliyun...example/spark/streaming src/main/java/com/aliyun...example/spark/streaming	JavaLoghubWordCount.java SparkRocketMQJavaDemo.java	78:94 (29%) 78:94 (32%)	view
14	x 2	src/main/java/com/aliyun...example/spark/streaming src/main/java/com/aliyun...example/spark/streaming	JavaLoghubWordCount.java SparkMNSJavaDemo.java	78:94 (29%) 69:85 (35%)	view
10	x 2	src/main/java/com/aliyun...ple/spark/sql/streaming src/main/java/com/aliyun...ple/spark/sql/streaming	SparkSLSContinuousStructuredStreaming... SparkSLSStructuredStreamingJavaDemo.java	53:64 (23%) 55:66 (22%)	view
10	x 2	src/main/java/com/aliyun...example/storm/benchmark src/main/java/com/aliyun...example/storm/benchmark	WindowedWordCount.java WordCount.java	62:81 (19%) 51:69 (22%)	view
9	x 2	src/main/scala/com/aliyu...example/spark/streaming src/main/scala/com/aliyu...example/spark/streaming	DirectSparkSLSDemo.scala SparkSLSDemo.scala	31:41 (20%) 32:42 (27%)	view
9	x 2	src/main/java/com/aliyun...ple/spark/sql/streaming src/main/scala/com/aliyu...ple/spark/sql/streaming	SparkSLSStructuredStreamingJavaDemo.java SparkSLSStructuredStreamingDemo.scala	62:70 (20%) 51:59 (24%)	view
8	x 2	src/main/java/com/aliyun...ple/spark/sql/streaming src/main/scala/com/aliyu...ple/spark/sql/streaming	SparkSLSContinuousStructuredStreaming... SparkSLSContinuousStructuredStreaming...	60:67 (19%) 52:59 (22%)	view
8	x 2	src/main/scala/com/aliyu...ple/spark/sql/streaming src/main/scala/com/aliyu...ple/spark/sql/streaming	SparkSLSContinuousStructuredStreaming... SparkSLSStructuredStreamingDemo.scala	49:56 (22%) 48:55 (21%)	view
8	x 2	src/main/scala/com/aliyu...ple/spark/sql/streaming src/main/scala/com/aliyu...ple/spark/sql/streaming	SparkSLSContinuousStructuredStreaming... SparkSLSStructuredStreamingDemo.scala	28:38 (22%) 27:37 (21%)	view
8	x 2	src/main/scala/com/aliyu...example/spark/streaming src/main/scala/com/aliyu...example/spark/streaming	SparkDatahubDemo.scala SparkDatahubDemo.scala	61:68 (14%) 73:80 (14%)	view
8	x 2	src/main/scala/com/aliyu...example/spark/streaming src/main/scala/com/aliyu...example/spark/streaming	SparkHBaseDemo.scala SparkRocketMQDemo.scala	53:60 (11%) 35:42 (10%)	view
7	x 2	src/main/java/com/aliyun...example/storm/benchmark src/main/java/com/aliyun...example/storm/benchmark	WindowedWordCount.java WordCount.java	34:40 (13%) 29:35 (15%)	view
6	x 2	src/main/java/com/aliyun...example/spark/streaming src/main/java/com/aliyun...example/spark/streaming	JavaLoghubWordCount.java SparkRocketMQJavaDemo.java	68:74 (12%) 68:74 (13%)	view
6	x 2	src/main/scala/com/aliyu...example/spark/streaming src/main/scala/com/aliyu...example/spark/streaming	SparkHBaseDemo.scala SparkRocketMQDemo.scala	81:86 (8%) 67:72 (7%)	view
6	x 2	src/main/java/com/aliyun...example/spark/streaming src/main/java/com/aliyun...example/spark/streaming	JavaLoghubWordCount.java SparkMNSJavaDemo.java	68:74 (12%) 59:65 (15%)	view