aws / sagemaker-spark-container

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

38% duplication:

1,752 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
681 duplicated lines

67 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 67 duplicates...

Size	#	Folders	Files	Lines	Code
44	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.3/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.3/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.2/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.3/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.1/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.2/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.1/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.4/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.1/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.2/py3/hadoop-config spark/processing/3.3/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.1/py3/hadoop-config spark/processing/3.3/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.2/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
44	x 2	spark/processing/3.1/py3/hadoop-config spark/processing/3.2/py3/hadoop-config	hdfs-site.xml hdfs-site.xml	1:64 (100%) 1:64 (100%)	view
25	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.3/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.3/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/2.4/py3/hadoop-config spark/processing/3.0/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.2/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.1/py3/hadoop-config spark/processing/3.3/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.1/py3/hadoop-config spark/processing/3.2/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/2.4/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/2.4/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.1/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.4/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.2/py3/hadoop-config spark/processing/3.3/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/2.4/py3/hadoop-config spark/processing/3.3/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.1/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.1/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/2.4/py3/hadoop-config spark/processing/3.2/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/2.4/py3/hadoop-config spark/processing/3.1/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.2/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.2/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
25	x 2	spark/processing/3.3/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	yarn-site.xml yarn-site.xml	1:31 (100%) 1:31 (100%)	view
23	x 2	spark/processing/2.4/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/3.4/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/3.2/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/3.1/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/3.1/py3/hadoop-config spark/processing/3.3/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/3.1/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/2.4/py3/hadoop-config spark/processing/3.5/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/3.2/py3/hadoop-config spark/processing/3.3/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/3.3/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/2.4/py3/hadoop-config spark/processing/3.0/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.4/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/3.0/py3/hadoop-config spark/processing/3.3/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view
23	x 2	spark/processing/2.4/py3/hadoop-config spark/processing/3.1/py3/hadoop-config	core-site.xml core-site.xml	1:29 (100%) 1:29 (100%)	view