aws / sagemaker-distribution

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

81% duplication:

10,873 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
8,818 duplicated lines

3,604 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
build_artifacts (5%) --> template (114%)	1119	179 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 3,604 duplicates...

Size	#	Folders	Files	Lines	Code
132	x 2	build_artifacts/v2/v2.5/v2.5.0/dirs/etc/sagemaker build_artifacts/v2/v2.6/v2.6.0/dirs/etc/sagemaker	sm_pysdk_default_config.py sm_pysdk_default_config.py	7:152 (100%) 7:152 (100%)	view
72	x 2	build_artifacts/v3/v3.0/...e-server/tornado_server template/v3/dirs/etc/sag...e-server/tornado_server	server.py server.py	12:127 (100%) 12:127 (100%)	view
47	x 2	build_artifacts/v1/v1.6/v1.6.2 build_artifacts/v1/v1.6/v1.6.3	in cpu.env.in cpu.env.in	5:51 (92%) 5:51 (92%)	view
46	x 2	build_artifacts/v1/v1.12/v1.12.4 build_artifacts/v1/v1.13/v1.13.1	in cpu.env.in cpu.env.in	1:46 (85%) 1:46 (85%)	view
41	x 2	build_artifacts/v1/v1.6/v1.6.2 build_artifacts/v1/v1.6/v1.6.3	in gpu.env.in gpu.env.in	11:51 (80%) 11:51 (80%)	view
40	x 2	build_artifacts/v1/v1.4/v1.4.2 build_artifacts/v1/v1.4/v1.4.3	in gpu.env.in gpu.env.in	1:40 (83%) 1:40 (83%)	view
40	x 2	build_artifacts/v1/v1.4/v1.4.2 build_artifacts/v1/v1.4/v1.4.3	in cpu.env.in cpu.env.in	1:40 (83%) 1:40 (83%)	view
39	x 2	build_artifacts/v3/v3.0/...-inference-server/utils template/v3/dirs/etc/sag...-inference-server/utils	logger.py logger.py	5:43 (100%) 5:43 (100%)	view
37	x 2	build_artifacts/v2/v2.5/.../sagemaker-ui/workflows build_artifacts/v2/v2.6/.../sagemaker-ui/workflows	workflow_client.py workflow_client.py	6:49 (57%) 7:50 (46%)	view
37	x 2	build_artifacts/v3/v3.0/...-inference-server/utils template/v3/dirs/etc/sag...-inference-server/utils	environment.py environment.py	8:59 (100%) 8:59 (100%)	view
36	x 2	build_artifacts/v2/v2.2/v2.2.4 build_artifacts/v2/v2.2/v2.2.5	in gpu.env.in gpu.env.in	14:49 (63%) 14:49 (63%)	view
36	x 2	build_artifacts/v2/v2.1/v2.1.3 build_artifacts/v2/v2.1/v2.1.4	in gpu.env.in gpu.env.in	14:49 (64%) 14:49 (64%)	view
36	x 2	build_artifacts/v2/v2.2/v2.2.4 build_artifacts/v2/v2.2/v2.2.5	in cpu.env.in cpu.env.in	14:49 (63%) 14:49 (63%)	view
36	x 2	build_artifacts/v2/v2.1/v2.1.3 build_artifacts/v2/v2.1/v2.1.4	in cpu.env.in cpu.env.in	14:49 (64%) 14:49 (64%)	view
32	x 2	build_artifacts/v2/v2.5/v2.5.0 build_artifacts/v2/v2.5/v2.5.0	in cpu.env.in gpu.env.in	32:63 (50%) 32:63 (50%)	view
32	x 2	build_artifacts/v2/v2.6/v2.6.0 build_artifacts/v2/v2.6/v2.6.0	in cpu.env.in gpu.env.in	32:63 (50%) 32:63 (50%)	view
32	x 2	build_artifacts/v2/v2.3/v2.3.1 build_artifacts/v2/v2.3/v2.3.1	in cpu.env.in gpu.env.in	32:63 (50%) 32:63 (50%)	view
32	x 2	build_artifacts/v2/v2.3/v2.3.0 build_artifacts/v2/v2.3/v2.3.0	in cpu.env.in gpu.env.in	32:63 (50%) 32:63 (50%)	view
31	x 2	build_artifacts/v2/v2.2/v2.2.1 build_artifacts/v2/v2.2/v2.2.1	in cpu.env.in gpu.env.in	30:60 (51%) 30:60 (51%)	view
30	x 2	build_artifacts/v3/v3.0/...e-server/tornado_server template/v3/dirs/etc/sag...e-server/tornado_server	async_handler.py async_handler.py	14:76 (100%) 14:76 (100%)	view
30	x 2	build_artifacts/v3/v3.0/...e-server/tornado_server template/v3/dirs/etc/sag...e-server/tornado_server	sync_handler.py sync_handler.py	15:77 (100%) 15:77 (100%)	view
29	x 2	build_artifacts/v1/v1.3/v1.3.0 build_artifacts/v1/v1.3/v1.3.0	in cpu.env.in gpu.env.in	17:45 (64%) 17:45 (64%)	view
29	x 2	build_artifacts/v1/v1.3/v1.3.1 build_artifacts/v1/v1.3/v1.3.1	in cpu.env.in gpu.env.in	17:45 (64%) 17:45 (64%)	view
29	x 2	build_artifacts/v1/v1.7/v1.7.1 build_artifacts/v1/v1.7/v1.7.1	in cpu.env.in gpu.env.in	24:52 (55%) 24:52 (55%)	view
29	x 2	build_artifacts/v1/v1.5/v1.5.2 build_artifacts/v1/v1.5/v1.5.2	in cpu.env.in gpu.env.in	20:48 (60%) 20:48 (60%)	view
29	x 2	build_artifacts/v1/v1.5/v1.5.1 build_artifacts/v1/v1.5/v1.5.1	in cpu.env.in gpu.env.in	20:48 (60%) 20:48 (60%)	view
29	x 2	build_artifacts/v1/v1.4/v1.4.2 build_artifacts/v1/v1.4/v1.4.2	in cpu.env.in gpu.env.in	20:48 (60%) 20:48 (60%)	view
29	x 2	build_artifacts/v1/v1.7/v1.7.2 build_artifacts/v1/v1.7/v1.7.2	in cpu.env.in gpu.env.in	24:52 (55%) 24:52 (55%)	view
29	x 2	build_artifacts/v1/v1.6/v1.6.3 build_artifacts/v1/v1.6/v1.6.3	in cpu.env.in gpu.env.in	23:51 (56%) 23:51 (56%)	view
29	x 2	build_artifacts/v1/v1.12/v1.12.1 build_artifacts/v1/v1.12/v1.12.1	in cpu.env.in gpu.env.in	27:55 (50%) 27:55 (50%)	view
29	x 2	build_artifacts/v1/v1.4/v1.4.0 build_artifacts/v1/v1.4/v1.4.0	in cpu.env.in gpu.env.in	20:48 (60%) 20:48 (60%)	view
29	x 2	build_artifacts/v1/v1.4/v1.4.1 build_artifacts/v1/v1.4/v1.4.1	in cpu.env.in gpu.env.in	20:48 (60%) 20:48 (60%)	view
29	x 2	build_artifacts/v1/v1.5/v1.5.3 build_artifacts/v1/v1.5/v1.5.3	in cpu.env.in gpu.env.in	20:48 (60%) 20:48 (60%)	view
29	x 2	build_artifacts/v1/v1.6/v1.6.0 build_artifacts/v1/v1.6/v1.6.0	in cpu.env.in gpu.env.in	23:51 (56%) 23:51 (56%)	view
29	x 2	build_artifacts/v1/v1.6/v1.6.2 build_artifacts/v1/v1.6/v1.6.2	in cpu.env.in gpu.env.in	23:51 (56%) 23:51 (56%)	view
29	x 2	build_artifacts/v1/v1.6/v1.6.2 build_artifacts/v1/v1.6/v1.6.3	in cpu.env.in gpu.env.in	23:51 (56%) 23:51 (56%)	view
29	x 2	build_artifacts/v1/v1.4/v1.4.3 build_artifacts/v1/v1.4/v1.4.3	in cpu.env.in gpu.env.in	20:48 (60%) 20:48 (60%)	view
29	x 2	build_artifacts/v1/v1.4/v1.4.4 build_artifacts/v1/v1.4/v1.4.4	in cpu.env.in gpu.env.in	20:48 (60%) 20:48 (60%)	view
29	x 2	build_artifacts/v1/v1.12/v1.12.2 build_artifacts/v1/v1.12/v1.12.3	in cpu.env.in cpu.env.in	6:34 (53%) 6:34 (53%)	view
29	x 2	build_artifacts/v1/v1.5/v1.5.0 build_artifacts/v1/v1.5/v1.5.0	in cpu.env.in gpu.env.in	20:48 (60%) 20:48 (60%)	view
29	x 2	build_artifacts/v1/v1.8/v1.8.0 build_artifacts/v1/v1.8/v1.8.0	in cpu.env.in gpu.env.in	24:52 (55%) 24:52 (55%)	view
29	x 2	build_artifacts/v2/v2.2/v2.2.0 build_artifacts/v2/v2.2/v2.2.0	in cpu.env.in gpu.env.in	30:58 (50%) 30:58 (50%)	view
29	x 2	build_artifacts/v1/v1.7/v1.7.0 build_artifacts/v1/v1.7/v1.7.0	in cpu.env.in gpu.env.in	24:52 (55%) 24:52 (55%)	view
29	x 2	build_artifacts/v1/v1.6/v1.6.2 build_artifacts/v1/v1.6/v1.6.3	in gpu.env.in cpu.env.in	23:51 (56%) 23:51 (56%)	view
29	x 2	build_artifacts/v1/v1.12/v1.12.0 build_artifacts/v1/v1.12/v1.12.0	in cpu.env.in gpu.env.in	27:55 (51%) 27:55 (50%)	view
29	x 2	build_artifacts/v1/v1.6/v1.6.1 build_artifacts/v1/v1.6/v1.6.1	in cpu.env.in gpu.env.in	23:51 (56%) 23:51 (56%)	view
28	x 2	build_artifacts/v2/v2.1/v2.1.0 build_artifacts/v2/v2.1/v2.1.0	in cpu.env.in gpu.env.in	30:57 (49%) 30:57 (49%)	view
28	x 2	build_artifacts/v1/v1.9/v1.9.1 build_artifacts/v1/v1.9/v1.9.1	in cpu.env.in gpu.env.in	27:54 (51%) 27:54 (51%)	view
28	x 2	build_artifacts/v2/v2.2/v2.2.5 build_artifacts/v2/v2.2/v2.2.5	in cpu.env.in gpu.env.in	30:57 (49%) 30:57 (49%)	view
28	x 2	build_artifacts/v2/v2.4/v2.4.1 build_artifacts/v2/v2.4/v2.4.1	in cpu.env.in gpu.env.in	32:59 (47%) 32:59 (47%)	view

Duplicated Units

The list of top 4 duplicated units.

See data for all 4 unit duplicates...

Size	#	Folders	Files	Lines	Code
98	x 2	build_artifacts/v2/v2.5/v2.5.0/dirs/etc/sagemaker build_artifacts/v2/v2.6/v2.6.0/dirs/etc/sagemaker	sm_pysdk_default_config.py sm_pysdk_default_config.py	0:0 0:0	view
26	x 2	template/v3/dirs/etc/sag...e-server/tornado_server build_artifacts/v3/v3.0/...e-server/tornado_server	server.py server.py	0:0 0:0	view
8	x 2	template/v3/dirs/etc/sag...-inference-server/utils build_artifacts/v3/v3.0/...-inference-server/utils	environment.py environment.py	0:0 0:0	view
6	x 2	build_artifacts/v2/v2.5/.../sagemaker-ui/workflows build_artifacts/v2/v2.6/.../sagemaker-ui/workflows	sample_dag.py sample_dag.py	0:0 0:0	view