apache / mxnet-ciDuplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

42% duplication:

7,624 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
3,243 duplicated lines

292 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
services (3%) --> tools (12%)	404	11 file pairs	details...

Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 292 duplicates...

Size	#	Folders	Files	Lines	Code
810	x 2	services/jenkins-slave-c...ows/conf-windows-cpu-c5 services/jenkins-slave-c...ows/conf-windows-gpu-g3	main.tf main.tf	57:867 (96%) 57:867 (97%)	view
116	x 2	tools/ami-creator/scripts tools/ami-creator/scripts	win2019_cuda114_installer.py win2019_cuda11_installer.py	56:226 (41%) 57:225 (35%)	view
80	x 2	tools/ami-creator/scripts tools/ami-creator/scripts	win2019_cuda114_installer.py win2019_cuda11_installer.py	228:322 (28%) 226:320 (24%)	view
33	x 2	services/jenkins-slave-c...ows/conf-windows-cpu-c5 services/jenkins-slave-c...ows/conf-windows-gpu-g3	main.tf main.tf	602:634 (3%) 710:742 (3%)	view
33	x 2	services/jenkins-slave-c...ows/conf-windows-gpu-g3 services/jenkins-slave-c...ows/conf-windows-gpu-g3	main.tf main.tf	602:634 (3%) 710:742 (3%)	view
33	x 2	services/jenkins-slave-c...ows/conf-windows-cpu-c5 services/jenkins-slave-c...ows/conf-windows-cpu-c5	main.tf main.tf	602:634 (3%) 710:742 (3%)	view
33	x 2	services/jenkins-slave-c...ows/conf-windows-cpu-c5 services/jenkins-slave-c...ows/conf-windows-gpu-g3	main.tf main.tf	710:742 (3%) 602:634 (3%)	view
23	x 2	services/lambda-mxnet-ci-bot services/lambda-pr-status-labeler/pr_status_bot	secret_manager.py secret_manager.py	24:55 (100%) 24:56 (100%)	view
23	x 2	services/jenkins-pipeline-monitor services/lambda-mxnet-ci-bot	secret_manager.py secret_manager.py	5:36 (100%) 24:55 (100%)	view
23	x 2	services/github-bots/LabelBotFullFunctionality services/lambda-pr-status-labeler/pr_status_bot	secret_manager.py secret_manager.py	24:55 (100%) 24:56 (100%)	view
23	x 2	services/github-bots/LabelBotFullFunctionality services/lambda-mxnet-ci-bot	secret_manager.py secret_manager.py	24:55 (100%) 24:55 (100%)	view
23	x 2	services/github-bots/LabelBotFullFunctionality services/jenkins-pipeline-monitor	secret_manager.py secret_manager.py	24:55 (100%) 5:36 (100%)	view
23	x 2	services/jenkins-pipeline-monitor services/lambda-pr-status-labeler/pr_status_bot	secret_manager.py secret_manager.py	5:36 (100%) 24:56 (100%)	view
22	x 2	services/lambda-mxnet-ci-bot services/lambda-pr-status-labeler/pr_status_bot	serverless.yml serverless.yml	9:31 (29%) 8:30 (30%)	view
22	x 2	tools/ami-creator/scripts tools/ami-creator/scripts	win2019_cuda114_installer.py win2019_cuda11_installer.py	365:395 (7%) 417:447 (6%)	view
22	x 2	services/github-bots/LabelBotAddLabels services/github-bots/LabelBotFullFunctionality	serverless.yml serverless.yml	22:44 (68%) 33:55 (33%)	view
21	x 2	services/github-bots/LabelBotAddLabels services/lambda-mxnet-ci-bot	secret_manager.py secret_manager.py	31:54 (77%) 32:55 (91%)	view
21	x 2	services/github-bots/LabelBotFullFunctionality services/lambda-mxnet-ci-bot	serverless.yml serverless.yml	52:73 (31%) 18:39 (28%)	view
21	x 2	services/github-bots/LabelBotAddLabels services/github-bots/LabelBotFullFunctionality	secret_manager.py secret_manager.py	31:54 (77%) 32:55 (91%)	view
21	x 2	services/github-bots/LabelBotAddLabels services/lambda-pr-status-labeler/pr_status_bot	secret_manager.py secret_manager.py	31:54 (77%) 32:56 (91%)	view
21	x 2	services/github-bots/LabelBotAddLabels services/jenkins-pipeline-monitor	secret_manager.py secret_manager.py	31:54 (77%) 13:36 (91%)	view
20	x 2	tools/jenkins-slave-crea...unix/conf-ubuntu-cpu-c5 tools/jenkins-slave-creation-unix/conf-ubuntu-gpu	infrastructure_backend.tfvars infrastructure_backend.tfvars	1:22 (100%) 1:22 (100%)	view
19	x 2	services/github-bots/LabelBotFullFunctionality services/lambda-pr-status-labeler/pr_status_bot	handler.py handler.py	22:45 (61%) 28:52 (61%)	view
19	x 2	services/jenkins-slave-c...ows/conf-windows-cpu-c5 services/jenkins-slave-c...ows/conf-windows-gpu-g3	main.tf main.tf	18:54 (2%) 18:54 (2%)	view
19	x 2	services/github-bots/LabelBotFullFunctionality services/lambda-mxnet-ci-bot	handler.py handler.py	22:45 (61%) 24:48 (70%)	view
19	x 2	services/lambda-mxnet-ci-bot services/lambda-pr-status-labeler/pr_status_bot	handler.py handler.py	24:48 (70%) 28:52 (61%)	view
18	x 2	services/jenkins-master tools/jenkins-slave-creation-unix	infrastructure.tf infrastructure.tf	158:175 (7%) 143:160 (7%)	view
18	x 2	tools/jenkins-slave-crea...unix/conf-ubuntu-cpu-c5 tools/jenkins-slave-creation-unix/conf-ubuntu-gpu	infrastructure.tfvars infrastructure.tfvars	1:19 (66%) 1:19 (64%)	view
16	x 2	services/jenkins-master tools/jenkins-slave-creation-unix	infrastructure.tf infrastructure.tf	138:153 (6%) 122:137 (6%)	view
16	x 2	services/jenkins-master/prod tools/jenkins-slave-creation-unix/conf-ubuntu-gpu	infrastructure.tfvars infrastructure_backend.tfvars	1:16 (53%) 1:16 (80%)	view
16	x 2	services/jenkins-master/prod tools/jenkins-slave-crea...unix/conf-ubuntu-cpu-c5	infrastructure.tfvars infrastructure.tfvars	1:16 (53%) 1:16 (59%)	view
16	x 2	tools/jenkins-slave-crea...unix/conf-ubuntu-cpu-c5 tools/jenkins-slave-creation-unix/conf-ubuntu-gpu	infrastructure_backend.tfvars infrastructure.tfvars	1:16 (80%) 1:16 (57%)	view
16	x 2	tools/jenkins-slave-crea...unix/conf-ubuntu-cpu-c5 tools/jenkins-slave-creation-unix/conf-ubuntu-gpu	infrastructure.tfvars infrastructure_backend.tfvars	1:16 (59%) 1:16 (80%)	view
16	x 2	services/jenkins-master/prod tools/jenkins-slave-crea...unix/conf-ubuntu-cpu-c5	infrastructure.tfvars infrastructure_backend.tfvars	1:16 (53%) 1:16 (80%)	view
16	x 2	tools/jenkins-slave-creation-unix tools/jenkins-slave-creation-unix	infrastructure.tf infrastructure.tf	103:118 (6%) 122:137 (6%)	view
16	x 2	tools/jenkins-slave-crea...unix/conf-ubuntu-cpu-c5 tools/jenkins-slave-crea...unix/conf-ubuntu-cpu-c5	infrastructure.tfvars infrastructure_backend.tfvars	1:16 (59%) 1:16 (80%)	view
16	x 2	tools/jenkins-slave-creation-unix/conf-ubuntu-gpu tools/jenkins-slave-creation-unix/conf-ubuntu-gpu	infrastructure.tfvars infrastructure_backend.tfvars	1:16 (57%) 1:16 (80%)	view
16	x 2	services/jenkins-master/prod tools/jenkins-slave-creation-unix/conf-ubuntu-gpu	infrastructure.tfvars infrastructure.tfvars	1:16 (53%) 1:16 (57%)	view
16	x 2	services/jenkins-master tools/jenkins-slave-creation-unix	infrastructure.tf infrastructure.tf	138:153 (6%) 103:118 (6%)	view
15	x 2	tools/ami-creator/scripts tools/ami-creator/scripts	win2019_cuda114_installer.py win2019_cuda11_installer.py	401:417 (5%) 453:472 (4%)	view
14	x 2	services/jenkins-slave-creation-windows services/jenkins-slave-creation-windows	infrastructure.tf infrastructure.tf	31:44 (6%) 54:67 (6%)	view
14	x 2	services/jenkins-slave-creation-windows tools/ami-creator/scripts	post-install.py win2019_cuda114_installer.py	60:76 (8%) 162:179 (4%)	view
14	x 2	services/jenkins-slave-creation-windows tools/ami-creator/scripts	post-install.py win2019_cuda11_installer.py	60:76 (8%) 163:180 (4%)	view
13	x 2	services/lambda-mxnet-ci-bot services/lambda-pr-status-labeler/pr_status_bot	serverless.yml serverless.yml	68:81 (17%) 66:79 (18%)	view
13	x 2	services/jenkins-slave-c...ows/conf-windows-cpu-c5 services/jenkins-slave-c...ows/conf-windows-gpu-g3	main.tf main.tf	574:586 (1%) 832:844 (1%)	view
13	x 2	services/jenkins-slave-c...ows/conf-windows-cpu-c5 services/jenkins-slave-c...ows/conf-windows-cpu-c5	main.tf main.tf	574:586 (1%) 832:844 (1%)	view
13	x 2	services/jenkins-slave-c...ows/conf-windows-cpu-c5 services/jenkins-slave-c...ows/conf-windows-gpu-g3	main.tf main.tf	832:844 (1%) 574:586 (1%)	view
13	x 2	services/jenkins-slave-c...ows/conf-windows-gpu-g3 services/jenkins-slave-c...ows/conf-windows-gpu-g3	main.tf main.tf	574:586 (1%) 832:844 (1%)	view
13	x 2	services/github-bots/LabelBotFullFunctionality services/lambda-pr-status-labeler/pr_status_bot	serverless.yml serverless.yml	52:65 (19%) 17:30 (18%)	view
12	x 2	services/lambda-mxnet-ci-bot services/lambda-pr-status-labeler/pr_status_bot	CIBot.py PRStatusBot.py	243:262 (4%) 388:405 (5%)	view

Duplicated Units

The list of top 2 duplicated units.

See data for all 2 unit duplicates...

Size	#	Folders	Files	Lines	Code
26	x 3	services/lambda-pr-status-labeler/pr_status_bot services/jenkins-pipeline-monitor services/lambda-mxnet-ci-bot	secret_manager.py secret_manager.py secret_manager.py	0:0 0:0 0:0	view
13	x 3	services/lambda-pr-status-labeler/pr_status_bot services/github-bots/LabelBotFullFunctionality services/lambda-mxnet-ci-bot	handler.py handler.py handler.py	0:0 0:0 0:0	view