GoogleCloudPlatform / slurm-gcp

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

93% duplication:

10,343 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
9,684 duplicated lines

332 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
ansible (95%) --> scripts (100%)	8357	31 file pairs	details...
ansible (2%) --> jobs (110%)	213	4 file pairs	details...
ansible (<1%) --> packer (2%)	85	3 file pairs	details...
packer (2%) --> scripts (<1%)	64	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 332 duplicates...

Size	#	Folders	Files	Lines	Code
1539	x 2	ansible/roles/slurm/files/scripts scripts	util.py util.py	48:2083 (100%) 48:2083 (100%)	view
554	x 2	ansible/roles/slurm/files/scripts scripts	resume.py resume.py	31:708 (100%) 31:708 (100%)	view
433	x 2	ansible/roles/slurm/files/scripts scripts	slurmsync.py slurmsync.py	32:575 (100%) 32:575 (100%)	view
370	x 2	ansible/roles/slurm/files/scripts scripts	conf.py conf.py	25:499 (100%) 25:499 (100%)	view
345	x 2	ansible/roles/slurm/files/scripts scripts	setup.py setup.py	30:545 (100%) 30:545 (100%)	view
271	x 2	packer/docker packer	hcl variables.pkr.hcl variables.pkr.hcl	1:323 (100%) 1:323 (100%)	view
234	x 2	ansible/roles/slurm/files/scripts scripts	load_bq.py load_bq.py	21:329 (100%) 21:329 (100%)	view
214	x 2	ansible/roles/slurm/files/scripts scripts	setup_network_storage.py setup_network_storage.py	32:307 (100%) 32:307 (100%)	view
125	x 2	ansible/roles/slurm/files/scripts scripts	suspend.py suspend.py	26:184 (100%) 26:184 (100%)	view
98	x 2	ansible/roles/slurm/file...ripts/slurm_gcp_plugins scripts/slurm_gcp_plugins	__init__.py __init__.py	7:135 (100%) 7:135 (100%)	view
90	x 2	ansible/roles/slurm/files/scripts scripts	destroy_nodes.py destroy_nodes.py	21:131 (100%) 21:131 (100%)	view
72	x 2	ansible/roles/slurm/files/scripts scripts	destroy_resource_policies.py destroy_resource_policies.py	22:108 (100%) 22:108 (100%)	view
60	x 2	ansible/roles/slurm/files/jobs jobs	submit_workflow.py submit_workflow.py	24:96 (100%) 24:96 (100%)	view
47	x 2	packer/docker packer	hcl example.pkrvars.hcl example.pkrvars.hcl	27:90 (68%) 22:84 (72%)	view
33	x 2	ansible/roles/slurm/file...slurm_gcp_plugins/utils scripts/slurm_gcp_plugins/utils	__init__.py __init__.py	14:56 (100%) 14:56 (100%)	view
31	x 2	ansible/roles/slurm/files/scripts scripts	setup_hybrid.py setup_hybrid.py	27:67 (100%) 27:67 (100%)	view
30	x 2	ansible/roles/slurm/file...rm_gcp_plugins/max_hops scripts/slurm_gcp_plugins/max_hops	__init__.py __init__.py	21:58 (100%) 21:58 (100%)	view
24	x 2	ansible/roles/slurm/files/scripts scripts	resume.py suspend.py	678:704 (4%) 154:180 (19%)	view
24	x 2	packer/builds packer/builds	hcl ubuntu-2004-lts.hcl ubuntu-2204-lts.hcl	1:29 (75%) 1:29 (77%)	view
24	x 2	packer/builds packer/builds	hcl ubuntu-2204-lts-arm64.hcl ubuntu-2204-lts.hcl	1:29 (75%) 1:29 (77%)	view
24	x 2	packer/builds packer/builds	hcl debian-10.hcl debian-11.hcl	1:29 (77%) 1:29 (77%)	view
24	x 2	packer/builds packer/builds	hcl ubuntu-2004-lts.hcl ubuntu-2204-lts-arm64.hcl	1:29 (75%) 1:29 (75%)	view
24	x 2	packer/builds packer/builds	hcl debian-11-arm64.hcl debian-11.hcl	1:29 (75%) 1:29 (77%)	view
24	x 2	packer/builds packer/builds	hcl hpc-centos-7.hcl hpc-rocky-linux-8.hcl	1:29 (77%) 1:29 (77%)	view
24	x 2	packer/builds packer/builds	hcl ubuntu-2004-lts-arm64.hcl ubuntu-2204-lts-arm64.hcl	1:29 (75%) 1:29 (75%)	view
24	x 2	packer/builds packer/builds	hcl ubuntu-2004-lts-arm64.hcl ubuntu-2004-lts.hcl	1:29 (75%) 1:29 (75%)	view
24	x 2	packer/builds packer/builds	hcl ubuntu-2004-lts-arm64.hcl ubuntu-2204-lts.hcl	1:29 (75%) 1:29 (77%)	view
24	x 2	scripts scripts	resume.py suspend.py	678:704 (4%) 154:180 (19%)	view
24	x 2	ansible/roles/slurm/files/scripts scripts	suspend.py resume.py	154:180 (19%) 678:704 (4%)	view
24	x 2	ansible/roles/slurm/files/scripts ansible/roles/slurm/files/scripts	resume.py suspend.py	678:704 (4%) 154:180 (19%)	view
24	x 2	packer/builds packer/builds	hcl debian-10.hcl debian-11-arm64.hcl	1:29 (77%) 1:29 (75%)	view
22	x 2	packer/builds packer/builds	hcl hpc-centos-7.hcl ubuntu-2004-lts-arm64.hcl	1:26 (70%) 1:26 (68%)	view
22	x 2	packer/builds packer/builds	hcl debian-10.hcl ubuntu-2204-lts-arm64.hcl	1:26 (70%) 1:26 (68%)	view
22	x 2	packer/builds packer/builds	hcl hpc-rocky-linux-8.hcl ubuntu-2004-lts-arm64.hcl	1:26 (70%) 1:26 (68%)	view
22	x 2	packer/builds packer/builds	hcl rocky-linux-8.hcl ubuntu-2004-lts.hcl	1:26 (70%) 1:26 (68%)	view
22	x 2	packer/builds packer/builds	hcl hpc-rocky-linux-8.hcl ubuntu-2204-lts.hcl	1:26 (70%) 1:26 (70%)	view
22	x 2	packer/builds packer/builds	hcl debian-10.hcl ubuntu-2004-lts.hcl	1:26 (70%) 1:26 (68%)	view
22	x 2	packer/builds packer/builds	hcl centos-7.hcl rocky-linux-8.hcl	1:26 (70%) 1:26 (70%)	view
22	x 2	packer/builds packer/builds	hcl hpc-rocky-linux-8.hcl rocky-linux-8.hcl	1:26 (70%) 1:26 (70%)	view
22	x 2	packer/builds packer/builds	hcl centos-7.hcl ubuntu-2004-lts-arm64.hcl	1:26 (70%) 1:26 (68%)	view
22	x 2	packer/builds packer/builds	hcl centos-7.hcl debian-10.hcl	1:26 (70%) 1:26 (70%)	view
22	x 2	packer/builds packer/builds	hcl debian-11.hcl ubuntu-2204-lts-arm64.hcl	1:26 (70%) 1:26 (68%)	view
22	x 2	packer/builds packer/builds	hcl debian-10.hcl hpc-centos-7.hcl	1:26 (70%) 1:26 (70%)	view
22	x 2	packer/builds packer/builds	hcl hpc-centos-7.hcl ubuntu-2004-lts.hcl	1:26 (70%) 1:26 (68%)	view
22	x 2	packer/builds packer/builds	hcl centos-7.hcl ubuntu-2204-lts.hcl	1:26 (70%) 1:26 (70%)	view
22	x 2	packer/builds packer/builds	hcl hpc-centos-7.hcl ubuntu-2204-lts-arm64.hcl	1:26 (70%) 1:26 (68%)	view
22	x 2	packer/builds packer/builds	hcl centos-7.hcl debian-11-arm64.hcl	1:26 (70%) 1:26 (68%)	view
22	x 2	packer/builds packer/builds	hcl debian-11-arm64.hcl ubuntu-2204-lts.hcl	1:26 (68%) 1:26 (70%)	view
22	x 2	packer/builds packer/builds	hcl debian-11.hcl hpc-centos-7.hcl	1:26 (70%) 1:26 (70%)	view
22	x 2	packer/builds packer/builds	hcl rocky-linux-8.hcl ubuntu-2204-lts-arm64.hcl	1:26 (70%) 1:26 (68%)	view

Duplicated Units

The list of top 15 duplicated units.

See data for all 15 unit duplicates...

Size	#	Folders	Files	Lines	Code
107	x 2	scripts ansible/roles/slurm/files/scripts	resume.py resume.py	0:0 0:0	view
75	x 2	scripts ansible/roles/slurm/files/scripts	util.py util.py	0:0 0:0	view
65	x 2	scripts ansible/roles/slurm/files/scripts	setup_network_storage.py setup_network_storage.py	0:0 0:0	view
52	x 2	scripts ansible/roles/slurm/files/scripts	conf.py conf.py	0:0 0:0	view
56	x 2	scripts ansible/roles/slurm/files/scripts	slurmsync.py slurmsync.py	0:0 0:0	view
53	x 2	scripts ansible/roles/slurm/files/scripts	setup.py setup.py	0:0 0:0	view
37	x 2	scripts ansible/roles/slurm/files/scripts	destroy_nodes.py destroy_nodes.py	0:0 0:0	view
33	x 2	scripts/slurm_gcp_plugins ansible/roles/slurm/file...ripts/slurm_gcp_plugins	__init__.py __init__.py	0:0 0:0	view
34	x 2	scripts ansible/roles/slurm/files/scripts	load_bq.py load_bq.py	0:0 0:0	view
24	x 2	scripts/slurm_gcp_plugins/max_hops ansible/roles/slurm/file...rm_gcp_plugins/max_hops	__init__.py __init__.py	0:0 0:0	view
23	x 2	ansible/roles/slurm/files/jobs jobs	submit_workflow.py submit_workflow.py	0:0 0:0	view
18	x 2	scripts ansible/roles/slurm/files/scripts	destroy_resource_policies.py destroy_resource_policies.py	0:0 0:0	view
18	x 2	scripts ansible/roles/slurm/files/scripts	suspend.py suspend.py	0:0 0:0	view
13	x 2	scripts/slurm_gcp_plugins/utils ansible/roles/slurm/file...slurm_gcp_plugins/utils	__init__.py __init__.py	0:0 0:0	view
6	x 2	scripts ansible/roles/slurm/files/scripts	setup_hybrid.py setup_hybrid.py	0:0 0:0	view