awslabs / aws-orbit-workbench
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 61% duplication:
    • 58,802 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 36,266 duplicated lines
  • 22,266 duplicates
system61% (36,266 lines)
Duplication per Extension
yaml84% (31,482 lines)
py14% (2,550 lines)
tsx44% (992 lines)
toml90% (385 lines)
cfg99% (345 lines)
tpl48% (261 lines)
in57% (251 lines)
Duplication per Component (primary)
cli/aws_orbit71% (30,916 lines)
jupyterlab_orbit/src40% (992 lines)
ROOT64% (573 lines)
trial70% (517 lines)
images/orbit-controller16% (445 lines)
plugins/sm-operator62% (392 lines)
plugins/voila59% (229 lines)
plugins/ray53% (222 lines)
kubeflow/manifests37% (221 lines)
plugins/team_script_launcher49% (211 lines)
plugins/lustre36% (206 lines)
sdk/aws_orbit_sdk8% (189 lines)
plugins/overprovisioning54% (165 lines)
plugins/code_commit52% (150 lines)
plugins/redshift31% (143 lines)
plugins/hello_world74% (140 lines)
plugins/emr_on_eks44% (140 lines)
plugins/custom_cfn39% (101 lines)
images/jupyter-user23% (90 lines)
cli42% (77 lines)
sdk53% (64 lines)
jupyterlab_orbit/jupyterlab_orbit10% (54 lines)
jupyterlab_orbit17% (17 lines)
images/utility-data10% (6 lines)
scripts5% (6 lines)
jupyterlab_orbit/style0% (0 lines)

Duplication Between Components (50+ lines)

G ROOT ROOT trial trial ROOT--trial 741 plugins/ray plugins/ray plugins/voila plugins/voila plugins/ray--plugins/voila 388 plugins/team_script_launcher plugins/team_script_launcher plugins/ray--plugins/team_script_launcher 364 plugins/sm-operator plugins/sm-operator plugins/ray--plugins/sm-operator 288 plugins/redshift plugins/redshift plugins/ray--plugins/redshift 174 plugins/team_script_launcher--plugins/voila 372 plugins/lustre plugins/lustre plugins/lustre--plugins/ray 315 plugins/lustre--plugins/voila 315 plugins/lustre--plugins/team_script_launcher 338 plugins/overprovisioning plugins/overprovisioning plugins/lustre--plugins/overprovisioning 301 plugins/lustre--plugins/sm-operator 325 plugins/lustre--plugins/redshift 170 plugins/overprovisioning--plugins/ray 330 plugins/overprovisioning--plugins/voila 316 plugins/overprovisioning--plugins/team_script_launcher 290 plugins/overprovisioning--plugins/sm-operator 288 plugins/overprovisioning--plugins/redshift 174 plugins/sm-operator--plugins/voila 288 plugins/sm-operator--plugins/team_script_launcher 304 plugins/code_commit plugins/code_commit plugins/hello_world plugins/hello_world plugins/code_commit--plugins/hello_world 246 plugins/emr_on_eks plugins/emr_on_eks plugins/code_commit--plugins/emr_on_eks 240 plugins/code_commit--plugins/redshift 204 plugins/custom_cfn plugins/custom_cfn plugins/code_commit--plugins/custom_cfn 178 plugins/hello_world--plugins/ray 174 plugins/hello_world--plugins/voila 174 plugins/hello_world--plugins/team_script_launcher 172 plugins/hello_world--plugins/lustre 170 plugins/hello_world--plugins/overprovisioning 174 plugins/hello_world--plugins/sm-operator 178 plugins/hello_world--plugins/redshift 224 plugins/emr_on_eks--plugins/ray 176 plugins/emr_on_eks--plugins/voila 176 plugins/emr_on_eks--plugins/team_script_launcher 176 plugins/emr_on_eks--plugins/lustre 174 plugins/emr_on_eks--plugins/overprovisioning 176 plugins/emr_on_eks--plugins/sm-operator 172 plugins/emr_on_eks--plugins/hello_world 208 plugins/emr_on_eks--plugins/redshift 204 plugins/redshift--plugins/voila 174 plugins/redshift--plugins/team_script_launcher 172 plugins/redshift--plugins/sm-operator 178 plugins/custom_cfn--plugins/ray 175 plugins/custom_cfn--plugins/voila 175 plugins/custom_cfn--plugins/team_script_launcher 172 plugins/custom_cfn--plugins/lustre 170 plugins/custom_cfn--plugins/overprovisioning 175 plugins/custom_cfn--plugins/sm-operator 171 plugins/custom_cfn--plugins/hello_world 194 plugins/custom_cfn--plugins/emr_on_eks 192 plugins/custom_cfn--plugins/redshift 186

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 20 longest duplicates.
See data for all 22,266 duplicates...
Size#FoldersFilesLinesCode
1995 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 8806:10800 (7%)
10802:12796 (7%)
 view
1994 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 16833:18826 (7%)
18828:20821 (7%)
 view
1979 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 12798:14776 (7%)
14796:16774 (7%)
 view
1978 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 20823:22800 (7%)
22820:24797 (7%)
 view
1892 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 14817:16708 (7%)
20843:22734 (7%)
 view
1892 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 10823:12714 (7%)
18848:20739 (7%)
 view
1892 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 14817:16708 (7%)
22840:24731 (7%)
 view
1892 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 8827:10718 (7%)
16853:18744 (7%)
 view
1892 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 8827:10718 (7%)
18848:20739 (7%)
 view
1892 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 12819:14710 (7%)
22840:24731 (7%)
 view
1892 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 12819:14710 (7%)
20843:22734 (7%)
 view
1892 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 10823:12714 (7%)
16853:18744 (7%)
 view
1683 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 19119:20801 (6%)
21114:22796 (6%)
 view
1683 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 9098:10780 (6%)
13090:14772 (6%)
 view
1683 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 19119:20801 (6%)
23111:24793 (6%)
 view
1683 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 17124:18806 (6%)
21114:22796 (6%)
 view
1683 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 9098:10780 (6%)
15088:16770 (6%)
 view
1683 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 17124:18806 (6%)
23111:24793 (6%)
 view
1683 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 11094:12776 (6%)
13090:14772 (6%)
 view
1683 x 2 cli/aws_orbit/data/kubec...bit-system/commons/base
cli/aws_orbit/data/kubec...bit-system/commons/base
00b-cert-manager.yaml
00b-cert-manager.yaml
 11094:12776 (6%)
15088:16770 (6%)
 view
Duplicated Units
The list of top 10 duplicated units.
See data for all 10 unit duplicates...
Size#FoldersFilesLinesCode
13 x 2 sdk/aws_orbit_sdk
sdk/aws_orbit_sdk
controller.py
controller.py
 0:0 
0:0 
 view
10 x 2 jupyterlab_orbit/src
jupyterlab_orbit/src
containers.tsx
storage.tsx
 374:384 
161:171 
 view
9 x 2 cli/aws_orbit
cli/aws_orbit
__main__.py
__main__.py
 0:0 
0:0 
 view
9 x 2 cli/aws_orbit/commands
cli/aws_orbit/commands
run.py
run.py
 0:0 
0:0 
 view
8 x 2 jupyterlab_orbit/src
jupyterlab_orbit/src
containers.tsx
storage.tsx
 404:412 
191:199 
 view
8 x 2 cli/aws_orbit
cli/aws_orbit/commands
__main__.py
deploy.py
 0:0 
0:0 
 view
7 x 2 images/orbit-controller/...it_controller/operators
images/orbit-controller/...it_controller/operators
podsetting_operator.py
podsetting_operator.py
 0:0 
0:0 
 view
7 x 3 jupyterlab_orbit/src
jupyterlab_orbit/src
jupyterlab_orbit/src
tests.tsx
compute.tsx
team.tsx
 22:29 
28:35 
76:83 
 view
6 x 4 plugins/redshift/redshift
plugins/code_commit/code_commit
plugins/emr_on_eks/emr_on_eks
plugins/hello_world/hello_world
orbit_redshift_stack.py
cdk.py
cdk.py
hello_cdk.py
 0:0 
0:0 
0:0 
0:0 
 view
6 x 2 sdk/aws_orbit_sdk
cli/aws_orbit
common.py
utils.py
 0:0 
0:0 
 view