aws-samples / aws-reinvent21-inf1-workshop
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 43% duplication:
    • 479 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 207 duplicated lines
  • 24 duplicates
system43% (207 lines)
Duplication per Extension
py43% (207 lines)
Duplication per Component (primary)
job/resnet53% (128 lines)
job/bert37% (79 lines)
job0% (0 lines)

Duplication Between Components (50+ lines)

G job/bert job/bert job/resnet job/resnet job/bert--job/resnet 78

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 20 longest duplicates.
See data for all 24 duplicates...
Size#FoldersFilesLinesCode
13 x 2 2-dl-container/Container-Root/job/bert
2-dl-container/Container-Root/job/resnet
direct_benchmark-inf.py
direct_benchmark-inf.py
 79:96 (20%)
85:103 (20%)
 view
12 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
direct_benchmark-gpu.py
direct_benchmark-inf.py
 47:62 (16%)
52:67 (18%)
 view
12 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
direct_benchmark-gpu.py
direct_benchmark-inf.py
 98:115 (16%)
95:112 (18%)
 view
12 x 2 2-dl-container/Container-Root/job/bert
2-dl-container/Container-Root/job/bert
direct_benchmark-gpu.py
direct_benchmark-inf.py
 34:47 (17%)
44:57 (19%)
 view
12 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
compile_model-gpu.py
compile_model-inf.py
 19:38 (35%)
25:44 (34%)
 view
9 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
direct_benchmark-gpu.py
neuronperf_benchmark.py
 52:62 (12%)
37:46 (29%)
 view
9 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
direct_benchmark-inf.py
neuronperf_benchmark.py
 57:67 (13%)
37:46 (29%)
 view
8 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
direct_benchmark-gpu.py
direct_benchmark-inf.py
 28:35 (11%)
24:31 (12%)
 view
8 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
compile_model-inf.py
direct_benchmark-gpu.py
 30:37 (22%)
28:35 (11%)
 view
8 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
compile_model-inf.py
direct_benchmark-inf.py
 30:37 (22%)
24:31 (12%)
 view
8 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
compile_model-inf.py
neuronperf_benchmark.py
 30:37 (22%)
24:31 (25%)
 view
8 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
direct_benchmark-inf.py
neuronperf_benchmark.py
 24:31 (12%)
24:31 (25%)
 view
8 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
compile_model-gpu.py
neuronperf_benchmark.py
 24:31 (23%)
24:31 (25%)
 view
8 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
compile_model-gpu.py
direct_benchmark-gpu.py
 24:31 (23%)
28:35 (11%)
 view
8 x 2 2-dl-container/Container-Root/job/bert
2-dl-container/Container-Root/job/bert
direct_benchmark-gpu.py
direct_benchmark-inf.py
 90:100 (11%)
88:97 (12%)
 view
8 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
direct_benchmark-gpu.py
neuronperf_benchmark.py
 28:35 (11%)
24:31 (25%)
 view
8 x 2 2-dl-container/Container-Root/job/bert
2-dl-container/Container-Root/job/bert
compile_model-gpu.py
compile_model-inf.py
 20:30 (36%)
26:36 (32%)
 view
8 x 2 2-dl-container/Container-Root/job/resnet
2-dl-container/Container-Root/job/resnet
compile_model-gpu.py
direct_benchmark-inf.py
 24:31 (23%)
24:31 (12%)
 view
7 x 2 2-dl-container/Container-Root/job/bert
2-dl-container/Container-Root/job/resnet
direct_benchmark-gpu.py
direct_benchmark-inf.py
 90:98 (10%)
95:103 (10%)
 view
7 x 2 2-dl-container/Container-Root/job/bert
2-dl-container/Container-Root/job/resnet
direct_benchmark-inf.py
direct_benchmark-gpu.py
 88:96 (11%)
98:106 (9%)
 view