aws-samples / amazon-sagemaker-mlops-workshop
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 15% duplication:
    • 952 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 146 duplicated lines
  • 6 duplicates
system15% (146 lines)
Duplication per Extension
py54% (94 lines)
yaml6% (52 lines)
Duplication per Component (primary)
event_engine/cfn6% (52 lines)
labs/04_workflow_sm_pipelines/code100% (47 lines)
labs/03_manual_sagemaker_process_train/code100% (47 lines)
labs/05_model_monitor0% (0 lines)

Duplication Between Components (50+ lines)

G labs/03_manual_sagemaker_process_train/code labs/03_manual_sagemaker_process_train/code labs/04_workflow_sm_pipelines/code labs/04_workflow_sm_pipelines/code labs/03_manual_sagemaker_process_train/code--labs/04_workflow_sm_pipelines/code 94

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 6 longest duplicates.
See data for all 6 duplicates...
Size#FoldersFilesLinesCode
41 x 2 labs/03_manual_sagemaker_process_train/code
labs/04_workflow_sm_pipelines/code
train.py
train.py
8:77 (100%)
8:77 (100%)
view
7 x 2 event_engine/cfn
event_engine/cfn
sagemaker_studio_template.yaml
sagemaker_studio_template.yaml
359:365 (<1%)
423:429 (<1%)
view
7 x 2 event_engine/cfn
event_engine/cfn
sagemaker_studio_template.yaml
sagemaker_studio_template.yaml
300:306 (<1%)
315:321 (<1%)
view
6 x 2 event_engine/cfn
event_engine/cfn
sagemaker_studio_template.yaml
sagemaker_studio_template.yaml
770:775 (<1%)
781:786 (<1%)
view
6 x 2 labs/03_manual_sagemaker_process_train/code
labs/04_workflow_sm_pipelines/code
model_def.py
model_def.py
4:10 (100%)
4:10 (100%)
view
6 x 2 event_engine/cfn
event_engine/cfn
sagemaker_studio_template.yaml
sagemaker_studio_template.yaml
42:47 (<1%)
54:59 (<1%)
view
Duplicated Units
The list of top 1 duplicated units.
See data for all 1 unit duplicate
Size#FoldersFilesLinesCode
11 x 2 labs/04_workflow_sm_pipelines/code
labs/03_manual_sagemaker_process_train/code
train.py
train.py
0:0 
0:0 
view