aws-samples / data-engineering-for-aws-immersion-day
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 57% duplication:
    • 2,708 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 1,567 duplicated lines
  • 294 duplicates
system57% (1,567 lines)
Duplication per Extension
yaml57% (1,567 lines)
Duplication per Component (primary)
PreLab57% (1,567 lines)
Longest Duplicates
The list of 20 longest duplicates.
See data for all 294 duplicates...
Size#FoldersFilesLinesCode
177 x 2 PreLab
PreLab
0.0-PreLab-DMSLab_instructor_CFN.yaml
central-template-environment-setup.yaml
15:210 (37%)
53:244 (30%)
view
116 x 2 PreLab
PreLab
0.0-PreLab-DMSLab_instructor_CFN.yaml
central-template-environment-setup.yaml
365:486 (24%)
391:512 (19%)
view
93 x 2 PreLab
PreLab
0.0-PreLab-DMSLab_instructor_CFN.yaml
central-template-environment-setup.yaml
248:340 (19%)
282:374 (15%)
view
85 x 2 PreLab
PreLab
central-template-environment-setup.yaml
central-template-glue-databrew.yaml
536:627 (14%)
147:238 (41%)
view
36 x 2 PreLab
PreLab
1-Prelab-Kinesis-Real-Time-Clickstrea...
central-template-environment-setup.yaml
473:514 (6%)
466:507 (6%)
view
36 x 2 PreLab
PreLab
2-PreLab-DMSlab_student_CFN.yaml
central-template-environment-setup.yaml
521:562 (6%)
466:507 (6%)
view
36 x 2 PreLab
PreLab
0.0-PreLab-DMSLab_instructor_CFN.yaml
1-Prelab-Kinesis-Real-Time-Clickstrea...
440:481 (7%)
473:514 (6%)
view
36 x 2 PreLab
PreLab
1-Prelab-Kinesis-Real-Time-Clickstrea...
2-PreLab-DMSlab_student_CFN.yaml
473:514 (6%)
521:562 (6%)
view
36 x 2 PreLab
PreLab
0.0-PreLab-DMSLab_instructor_CFN.yaml
2-PreLab-DMSlab_student_CFN.yaml
440:481 (7%)
521:562 (6%)
view
31 x 2 PreLab
PreLab
0.0-PreLab-DMSLab_instructor_CFN.yaml
central-template-environment-setup.yaml
215:245 (6%)
249:279 (5%)
view
28 x 2 PreLab
PreLab
0.0-PreLab-DMSLab_instructor_CFN.yaml
4-PreLab-DataBrew_CFN.yaml
448:481 (5%)
141:174 (16%)
view
28 x 2 PreLab
PreLab
1-Prelab-Kinesis-Real-Time-Clickstrea...
4-PreLab-DataBrew_CFN.yaml
481:514 (5%)
141:174 (16%)
view
28 x 2 PreLab
PreLab
4-PreLab-DataBrew_CFN.yaml
central-template-environment-setup.yaml
141:174 (16%)
474:507 (4%)
view
28 x 2 PreLab
PreLab
2-PreLab-DMSlab_student_CFN.yaml
4-PreLab-DataBrew_CFN.yaml
529:562 (4%)
141:174 (16%)
view
24 x 2 PreLab
PreLab
central-template-environment-setup.yaml
central-template-glue-databrew.yaml
1:32 (4%)
1:32 (11%)
view
22 x 2 PreLab
PreLab
1-Prelab-Kinesis-Real-Time-Clickstrea...
2-PreLab-DMSlab_student_CFN.yaml
444:465 (4%)
490:511 (3%)
view
21 x 2 PreLab
PreLab
central-template-glue-databrew.yaml
central-template-glue-databrew.yaml
170:190 (10%)
218:238 (10%)
view
21 x 2 PreLab
PreLab
0.0-PreLab-DMSLab_instructor_CFN.yaml
1-Prelab-Kinesis-Real-Time-Clickstrea...
415:435 (4%)
444:464 (4%)
view
21 x 2 PreLab
PreLab
central-template-environment-setup.yaml
central-template-environment-setup.yaml
559:579 (3%)
607:627 (3%)
view
21 x 2 PreLab
PreLab
1-Prelab-Kinesis-Real-Time-Clickstrea...
central-template-environment-setup.yaml
444:464 (4%)
441:461 (3%)
view