aws-samples / amazon-comprehend-examples
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 36% duplication:
    • 932 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 342 duplicated lines
  • 40 duplicates
system36% (342 lines)
Duplication per Extension
yaml67% (326 lines)
py3% (16 lines)
Duplication per Component (primary)
s3_object_lambda_pii_protection_blog/redaction67% (227 lines)
s3_object_lambda_pii_protection_blog/access-control67% (99 lines)
comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier10% (16 lines)
amazon_comprehend_events_tutorial/notebooks0% (0 lines)
comprehend_groundtruth_integration/src0% (0 lines)
comprehend_groundtruth_integration/src/comprehend_customer_scripts0% (0 lines)
comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth0% (0 lines)
comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/EntityRecognizer0% (0 lines)

Duplication Between Components (50+ lines)

G s3_object_lambda_pii_protection_blog/access-control s3_object_lambda_pii_protection_blog/access-control s3_object_lambda_pii_protection_blog/redaction s3_object_lambda_pii_protection_blog/redaction s3_object_lambda_pii_protection_blog/access-control--s3_object_lambda_pii_protection_blog/redaction 316

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 20 longest duplicates.
See data for all 40 duplicates...
Size#FoldersFilesLinesCode
28 x 2 s3_object_lambda_pii_pro...ion_blog/access-control
s3_object_lambda_pii_protection_blog/redaction
s3olap-access-control-foundation.yaml
s3olap-redaction-foundation.yaml
 120:147 (19%)
214:242 (8%)
 view
28 x 2 s3_object_lambda_pii_protection_blog/redaction
s3_object_lambda_pii_protection_blog/redaction
s3olap-redaction-foundation.yaml
s3olap-redaction-foundation.yaml
 214:242 (8%)
334:361 (8%)
 view
28 x 2 s3_object_lambda_pii_pro...ion_blog/access-control
s3_object_lambda_pii_protection_blog/redaction
s3olap-access-control-foundation.yaml
s3olap-redaction-foundation.yaml
 120:147 (19%)
334:361 (8%)
 view
28 x 2 s3_object_lambda_pii_protection_blog/redaction
s3_object_lambda_pii_protection_blog/redaction
s3olap-redaction-foundation.yaml
s3olap-redaction-foundation.yaml
 274:301 (8%)
334:361 (8%)
 view
28 x 2 s3_object_lambda_pii_pro...ion_blog/access-control
s3_object_lambda_pii_protection_blog/redaction
s3olap-access-control-foundation.yaml
s3olap-redaction-foundation.yaml
 120:147 (19%)
274:301 (8%)
 view
28 x 2 s3_object_lambda_pii_protection_blog/redaction
s3_object_lambda_pii_protection_blog/redaction
s3olap-redaction-foundation.yaml
s3olap-redaction-foundation.yaml
 214:242 (8%)
274:301 (8%)
 view
21 x 2 s3_object_lambda_pii_protection_blog/redaction
s3_object_lambda_pii_protection_blog/redaction
s3olap-redaction-foundation.yaml
s3olap-redaction-foundation.yaml
 304:324 (6%)
364:384 (6%)
 view
21 x 2 s3_object_lambda_pii_pro...ion_blog/access-control
s3_object_lambda_pii_protection_blog/redaction
s3olap-access-control-foundation.yaml
s3olap-redaction-foundation.yaml
 150:170 (14%)
245:265 (6%)
 view
21 x 2 s3_object_lambda_pii_protection_blog/redaction
s3_object_lambda_pii_protection_blog/redaction
s3olap-redaction-foundation.yaml
s3olap-redaction-foundation.yaml
 245:265 (6%)
304:324 (6%)
 view
21 x 2 s3_object_lambda_pii_pro...ion_blog/access-control
s3_object_lambda_pii_protection_blog/redaction
s3olap-access-control-foundation.yaml
s3olap-redaction-foundation.yaml
 150:170 (14%)
364:384 (6%)
 view
21 x 2 s3_object_lambda_pii_pro...ion_blog/access-control
s3_object_lambda_pii_protection_blog/redaction
s3olap-access-control-foundation.yaml
s3olap-redaction-foundation.yaml
 150:170 (14%)
304:324 (6%)
 view
21 x 2 s3_object_lambda_pii_protection_blog/redaction
s3_object_lambda_pii_protection_blog/redaction
s3olap-redaction-foundation.yaml
s3olap-redaction-foundation.yaml
 245:265 (6%)
364:384 (6%)
 view
15 x 2 s3_object_lambda_pii_protection_blog/redaction
s3_object_lambda_pii_protection_blog/redaction
s3olap-redaction-foundation.yaml
s3olap-redaction-foundation.yaml
 145:160 (4%)
167:182 (4%)
 view
15 x 2 s3_object_lambda_pii_protection_blog/redaction
s3_object_lambda_pii_protection_blog/redaction
s3olap-redaction-foundation.yaml
s3olap-redaction-foundation.yaml
 145:160 (4%)
189:204 (4%)
 view
15 x 2 s3_object_lambda_pii_pro...ion_blog/access-control
s3_object_lambda_pii_protection_blog/redaction
s3olap-access-control-foundation.yaml
s3olap-redaction-foundation.yaml
 95:110 (10%)
145:160 (4%)
 view
15 x 2 s3_object_lambda_pii_pro...ion_blog/access-control
s3_object_lambda_pii_protection_blog/redaction
s3olap-access-control-foundation.yaml
s3olap-redaction-foundation.yaml
 95:110 (10%)
167:182 (4%)
 view
15 x 2 s3_object_lambda_pii_pro...ion_blog/access-control
s3_object_lambda_pii_protection_blog/redaction
s3olap-access-control-foundation.yaml
s3olap-redaction-foundation.yaml
 95:110 (10%)
189:204 (4%)
 view
15 x 2 s3_object_lambda_pii_protection_blog/redaction
s3_object_lambda_pii_protection_blog/redaction
s3olap-redaction-foundation.yaml
s3olap-redaction-foundation.yaml
 167:182 (4%)
189:204 (4%)
 view
12 x 2 s3_object_lambda_pii_pro...ion_blog/access-control
s3_object_lambda_pii_protection_blog/redaction
s3olap-access-control-foundation.yaml
s3olap-redaction-foundation.yaml
 61:72 (8%)
90:101 (3%)
 view
10 x 2 s3_object_lambda_pii_pro...ion_blog/access-control
s3_object_lambda_pii_protection_blog/redaction
s3olap-access-control-foundation.yaml
s3olap-redaction-foundation.yaml
 28:38 (6%)
53:63 (2%)
 view