aws-samples / document-processing-pipeline-for-regulated-industries
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 15% duplication:
    • 2,434 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 369 duplicated lines
  • 70 duplicates
system15% (369 lines)
Duplication per Extension
py17% (369 lines)
Duplication per Component (primary)
code/lambda_layer/pipeline19% (191 lines)
code/lambda_layer/metadata-services31% (95 lines)
code/metadata15% (25 lines)
code/textract_sync18% (13 lines)
code/textract_async8% (13 lines)
code/document_registrar14% (12 lines)
code/extension_detector8% (7 lines)
code/comprehend_sync4% (7 lines)
code/document_classifier8% (6 lines)
infrastructure/lib0% (0 lines)
Longest Duplicates
The list of 20 longest duplicates.
See data for all 70 duplicates...
Size#FoldersFilesLinesCode
22 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
193:221 (4%)
245:273 (4%)
view
21 x 2 code/lambda_layer/metadata-services/python
code/lambda_layer/pipeline/python
helper.py
helper.py
33:55 (51%)
62:84 (10%)
view
18 x 2 code/lambda_layer/metadata-services/python
code/lambda_layer/metadata-services/python
datastore.py
datastore.py
30:47 (6%)
79:96 (6%)
view
15 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
255:273 (2%)
394:412 (2%)
view
15 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
203:221 (2%)
394:412 (2%)
view
14 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
176:191 (2%)
224:239 (2%)
view
12 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
79:94 (2%)
248:263 (2%)
view
12 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
79:94 (2%)
196:211 (2%)
view
11 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
126:140 (2%)
461:475 (2%)
view
11 x 2 code/lambda_layer/metadata-services/python
code/lambda_layer/metadata-services/python
datastore.py
datastore.py
27:37 (4%)
172:182 (4%)
view
10 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
159:171 (1%)
463:475 (1%)
view
10 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
251:263 (1%)
463:475 (1%)
view
10 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
128:140 (1%)
251:263 (1%)
view
10 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
159:171 (1%)
199:211 (1%)
view
10 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
199:211 (1%)
463:475 (1%)
view
10 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
128:140 (1%)
199:211 (1%)
view
10 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
82:94 (1%)
159:171 (1%)
view
10 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
159:171 (1%)
251:263 (1%)
view
10 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
82:94 (1%)
463:475 (1%)
view
10 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/pipeline/python
trp.py
trp.py
82:94 (1%)
128:140 (1%)
view
Duplicated Units
The list of top 2 duplicated units.
See data for all 2 unit duplicates...
Size#FoldersFilesLinesCode
9 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/metadata-services/python
helper.py
helper.py
0:0 
0:0 
view
9 x 2 code/lambda_layer/pipeline/python
code/lambda_layer/metadata-services/python
helper.py
helper.py
0:0 
0:0 
view