aws-samples / aws-lambda-sap-odp-extractor
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 99% duplication:
    • 48,381 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 48,236 duplicated lines
  • 1,023 duplicates
system99% (48,236 lines)
Duplication per Extension
py99% (48,236 lines)
Duplication per Component (primary)
lib/lambda/layers/aws-sap-odp-extractor/python99% (24,118 lines)
lib/glue/aws-sap-odp-extractor/extractor/idna99% (10,508 lines)
lib/glue/aws-sap-odp-extractor/extractor/urllib399% (6,447 lines)
lib/glue/aws-sap-odp-extractor/extractor/chardet99% (4,609 lines)
lib/glue/aws-sap-odp-extractor/extractor/requests99% (2,395 lines)
lib/glue/aws-sap-odp-extractor/extractor99% (159 lines)
lib0% (0 lines)
lib/lambda/functions/aws-sap-odp-extractor-test0% (0 lines)
lib/glue/aws-sap-odp-extractor/extractor/certifi0% (0 lines)
lib/glue/aws-sap-odp-extractor0% (0 lines)

Duplication Between Components (50+ lines)

G lib/glue/aws-sap-odp-extractor/extractor/idna lib/glue/aws-sap-odp-extractor/extractor/idna lib/lambda/layers/aws-sap-odp-extractor/python lib/lambda/layers/aws-sap-odp-extractor/python lib/glue/aws-sap-odp-extractor/extractor/idna--lib/lambda/layers/aws-sap-odp-extractor/python 21016 lib/glue/aws-sap-odp-extractor/extractor/urllib3 lib/glue/aws-sap-odp-extractor/extractor/urllib3 lib/glue/aws-sap-odp-extractor/extractor/urllib3--lib/lambda/layers/aws-sap-odp-extractor/python 12894 lib/glue/aws-sap-odp-extractor/extractor/chardet lib/glue/aws-sap-odp-extractor/extractor/chardet lib/glue/aws-sap-odp-extractor/extractor/chardet--lib/lambda/layers/aws-sap-odp-extractor/python 9218 lib/glue/aws-sap-odp-extractor/extractor/requests lib/glue/aws-sap-odp-extractor/extractor/requests lib/glue/aws-sap-odp-extractor/extractor/requests--lib/lambda/layers/aws-sap-odp-extractor/python 4790 lib/glue/aws-sap-odp-extractor/extractor lib/glue/aws-sap-odp-extractor/extractor lib/glue/aws-sap-odp-extractor/extractor--lib/lambda/layers/aws-sap-odp-extractor/python 318

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 20 longest duplicates.
See data for all 1,023 duplicates...
Size#FoldersFilesLinesCode
8120 x 2 lib/glue/aws-sap-odp-extractor/extractor/idna
lib/lambda/layers/aws-sa...p-extractor/python/idna
uts46data.py
uts46data.py
7:8205 (100%)
7:8205 (100%)
view
1977 x 2 lib/glue/aws-sap-odp-extractor/extractor/idna
lib/lambda/layers/aws-sa...p-extractor/python/idna
idnadata.py
idnadata.py
3:1979 (100%)
3:1979 (100%)
view
606 x 2 lib/glue/aws-sap-odp-ext...ractor/urllib3/packages
lib/lambda/layers/aws-sa...python/urllib3/packages
six.py
six.py
31:868 (100%)
31:868 (100%)
view
498 x 2 lib/glue/aws-sap-odp-extractor/extractor/requests
lib/lambda/layers/aws-sa...tractor/python/requests
models.py
models.py
22:953 (100%)
22:953 (100%)
view
486 x 2 lib/glue/aws-sap-odp-ext...tractor/urllib3/contrib
lib/lambda/layers/aws-sa.../python/urllib3/contrib
securetransport.py
securetransport.py
66:853 (100%)
66:853 (100%)
view
476 x 2 lib/glue/aws-sap-odp-extractor/extractor/requests
lib/lambda/layers/aws-sa...tractor/python/requests
utils.py
utils.py
29:977 (100%)
29:977 (100%)
view
458 x 2 lib/glue/aws-sap-odp-ext...ontrib/_securetransport
lib/lambda/layers/aws-sa...ontrib/_securetransport
bindings.py
bindings.py
37:593 (100%)
37:593 (100%)
view
426 x 2 lib/glue/aws-sap-odp-extractor/extractor/urllib3
lib/lambda/layers/aws-sa...xtractor/python/urllib3
response.py
response.py
9:760 (100%)
9:760 (100%)
view
392 x 2 lib/glue/aws-sap-odp-extractor/extractor/urllib3
lib/lambda/layers/aws-sa...xtractor/python/urllib3
connectionpool.py
connectionpool.py
12:897 (100%)
12:897 (100%)
view
340 x 2 lib/glue/aws-sap-odp-extractor/extractor/chardet
lib/lambda/layers/aws-sa...xtractor/python/chardet
big5freq.py
big5freq.py
43:385 (100%)
43:385 (100%)
view
340 x 2 lib/glue/aws-sap-odp-extractor/extractor/chardet
lib/lambda/layers/aws-sa...xtractor/python/chardet
euctwfreq.py
euctwfreq.py
44:386 (100%)
44:386 (100%)
view
336 x 2 lib/glue/aws-sap-odp-extractor/extractor/requests
lib/lambda/layers/aws-sa...tractor/python/requests
sessions.py
sessions.py
18:770 (100%)
18:770 (100%)
view
292 x 2 lib/glue/aws-sap-odp-extractor/extractor/idna
lib/lambda/layers/aws-sa...p-extractor/python/idna
core.py
core.py
8:396 (100%)
8:396 (100%)
view
292 x 2 lib/glue/aws-sap-odp-ext...tractor/urllib3/contrib
lib/lambda/layers/aws-sa.../python/urllib3/contrib
pyopenssl.py
pyopenssl.py
50:478 (100%)
50:478 (100%)
view
286 x 2 lib/glue/aws-sap-odp-extractor/extractor/chardet
lib/lambda/layers/aws-sa...xtractor/python/chardet
langcyrillicmodel.py
langcyrillicmodel.py
30:333 (100%)
30:333 (100%)
view
277 x 2 lib/glue/aws-sap-odp-extractor/extractor/chardet
lib/lambda/layers/aws-sa...xtractor/python/chardet
jisfreq.py
jisfreq.py
44:323 (100%)
44:323 (100%)
view
273 x 2 lib/glue/aws-sap-odp-extractor/extractor/requests
lib/lambda/layers/aws-sa...tractor/python/requests
cookies.py
cookies.py
19:549 (100%)
19:549 (100%)
view
268 x 2 lib/glue/aws-sap-odp-ext...rllib3/packages/rfc3986
lib/lambda/layers/aws-sa...rllib3/packages/rfc3986
parseresult.py
parseresult.py
24:385 (100%)
24:385 (100%)
view
255 x 2 lib/glue/aws-sap-odp-extractor/extractor/requests
lib/lambda/layers/aws-sa...tractor/python/requests
adapters.py
adapters.py
34:533 (100%)
34:533 (100%)
view
239 x 2 lib/glue/aws-sap-odp-extractor/extractor/chardet
lib/lambda/layers/aws-sa...xtractor/python/chardet
gb2312freq.py
gb2312freq.py
42:282 (100%)
42:282 (100%)
view
Duplicated Units
The list of top 20 duplicated units.
See data for all 587 unit duplicates...
Size#FoldersFilesLinesCode
235 x 2 lib/lambda/layers/aws-sa...xtractor/python/urllib3
lib/glue/aws-sap-odp-extractor/extractor/urllib3
connectionpool.py
connectionpool.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view
102 x 2 lib/lambda/layers/aws-sa...p-extractor/python/idna
lib/glue/aws-sap-odp-extractor/extractor/idna
uts46data.py
uts46data.py
0:0 
0:0 
view