Places in code with 6 or more lines that are exactly the same.
Intro
- For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
- Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
- You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
- To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:
- Avoid Repetition, MartinFlower.com (IEEE Software article)
- Refactoring duplicated code, sourcemaking.com
- Beck Design Rules, MartinFowler.com
- DRY (Don't Repeat Yourself) Principle, Wikipedia
- The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
- Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:
- "Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"
- Reducing Coupling, MartinFlower.com (IEEE Software article):
- "There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."
Duplication Overall
- 80% duplication:
- 32,746 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
- 26,431 duplicated lines
- 2,703 duplicates
Duplication per Extension
Duplication per Component (primary)
Duplication Between Components (50+ lines)
Open 3D force graph...
Show more details on duplication between components...
From Component
--> To Component
Duplicated
Lines
File Pairs
Details
lambda/source/bastion (98%)
--> lambda/source/elasticsearch (98%)
21240
96 file pairs
details...
assets/deployments/search (39%)
--> assets/deployments/userinfo (45%)
318
8 file pairs
details...
assets/deployments/cron (40%)
--> assets/deployments/search (30%)
245
10 file pairs
details...
assets/deployments/elk-cron (52%)
--> assets/deployments/search (28%)
232
8 file pairs
details...
assets/deployments/cron (34%)
--> assets/deployments/elk-cron (47%)
211
7 file pairs
details...
assets/deployments/iba-bis (58%)
--> assets/deployments/iba (6%)
210
3 file pairs
details...
assets/deployments/cron (32%)
--> assets/deployments/userinfo (28%)
199
7 file pairs
details...
assets/deployments/elk-cron (35%)
--> assets/deployments/userinfo (22%)
158
4 file pairs
details...
assets/deployments/sentinel-2 (100%)
--> assets/deployments/sentinel2 (100%)
98
2 file pairs
details...
assets/deployments/sentinel-1 (100%)
--> assets/deployments/sentinel1 (100%)
98
2 file pairs
details...
assets/deployments/converter (17%)
--> assets/deployments/cron (13%)
82
2 file pairs
details...
assets/deployments/converter (17%)
--> assets/deployments/elk-cron (18%)
82
2 file pairs
details...
assets/deployments/converter (16%)
--> assets/deployments/search (9%)
76
2 file pairs
details...
assets/deployments/cron (11%)
--> assets/deployments/iba (2%)
72
3 file pairs
details...
assets/deployments/redis-master (100%)
--> assets/deployments/redismaster (100%)
70
2 file pairs
details...
assets/deployments/iba (2%)
--> assets/deployments/userinfo (9%)
70
3 file pairs
details...
assets/deployments/converter (14%)
--> assets/deployments/userinfo (9%)
68
1 file pair
details...
assets/deployments/elk-cron (15%)
--> assets/deployments/iba (2%)
66
2 file pairs
details...
assets/deployments/iba (2%)
--> assets/deployments/search (8%)
66
3 file pairs
details...
assets/deployments/redisslave1 (37%)
--> assets/deployments/redisslave2 (52%)
50
2 file pairs
details...
| From Component --> To Component |
Duplicated Lines |
File Pairs | Details |
|---|---|---|---|
| lambda/source/bastion (98%) --> lambda/source/elasticsearch (98%) |
21240 | 96 file pairs | details... |
| assets/deployments/search (39%) --> assets/deployments/userinfo (45%) |
318 | 8 file pairs | details... |
| assets/deployments/cron (40%) --> assets/deployments/search (30%) |
245 | 10 file pairs | details... |
| assets/deployments/elk-cron (52%) --> assets/deployments/search (28%) |
232 | 8 file pairs | details... |
| assets/deployments/cron (34%) --> assets/deployments/elk-cron (47%) |
211 | 7 file pairs | details... |
| assets/deployments/iba-bis (58%) --> assets/deployments/iba (6%) |
210 | 3 file pairs | details... |
| assets/deployments/cron (32%) --> assets/deployments/userinfo (28%) |
199 | 7 file pairs | details... |
| assets/deployments/elk-cron (35%) --> assets/deployments/userinfo (22%) |
158 | 4 file pairs | details... |
| assets/deployments/sentinel-2 (100%) --> assets/deployments/sentinel2 (100%) |
98 | 2 file pairs | details... |
| assets/deployments/sentinel-1 (100%) --> assets/deployments/sentinel1 (100%) |
98 | 2 file pairs | details... |
| assets/deployments/converter (17%) --> assets/deployments/cron (13%) |
82 | 2 file pairs | details... |
| assets/deployments/converter (17%) --> assets/deployments/elk-cron (18%) |
82 | 2 file pairs | details... |
| assets/deployments/converter (16%) --> assets/deployments/search (9%) |
76 | 2 file pairs | details... |
| assets/deployments/cron (11%) --> assets/deployments/iba (2%) |
72 | 3 file pairs | details... |
| assets/deployments/redis-master (100%) --> assets/deployments/redismaster (100%) |
70 | 2 file pairs | details... |
| assets/deployments/iba (2%) --> assets/deployments/userinfo (9%) |
70 | 3 file pairs | details... |
| assets/deployments/converter (14%) --> assets/deployments/userinfo (9%) |
68 | 1 file pair | details... |
| assets/deployments/elk-cron (15%) --> assets/deployments/iba (2%) |
66 | 2 file pairs | details... |
| assets/deployments/iba (2%) --> assets/deployments/search (8%) |
66 | 3 file pairs | details... |
| assets/deployments/redisslave1 (37%) --> assets/deployments/redisslave2 (52%) |
50 | 2 file pairs | details... |
Longest Duplicates
The list of 20 longest duplicates.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 877 | x 2 | lambda/source/bastion/requests/packages/chardetlambda/source/elasticsea...quests/packages/chardet |  big5freq.pybig5freq.py |
43:923 (100%)43:923 (100%) | view |
| 550 | x 2 | lambda/source/bastion/requests/packages/chardetlambda/source/elasticsea...quests/packages/chardet | euckrfreq.pyeuckrfreq.py |
41:594 (100%)41:594 (100%) | view |
| 520 | x 2 | lambda/source/bastion/requests/packages/chardetlambda/source/elasticsea...quests/packages/chardet | jisfreq.pyjisfreq.py |
44:567 (100%)44:567 (100%) | view |
| 461 | x 2 | lambda/source/bastion/requestslambda/source/elasticsearch/requests | models.pymodels.py |
23:851 (100%)23:851 (100%) | view |
| 426 | x 2 | lambda/source/bastion/requests/packages/chardetlambda/source/elasticsea...quests/packages/chardet | gb2312freq.pygb2312freq.py |
42:470 (100%)42:470 (100%) | view |
| 379 | x 2 | lambda/source/bastion/requests/packages/chardetlambda/source/elasticsea...quests/packages/chardet | euctwfreq.pyeuctwfreq.py |
44:426 (100%)44:426 (100%) | view |
| 355 | x 2 | lambda/source/bastion/requests/packages/urllib3lambda/source/elasticsea...quests/packages/urllib3 | connectionpool.pyconnectionpool.py |
10:818 (100%)10:818 (100%) | view |
| 350 | x 2 | lambda/source/bastion/requestslambda/source/elasticsearch/requests | utils.pyutils.py |
28:721 (100%)28:721 (100%) | view |
| 307 | x 2 | lambda/source/bastion/requestslambda/source/elasticsearch/requests | sessions.pysessions.py |
18:680 (100%)18:680 (100%) | view |
| 281 | x 2 | lambda/source/bastion/requests/packages/urllib3lambda/source/elasticsea...quests/packages/urllib3 | response.pyresponse.py |
10:514 (100%)10:514 (100%) | view |
| 280 | x 2 | lambda/source/bastion/requests/packages/chardetlambda/source/elasticsea...quests/packages/chardet | langcyrillicmodel.pylangcyrillicmodel.py |
30:327 (100%)30:327 (100%) | view |
| 269 | x 2 | lambda/source/bastion/re...ckages/urllib3/packageslambda/source/elasticsea...ckages/urllib3/packages | six.pysix.py |
26:385 (100%)26:385 (100%) | view |
| 263 | x 2 | lambda/source/bastion/requestslambda/source/elasticsearch/requests | cookies.pycookies.py |
15:487 (100%)15:487 (100%) | view |
| 219 | x 2 | lambda/source/bastion/re...ackages/urllib3/contriblambda/source/elasticsea...ackages/urllib3/contrib | pyopenssl.pypyopenssl.py |
1:307 (100%)1:307 (100%) | view |
| 210 | x 2 | lambda/source/bastion/requestslambda/source/elasticsearch/requests | adapters.pyadapters.py |
21:453 (100%)21:453 (100%) | view |
| 197 | x 2 | lambda/source/bastion/re...ckages/urllib3/packageslambda/source/elasticsea...ckages/urllib3/packages | ordered_dict.pyordered_dict.py |
5:259 (100%)5:259 (100%) | view |
| 184 | x 2 | lambda/source/bastion/requests/packages/urllib3lambda/source/elasticsea...quests/packages/urllib3 | _collections.py_collections.py |
3:324 (100%)3:324 (100%) | view |
| 180 | x 2 | lambda/source/bastion/requests/packages/chardetlambda/source/elasticsea...quests/packages/chardet | langhungarianmodel.pylanghungarianmodel.py |
34:223 (100%)34:223 (100%) | view |
| 180 | x 2 | lambda/source/bastion/requests/packages/chardetlambda/source/elasticsea...quests/packages/chardet | langbulgarianmodel.pylangbulgarianmodel.py |
37:226 (100%)37:226 (100%) | view |
| 180 | x 2 | lambda/source/bastion/requests/packages/chardetlambda/source/elasticsea...quests/packages/chardet | langgreekmodel.pylanggreekmodel.py |
34:223 (100%)34:223 (100%) | view |
Duplicated Units
The list of top 20 duplicated units.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 187 | x 2 | lambda/source/elasticsea...quests/packages/urllib3lambda/source/bastion/requests/packages/urllib3 | connectionpool.pyconnectionpool.py |
0:0 0:0 | view |
| 102 | x 2 | lambda/source/elasticsearch/requestslambda/source/bastion/requests | adapters.pyadapters.py |
0:0 0:0 | view |
| 86 | x 2 | lambda/source/elasticsearch/requestslambda/source/bastion/requests | sessions.pysessions.py |
0:0 0:0 | view |
| 71 | x 2 | lambda/source/elasticsearch/requestslambda/source/bastion/requests | auth.pyauth.py |
0:0 0:0 | view |
| 56 | x 2 | lambda/source/elasticsea...ackages/urllib3/contriblambda/source/bastion/re...ackages/urllib3/contrib | appengine.pyappengine.py |
0:0 0:0 | view |
| 62 | x 2 | lambda/source/elasticsea...quests/packages/chardetlambda/source/bastion/requests/packages/chardet | universaldetector.pyuniversaldetector.py |
0:0 0:0 | view |
| 63 | x 2 | lambda/source/elasticsearch/requestslambda/source/bastion/requests | models.pymodels.py |
0:0 0:0 | view |
| 56 | x 2 | lambda/source/elasticsea...ackages/urllib3/contriblambda/source/bastion/re...ackages/urllib3/contrib | ntlmpool.pyntlmpool.py |
0:0 0:0 | view |
| 43 | x 2 | lambda/source/elasticsea...ckages/urllib3/packageslambda/source/bastion/re...ckages/urllib3/packages | six.pysix.py |
0:0 0:0 | view |
| 55 | x 2 | lambda/source/elasticsea...s/packages/urllib3/utillambda/source/bastion/re...s/packages/urllib3/util | retry.pyretry.py |
0:0 0:0 | view |
| 56 | x 2 | lambda/source/elasticsea...quests/packages/urllib3lambda/source/bastion/requests/packages/urllib3 | connection.pyconnection.py |
0:0 0:0 | view |
| 64 | x 2 | lambda/source/elasticsea...quests/packages/urllib3lambda/source/bastion/requests/packages/urllib3 | connectionpool.pyconnectionpool.py |
0:0 0:0 | view |
| 46 | x 2 | lambda/source/elasticsearch/requestslambda/source/bastion/requests | models.pymodels.py |
0:0 0:0 | view |
| 73 | x 2 | lambda/source/elasticsearch/requestslambda/source/bastion/requests | sessions.pysessions.py |
0:0 0:0 | view |
| 67 | x 2 | lambda/source/elasticsea...s/packages/urllib3/utillambda/source/bastion/re...s/packages/urllib3/util | url.pyurl.py |
0:0 0:0 | view |
| 38 | x 2 | lambda/source/elasticsea...quests/packages/chardetlambda/source/bastion/requests/packages/chardet | sbcharsetprober.pysbcharsetprober.py |
0:0 0:0 | view |
| 42 | x 2 | lambda/source/elasticsearch/requestslambda/source/bastion/requests | models.pymodels.py |
0:0 0:0 | view |
| 35 | x 2 | lambda/source/elasticsea...ackages/urllib3/contriblambda/source/bastion/re...ackages/urllib3/contrib | pyopenssl.pypyopenssl.py |
0:0 0:0 | view |
| 52 | x 2 | lambda/source/elasticsearch/requestslambda/source/bastion/requests | sessions.pysessions.py |
0:0 0:0 | view |
| 33 | x 2 | lambda/source/elasticsea...quests/packages/chardetlambda/source/bastion/requests/packages/chardet | universaldetector.pyuniversaldetector.py |
0:0 0:0 | view |