Places in code with 6 or more lines that are exactly the same.
Intro
- For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
- Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
- You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
- To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:
- Avoid Repetition, MartinFlower.com (IEEE Software article)
- Refactoring duplicated code, sourcemaking.com
- Beck Design Rules, MartinFowler.com
- DRY (Don't Repeat Yourself) Principle, Wikipedia
- The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
- Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:
- "Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"
- Reducing Coupling, MartinFlower.com (IEEE Software article):
- "There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."
Duplication Overall
- 17% duplication:
- 40,956 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
- 7,174 duplicated lines
- 1,071 duplicates
Duplication per Extension
Duplication per Component (primary)
Duplication Between Components (50+ lines)
Open 3D force graph...
Show more details on duplication between components...
From Component
--> To Component
Duplicated
Lines
File Pairs
Details
pdq/cpp (16%)
--> pdq/php (17%)
518
11 file pairs
details...
api-reference-examples/python (2%)
--> python-threatexchange/threatexchange (1%)
144
1 file pair
details...
hasher-matcher-actioner/hmalib (<1%)
--> python-threatexchange/threatexchange (1%)
92
3 file pairs
details...
| From Component --> To Component |
Duplicated Lines |
File Pairs | Details |
|---|---|---|---|
| pdq/cpp (16%) --> pdq/php (17%) |
518 | 11 file pairs | details... |
| api-reference-examples/python (2%) --> python-threatexchange/threatexchange (1%) |
144 | 1 file pair | details... |
| hasher-matcher-actioner/hmalib (<1%) --> python-threatexchange/threatexchange (1%) |
92 | 3 file pairs | details... |
Longest Duplicates
The list of 50 longest duplicates.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 40 | x 2 | api-reference-examples/python/te-tag-queryapi-reference-examples/python/te-tag-query | 238:291 (4%)332:381 (4%) | view | |
| 35 | x 2 | api-reference-examples/python/te-tag-queryapi-reference-examples/python/te-tag-query | 238:285 (3%)421:475 (3%) | view | |
| 35 | x 2 | api-reference-examples/python/te-tag-queryapi-reference-examples/python/te-tag-query | 332:375 (3%)421:475 (3%) | view | |
| 34 | x 2 | pdq/php/ext/pdqpdq/php/ext/pdq | 72:122 (18%)170:220 (18%) | view | |
| 32 | x 2 | pdq/cpp/downscalingpdq/php/ext/pdq/impl | 395:439 (12%)643:687 (7%) | view | |
| 29 | x 2 | api-reference-examples/python/te-tag-queryapi-reference-examples/python/te-tag-query | 1058:1090 (3%)1312:1344 (3%) | view | |
| 28 | x 2 | pdq/cpp/iopdq/cpp/io | 80:117 (21%)141:176 (21%) | view | |
| 27 | x 2 | api-reference-examples/j...facebook/threatexchangeapi-reference-examples/j...facebook/threatexchange | 1369:1407 (2%)1525:1563 (2%) | view | |
| 27 | x 2 | api-reference-examples/python/te-tag-queryapi-reference-examples/python/te-tag-query | 1200:1231 (2%)1328:1359 (2%) | view | |
| 26 | x 2 | hasher-matcher-actioner/terraform/hasherhasher-matcher-actioner/terraform/matcher | 43:73 (30%)41:71 (39%) | view | |
| 25 | x 2 | pdq/cpp/downscalingpdq/php/ext/pdq/impl | 405:444 (9%)710:749 (5%) | view | |
| 25 | x 2 | api-reference-examples/python/te-tag-queryapi-reference-examples/python/te-tag-query | 1152:1184 (2%)1278:1310 (2%) | view | |
| 24 | x 2 | api-reference-examples/j...facebook/threatexchangeapi-reference-examples/j...facebook/threatexchange | 1183:1214 (2%)1514:1546 (2%) | view | |
| 24 | x 2 | api-reference-examples/ruby/te-tag-queryapi-reference-examples/ruby/te-tag-query | 254:283 (2%)338:366 (2%) | view | |
| 24 | x 2 | pdq/php/ext/pdq/implpdq/php/ext/pdq/impl | 653:687 (5%)710:744 (5%) | view | |
| 24 | x 2 | api-reference-examples/python-notebookapi-reference-examples/python-notebook | 251:274 (8%)456:479 (5%) | view | |
| 23 | x 2 | api-reference-examples/ruby/te-tag-queryapi-reference-examples/ruby/te-tag-query | 954:984 (2%)1074:1104 (2%) | view | |
| 23 | x 2 | pdq/cpp/hashingpdq/php/ext/pdq/impl | 67:95 (6%)48:76 (5%) | view | |
| 23 | x 2 | api-reference-examples/ruby/te-tag-queryapi-reference-examples/ruby/te-tag-query | 252:279 (2%)429:455 (2%) | view | |
| 23 | x 2 | api-reference-examples/python/te-tag-querypython-threatexchange/th...hange/fb_threatexchange | 35:58 (4%)90:113 (5%) | view | |
| 22 | x 2 | pdq/java/src/main/java/pdqhashing/toolspdq/java/src/main/java/pdqhashing/tools | 112:140 (10%)96:124 (16%) | view | |
| 22 | x 2 | hasher-matcher-actioner/...m/authentication-sharedhasher-matcher-actioner/terraform/authentication | 42:63 (29%)25:46 (33%) | view | |
| 21 | x 2 | pdq/cpp/hashingpdq/php/ext/pdq/impl | 347:371 (6%)316:340 (4%) | view | |
| 21 | x 2 | api-reference-examples/python-notebookapi-reference-examples/python-notebook | 41:61 (7%)47:67 (4%) | view | |
| 21 | x 2 | api-reference-examples/ruby/te-tag-queryapi-reference-examples/ruby/te-tag-query | 859:883 (2%)1106:1130 (2%) | view | |
| 21 | x 2 | api-reference-examples/ruby/te-tag-queryapi-reference-examples/ruby/te-tag-query | 338:362 (2%)431:455 (2%) | view | |
| 20 | x 2 | api-reference-examples/j...facebook/threatexchangeapi-reference-examples/j...facebook/threatexchange | 1322:1345 (1%)1482:1505 (1%) | view | |
| 19 | x 2 | api-reference-examples/python-notebookapi-reference-examples/python-notebook | 22:40 (6%)26:44 (3%) | view | |
| 19 | x 2 | pdq/phppdq/php | 934:963 (3%)977:1006 (3%) | view | |
| 19 | x 2 | api-reference-examples/ruby/te-tag-queryapi-reference-examples/ruby/te-tag-query | 996:1017 (2%)1118:1139 (2%) | view | |
| 19 | x 2 | pdq/cpp/hashingpdq/php/ext/pdq/impl | 45:65 (5%)24:44 (4%) | view | |
| 18 | x 2 | pdq/phppdq/php | 860:885 (3%)895:920 (3%) | view | |
| 18 | x 2 | pdq/java/src/main/java/pdqhashing/hasherpdq/java/src/main/java/pdqhashing/hasher | 94:116 (4%)214:236 (4%) | view | |
| 18 | x 2 | pdq/php/ext/pdq/implpdq/php/ext/pdq/impl | 143:160 (4%)67:84 (17%) | view | |
| 18 | x 2 | api-reference-examples/js/node/libapi-reference-examples/js/node/lib | 87:108 (9%)111:132 (9%) | view | |
| 17 | x 2 | hasher-matcher-actioner/terraform/hasherhasher-matcher-actioner/terraform/matcher | 3:21 (20%)3:21 (25%) | view | |
| 17 | x 2 | api-reference-examples/j...facebook/threatexchangeapi-reference-examples/j...facebook/threatexchange | 330:346 (4%)492:508 (4%) | view | |
| 17 | x 2 | api-reference-examples/j.../org/json/simple/parserapi-reference-examples/j.../org/json/simple/parser | 355:372 (4%)483:500 (4%) | view | |
| 16 | x 2 | pdq/cpp/hashingpdq/php/ext/pdq/impl | 179:194 (4%)68:83 (15%) | view | |
| 16 | x 2 | hasher-matcher-actioner/terraform/apihasher-matcher-actioner/terraform/hasher | 50:68 (9%)12:29 (18%) | view | |
| 16 | x 2 | python-threatexchange/threatexchange/fetcher/apispython-threatexchange/threatexchange/fetcher | 255:272 (7%)158:180 (20%) | view | |
| 16 | x 2 | pdq/pythonpdq/python | 71:95 (9%)122:146 (9%) | view | |
| 16 | x 2 | pdq/phppdq/php | 893:916 (3%)975:998 (3%) | view | |
| 16 | x 2 | api-reference-examples/python/te-tag-queryapi-reference-examples/python/te-tag-query | 375:392 (1%)486:503 (1%) | view | |
| 16 | x 2 | api-reference-examples/python/pytx/pytxapi-reference-examples/python/pytx/pytx | 354:388 (5%)398:432 (5%) | view | |
| 16 | x 2 | hasher-matcher-actioner/terraform/actionshasher-matcher-actioner/terraform/indexer | 20:38 (24%)4:22 (28%) | view | |
| 16 | x 2 | pdq/cpp/hashingpdq/php/ext/pdq/impl | 179:194 (4%)144:159 (3%) | view | |
| 16 | x 2 | api-reference-examples/python/pytx/pytxapi-reference-examples/python/pytx/pytx | 310:344 (5%)398:432 (5%) | view | |
| 16 | x 2 | api-reference-examples/python/pytx/pytxapi-reference-examples/python/pytx/pytx | 310:344 (5%)354:388 (5%) | view | |
| 15 | x 2 | api-reference-examples/python/te-tag-queryapi-reference-examples/python/te-tag-query | 1036:1054 (1%)1283:1302 (1%) | view |
Duplicated Units
The list of top 1 duplicated units.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 16 | x 2 | pdq/php/ext/pdq/implpdq/cpp/hashing | 61:78 80:97 | view |