openai/transformer-debugger
Duplication Places in code with 6 or more lines that are exactly the same. |
Duplication Overall
- 7% duplication:
- 25,003 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
- 1,864 duplicated lines
- 345 duplicates
Duplication per Extension
Duplication per Component (primary)
Longest Duplicates
The list of 50 longest duplicates.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 39 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 503:544 (9%)337:378 (9%) | view | |
| 24 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 131:160 (9%)59:88 (6%) | view | |
| 17 | x 2 | neuron_explainer/activationsneuron_explainer/activations | 212:230 (7%)281:299 (7%) | view | |
| 17 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 739:757 (2%)835:854 (2%) | view | |
| 16 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 463:479 (3%)295:311 (3%) | view | |
| 14 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 33:47 (16%)67:81 (16%) | view | |
| 13 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 203:216 (3%)250:263 (3%) | view | |
| 12 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 563:574 (1%)753:764 (1%) | view | |
| 12 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 829:840 (<1%)851:862 (<1%) | view | |
| 11 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 249:259 (2%)415:425 (2%) | view | |
| 11 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 40:50 (3%)130:140 (3%) | view | |
| 11 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 20:31 (12%)54:65 (12%) | view | |
| 11 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 114:129 (4%)42:57 (3%) | view | |
| 10 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 831:840 (<1%)950:959 (<1%) | view | |
| 10 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 842:851 (<1%)884:893 (<1%) | view | |
| 10 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 853:862 (<1%)950:959 (<1%) | view | |
| 10 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 291:302 (2%)332:343 (2%) | view | |
| 10 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 32:44 (11%)79:90 (11%) | view | |
| 10 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 32:44 (11%)99:110 (11%) | view | |
| 10 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 79:90 (11%)99:110 (11%) | view | |
| 9 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 357:365 (1%)387:395 (1%) | view | |
| 9 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 572:580 (<1%)811:819 (<1%) | view | |
| 9 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 579:587 (<1%)832:840 (<1%) | view | |
| 9 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 579:587 (<1%)854:862 (<1%) | view | |
| 9 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 579:587 (<1%)951:959 (<1%) | view | |
| 9 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 605:613 (<1%)819:827 (<1%) | view | |
| 9 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 729:737 (<1%)764:772 (<1%) | view | |
| 9 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 829:837 (<1%)965:973 (<1%) | view | |
| 9 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 851:859 (<1%)965:973 (<1%) | view | |
| 9 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 93:101 (2%)117:125 (2%) | view | |
| 9 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 271:279 (2%)298:306 (2%) | view | |
| 9 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 226:234 (3%)273:281 (3%) | view | |
| 9 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 236:245 (2%)278:287 (2%) | view | |
| 9 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 236:245 (2%)317:326 (2%) | view | |
| 9 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 278:287 (2%)317:326 (2%) | view | |
| 9 | x 2 | neuron_explainer/activation_serverneuron_explainer/activation_server | 306:314 (<1%)377:385 (<1%) | view | |
| 9 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 364:372 (1%)608:616 (1%) | view | |
| 9 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 169:177 (2%)412:420 (2%) | view | |
| 9 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 39:50 (4%)403:414 (2%) | view | |
| 8 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 318:326 (1%)439:447 (1%) | view | |
| 8 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 318:326 (1%)708:716 (1%) | view | |
| 8 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 356:369 (1%)540:552 (1%) | view | |
| 8 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 439:447 (1%)708:716 (1%) | view | |
| 8 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 536:549 (1%)749:764 (1%) | view | |
| 8 | x 2 | neuron_viewer/src/TransformerDebugger/cardsneuron_viewer/src/TransformerDebugger/cards | 132:139 (5%)145:152 (5%) | view | |
| 8 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 407:415 (1%)443:451 (1%) | view | |
| 8 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 594:601 (<1%)829:836 (<1%) | view | |
| 8 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 594:601 (<1%)851:858 (<1%) | view | |
| 8 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 594:601 (<1%)965:972 (<1%) | view | |
| 8 | x 2 | neuron_explainer/explanationsneuron_explainer/explanations | 821:828 (<1%)940:947 (<1%) | view |
Most Frequent Duplicates
The list of 49 most frequently found duplicates.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 6 | x 16 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations... | 553:558 (<1%)559:564 (<1%)582:587 (<1%)588:593 (<1%)823:828 (<1%)835:840 (<1%)847:852 (<1%)857:862 (<1%)863:868 (<1%)878:883 (<1%)... | view | |
| 6 | x 10 | neuron_viewer/src/client/servicesneuron_viewer/src/client/servicesneuron_viewer/src/client/servicesneuron_viewer/src/client/servicesneuron_viewer/src/client/servicesneuron_viewer/src/client/servicesneuron_viewer/src/client/servicesneuron_viewer/src/client/servicesneuron_viewer/src/client/servicesneuron_viewer/src/client/services | 28:33 (26%)34:39 (9%)30:35 (14%)46:51 (26%)54:59 (9%)74:79 (9%)92:97 (9%)112:117 (9%)50:55 (14%)70:75 (14%) | view | |
| 6 | x 6 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 572:577 (<1%)595:600 (<1%)811:816 (<1%)830:835 (<1%)852:857 (<1%)966:971 (<1%) | view | |
| 6 | x 5 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 580:585 (<1%)816:821 (<1%)833:838 (<1%)855:860 (<1%)952:957 (<1%) | view | |
| 6 | x 5 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 545:550 (<1%)570:575 (<1%)607:612 (<1%)821:826 (<1%)940:945 (<1%) | view | |
| 6 | x 5 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 37:42 (6%)129:134 (<1%)563:568 (<1%)753:758 (<1%)71:76 (6%) | view | |
| 6 | x 5 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 38:43 (6%)130:135 (<1%)564:569 (<1%)754:759 (<1%)72:77 (6%) | view | |
| 6 | x 5 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 546:551 (<1%)608:613 (<1%)822:827 (<1%)877:882 (<1%)941:946 (<1%) | view | |
| 6 | x 5 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 594:599 (<1%)829:834 (<1%)851:856 (<1%)866:871 (<1%)965:970 (<1%) | view | |
| 6 | x 5 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 596:601 (<1%)831:836 (<1%)853:858 (<1%)950:955 (<1%)967:972 (<1%) | view | |
| 6 | x 5 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 579:584 (<1%)832:837 (<1%)854:859 (<1%)951:956 (<1%)968:973 (<1%) | view | |
| 6 | x 4 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 581:586 (<1%)834:839 (<1%)856:861 (<1%)953:958 (<1%) | view | |
| 6 | x 4 | neuron_viewer/src/Transf...bugger/cards/node_tableneuron_viewer/src/Transf...bugger/cards/node_tableneuron_viewer/src/Transf...bugger/cards/node_tableneuron_viewer/src/Transf...bugger/cards/node_table | 457:462 (<1%)474:479 (<1%)491:496 (<1%)512:517 (<1%) | view | |
| 6 | x 4 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 44:50 (1%)59:67 (<1%)34:41 (1%)114:121 (1%) | view | |
| 6 | x 3 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 320:326 (1%)441:447 (1%)710:716 (1%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 133:138 (1%)359:364 (1%)389:394 (1%) | view | |
| 6 | x 3 | neuron_viewer/src/TransformerDebugger/cardsneuron_viewer/src/TransformerDebugger/cardsneuron_viewer/src/TransformerDebugger/cards | 122:127 (4%)133:138 (4%)146:151 (4%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 236:242 (1%)278:284 (1%)317:323 (1%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 32:38 (1%)106:113 (1%)29:35 (<1%) | view | |
| 6 | x 3 | neuron_explainer/activationsneuron_explainer/activationsneuron_explainer/activations | 154:159 (2%)213:218 (2%)282:287 (2%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 177:187 (2%)215:223 (2%)250:262 (2%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 203:209 (1%)227:233 (1%)250:256 (1%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 205:210 (1%)229:234 (1%)252:257 (1%) | view | |
| 6 | x 3 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 28:35 (3%)20:31 (1%)27:33 (1%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 100:105 (2%)119:124 (2%)378:383 (2%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 33:41 (7%)80:87 (7%)100:107 (7%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 36:42 (7%)82:88 (7%)102:108 (7%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 159:164 (2%)210:215 (2%)255:260 (2%) | view | |
| 6 | x 3 | neuron_explainer/modelsneuron_explainer/modelsneuron_explainer/models | 36:41 (2%)227:232 (2%)350:355 (2%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 88:93 (1%)138:143 (1%)182:187 (1%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 160:165 (2%)211:216 (2%)256:261 (2%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 87:92 (1%)137:142 (1%)181:186 (1%) | view | |
| 6 | x 3 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 319:325 (1%)440:446 (1%)709:715 (1%) | view | |
| 6 | x 3 | neuron_viewer/src/TransformerDebugger/cardsneuron_viewer/src/TransformerDebugger/cardsneuron_viewer/src/TransformerDebugger/cards | 121:126 (4%)132:137 (4%)145:150 (4%) | view | |
| 6 | x 3 | neuron_explainer/activationsneuron_explainer/activationsneuron_explainer/activations | 153:158 (2%)212:217 (2%)281:286 (2%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 31:36 (<1%)34:39 (1%)109:114 (1%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 39:44 (7%)85:90 (7%)105:110 (7%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 32:40 (7%)79:86 (7%)99:106 (7%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 260:265 (1%)296:301 (1%)337:342 (1%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 240:245 (1%)282:287 (1%)321:326 (1%) | view | |
| 6 | x 3 | neuron_explainer/explanationsneuron_explainer/explanationsneuron_explainer/explanations | 318:324 (1%)439:445 (1%)708:714 (1%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 237:243 (1%)279:285 (1%)318:324 (1%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 360:365 (1%)390:395 (1%)493:498 (1%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 37:43 (7%)83:89 (7%)103:109 (7%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 35:41 (6%)561:567 (<1%)69:75 (6%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 175:185 (2%)213:221 (2%)248:260 (2%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 239:244 (1%)281:286 (1%)320:325 (1%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 176:186 (2%)214:222 (2%)249:261 (2%) | view | |
| 6 | x 3 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 261:266 (1%)297:302 (1%)338:343 (1%) | view |
Duplicated Units
The list of top 3 duplicated units.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 11 | x 2 | neuron_viewer/src/client/servicesneuron_viewer/src/client/services | 22:34 44:56 | view | |
| 9 | x 2 | neuron_viewer/src/client/servicesneuron_viewer/src/client/services | 42:52 88:98 | view | |
| 6 | x 2 | neuron_explainer/activations/derived_scalarsneuron_explainer/activations/derived_scalars | 149:156 77:84 | view |
About This Analysis
- For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
- Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
- You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
- To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:
- Avoid Repetition, MartinFlower.com (IEEE Software article)
- Refactoring duplicated code, sourcemaking.com
- Beck Design Rules, MartinFowler.com
- DRY (Don't Repeat Yourself) Principle, Wikipedia
- The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
- Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:
- "Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"
- Reducing Coupling, MartinFlower.com (IEEE Software article):
- "There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."