anthropics / knowledge-work-plugins Duplication

anthropics / knowledge-work-plugins

Duplication

Places in code with 6 or more lines that are exactly the same.

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."

Duplication Overall

7% duplication:

9,182 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
684 duplicated lines

138 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 138 duplicates...

Size	#	Folders	Files	Lines	Code
28	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1611:1640 (1%) 2055:2084 (1%)	view
23	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	2095:2119 (<1%) 2410:2434 (<1%)	view
23	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1550:1575 (<1%) 2267:2292 (<1%)	view
21	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1524:1547 (<1%) 2241:2264 (<1%)	view
20	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1500:1521 (<1%) 2329:2350 (<1%)	view
13	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	231:248 (2%) 603:620 (2%)	view
13	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	208:226 (2%) 578:597 (2%)	view
11	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1578:1590 (<1%) 2295:2307 (<1%)	view
10	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1511:1521 (<1%) 1630:1640 (<1%)	view
10	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1630:1640 (<1%) 2311:2321 (<1%)	view
10	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	2074:2084 (<1%) 2311:2321 (<1%)	view
10	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1630:1640 (<1%) 2340:2350 (<1%)	view
10	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1511:1521 (<1%) 2074:2084 (<1%)	view
10	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	2074:2084 (<1%) 2340:2350 (<1%)	view
10	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	2311:2321 (<1%) 2340:2350 (<1%)	view
10	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1511:1521 (<1%) 2311:2321 (<1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	101:110 (1%) 233:243 (1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	158:167 (1%) 233:243 (1%)	view
9	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1566:1575 (<1%) 2255:2264 (<1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	158:167 (1%) 605:615 (1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	158:167 (1%) 214:225 (1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	233:243 (1%) 584:595 (1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	214:225 (1%) 233:243 (1%)	view
9	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1538:1547 (<1%) 1566:1575 (<1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	214:225 (1%) 605:615 (1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	584:595 (1%) 605:615 (1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	158:167 (1%) 584:595 (1%)	view
9	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1538:1547 (<1%) 2283:2292 (<1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	101:110 (1%) 158:167 (1%)	view
9	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	2652:2660 (<1%) 2703:2711 (<1%)	view
9	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	2255:2264 (<1%) 2283:2292 (<1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	101:110 (1%) 584:595 (1%)	view
9	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	233:241 (<1%) 609:617 (<1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	101:110 (1%) 214:225 (1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	101:110 (1%) 605:615 (1%)	view
9	x 2	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py	97:107 (1%) 512:522 (1%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1539:1547 (<1%) 2313:2321 (<1%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1632:1640 (<1%) 2284:2292 (<1%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	2256:2264 (<1%) 2313:2321 (<1%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1539:1547 (<1%) 2076:2084 (<1%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	2256:2264 (<1%) 2342:2350 (<1%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1592:1600 (<1%) 1632:1640 (<1%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1539:1547 (<1%) 2342:2350 (<1%)	view
8	x 2	bio-research/skills/inst...ta-to-allotrope/scripts bio-research/skills/inst...ta-to-allotrope/scripts	export_parser.py export_parser.py	396:403 (3%) 420:427 (3%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1592:1600 (<1%) 2342:2350 (<1%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1567:1575 (<1%) 1592:1600 (<1%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	2076:2084 (<1%) 2284:2292 (<1%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1592:1600 (<1%) 2076:2084 (<1%)	view
8	x 2	productivity/skills productivity/skills	dashboard.html dashboard.html	1513:1521 (<1%) 1567:1575 (<1%)	view
8	x 2	bio-research/skills/scvi-tools/scripts bio-research/skills/scvi-tools/scripts	model_utils.py prepare_data.py	90:97 (2%) 83:90 (9%)	view

Most Frequent Duplicates

The list of 18 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 10	productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills	dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html	1513:1519 (<1%) 1539:1545 (<1%) 1567:1573 (<1%) 1592:1598 (<1%) 1632:1638 (<1%) 2076:2082 (<1%) 2256:2262 (<1%) 2284:2290 (<1%) 2313:2319 (<1%) 2342:2348 (<1%)	view
6	x 10	productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills	dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html	1516:1521 (<1%) 1542:1547 (<1%) 1570:1575 (<1%) 1595:1600 (<1%) 1635:1640 (<1%) 2079:2084 (<1%) 2259:2264 (<1%) 2287:2292 (<1%) 2316:2321 (<1%) 2345:2350 (<1%)	view
6	x 10	productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills	dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html	1514:1520 (<1%) 1540:1546 (<1%) 1568:1574 (<1%) 1593:1599 (<1%) 1633:1639 (<1%) 2077:2083 (<1%) 2257:2263 (<1%) 2285:2291 (<1%) 2314:2320 (<1%) 2343:2349 (<1%)	view
6	x 9	bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts	manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py	33:38 (1%) 45:50 (1%) 58:63 (1%) 70:75 (1%) 83:88 (1%) 107:112 (1%) 120:125 (1%) 143:148 (1%) 156:161 (1%)	view
6	x 9	bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts bio-research/skills/nextflow-development/scripts	manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py manage_genomes.py	32:37 (1%) 44:49 (1%) 57:62 (1%) 69:74 (1%) 82:87 (1%) 106:111 (1%) 119:124 (1%) 142:147 (1%) 155:160 (1%)	view
6	x 7	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py	102:107 (1%) 159:164 (1%) 215:220 (1%) 234:239 (1%) 517:522 (1%) 585:590 (1%) 606:611 (1%)	view
6	x 7	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py	101:106 (1%) 158:163 (1%) 214:219 (1%) 233:238 (1%) 516:521 (1%) 584:589 (1%) 605:610 (1%)	view
6	x 6	productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills	dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html	1501:1507 (<1%) 1556:1562 (<1%) 1612:1618 (<1%) 2056:2062 (<1%) 2273:2279 (<1%) 2330:2336 (<1%)	view
6	x 6	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py	103:109 (1%) 160:166 (1%) 216:222 (1%) 235:241 (1%) 586:592 (1%) 607:613 (1%)	view
6	x 6	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py ncbi_utils.py	104:110 (1%) 161:167 (1%) 217:225 (1%) 236:243 (1%) 587:595 (1%) 608:615 (1%)	view
6	x 5	productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills	dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html	1511:1517 (<1%) 1630:1636 (<1%) 2074:2080 (<1%) 2311:2317 (<1%) 2340:2346 (<1%)	view
6	x 5	productivity/skills productivity/skills productivity/skills productivity/skills productivity/skills	dashboard.html dashboard.html dashboard.html dashboard.html dashboard.html	1512:1518 (<1%) 1631:1637 (<1%) 2075:2081 (<1%) 2312:2318 (<1%) 2341:2347 (<1%)	view
6	x 4	productivity/skills productivity/skills productivity/skills productivity/skills	dashboard.html dashboard.html dashboard.html dashboard.html	1500:1506 (<1%) 1611:1617 (<1%) 2055:2061 (<1%) 2329:2335 (<1%)	view
6	x 4	productivity/skills productivity/skills productivity/skills productivity/skills	dashboard.html dashboard.html dashboard.html dashboard.html	1538:1544 (<1%) 1566:1572 (<1%) 2255:2261 (<1%) 2283:2289 (<1%)	view
6	x 3	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py ncbi_utils.py	118:123 (1%) 174:179 (1%) 547:552 (1%)	view
6	x 3	bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils bio-research/skills/next...velopment/scripts/utils	ncbi_utils.py ncbi_utils.py ncbi_utils.py	119:124 (1%) 175:180 (1%) 548:553 (1%)	view
6	x 3	bio-research/skills/scvi-tools/scripts bio-research/skills/scvi-tools/scripts bio-research/skills/scvi-tools/scripts	model_utils.py train_model.py integrate_datasets.py	174:181 (1%) 64:72 (2%) 103:109 (4%)	view
6	x 3	bio-research/skills/scvi-tools/scripts bio-research/skills/scvi-tools/scripts bio-research/skills/scvi-tools/scripts	model_utils.py train_model.py integrate_datasets.py	173:178 (1%) 63:70 (2%) 102:107 (4%)	view