Duplication · openai/penda

Duplication Overall

29% duplication:

5,658 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,691 duplicated lines

13,705 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 13,705 duplicates...

Size	#	Folders	Files	Lines	Code
35	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	4565:4599 (<1%) 4802:4836 (<1%)	view
20	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	4067:4086 (<1%) 4197:4216 (<1%)	view
11	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2791:2801 (<1%) 2848:2858 (<1%)	view
11	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2791:2801 (<1%) 3024:3034 (<1%)	view
11	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2848:2858 (<1%) 3024:3034 (<1%)	view
11	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	4131:4141 (<1%) 4160:4170 (<1%)	view
10	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	1017:1026 (<1%) 1515:1524 (<1%)	view
10	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2751:2760 (<1%) 3062:3071 (<1%)	view
10	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	3126:3135 (<1%) 3140:3149 (<1%)	view
10	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	4884:4893 (<1%) 5014:5023 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	459:467 (<1%) 768:776 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	459:467 (<1%) 921:929 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	459:467 (<1%) 1326:1334 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	459:467 (<1%) 2893:2901 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	459:467 (<1%) 3127:3135 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	459:467 (<1%) 3141:3149 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	459:467 (<1%) 4102:4110 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	459:467 (<1%) 4133:4141 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	459:467 (<1%) 4162:4170 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	768:776 (<1%) 921:929 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	768:776 (<1%) 1326:1334 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	768:776 (<1%) 2893:2901 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	768:776 (<1%) 3127:3135 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	768:776 (<1%) 3141:3149 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	768:776 (<1%) 4102:4110 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	768:776 (<1%) 4133:4141 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	768:776 (<1%) 4162:4170 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	921:929 (<1%) 1326:1334 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	921:929 (<1%) 2893:2901 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	921:929 (<1%) 3127:3135 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	921:929 (<1%) 3141:3149 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	921:929 (<1%) 4102:4110 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	921:929 (<1%) 4133:4141 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	921:929 (<1%) 4162:4170 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	1326:1334 (<1%) 2893:2901 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	1326:1334 (<1%) 3127:3135 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	1326:1334 (<1%) 3141:3149 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	1326:1334 (<1%) 4102:4110 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	1326:1334 (<1%) 4133:4141 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	1326:1334 (<1%) 4162:4170 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2376:2384 (<1%) 2472:2480 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2376:2384 (<1%) 3471:3479 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2472:2480 (<1%) 3471:3479 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2752:2760 (<1%) 2793:2801 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2752:2760 (<1%) 2850:2858 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2752:2760 (<1%) 3026:3034 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2793:2801 (<1%) 3063:3071 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2809:2817 (<1%) 3114:3122 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2809:2817 (<1%) 3128:3136 (<1%)	view
9	x 2	ROOT ROOT	analysis_os.ipynb analysis_os.ipynb	2850:2858 (<1%) 3063:3071 (<1%)	view

Most Frequent Duplicates

The list of 10 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 163	ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ...	analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb ...	9:14 (<1%) 50:55 (<1%) 65:70 (<1%) 98:103 (<1%) 131:136 (<1%) 151:156 (<1%) 188:193 (<1%) 200:205 (<1%) 209:214 (<1%) 226:231 (<1%) ...	view
6	x 163	ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ...	analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb ...	10:15 (<1%) 51:56 (<1%) 66:71 (<1%) 99:104 (<1%) 132:137 (<1%) 152:157 (<1%) 189:194 (<1%) 201:206 (<1%) 210:215 (<1%) 227:232 (<1%) ...	view
6	x 163	ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ...	analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb ...	8:13 (<1%) 49:54 (<1%) 64:69 (<1%) 97:102 (<1%) 130:135 (<1%) 150:155 (<1%) 187:192 (<1%) 199:204 (<1%) 208:213 (<1%) 225:230 (<1%) ...	view
6	x 32	ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ...	analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb ...	123:128 (<1%) 180:185 (<1%) 218:223 (<1%) 308:313 (<1%) 375:380 (<1%) 382:387 (<1%) 479:484 (<1%) 518:523 (<1%) 680:685 (<1%) 934:939 (<1%) ...	view
6	x 10	ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT ROOT	analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb	459:464 (<1%) 768:773 (<1%) 921:926 (<1%) 1326:1331 (<1%) 2893:2898 (<1%) 3127:3132 (<1%) 3141:3146 (<1%) 4102:4107 (<1%) 4133:4138 (<1%) 4162:4167 (<1%)	view
6	x 5	ROOT ROOT ROOT ROOT ROOT	analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb	2755:2760 (<1%) 2796:2801 (<1%) 2853:2858 (<1%) 3029:3034 (<1%) 3066:3071 (<1%)	view
6	x 3	ROOT ROOT ROOT	analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb	2812:2817 (<1%) 3117:3122 (<1%) 3131:3136 (<1%)	view
6	x 3	ROOT ROOT ROOT	analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb	2792:2797 (<1%) 2849:2854 (<1%) 3025:3030 (<1%)	view
6	x 3	ROOT ROOT ROOT	analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb	2376:2381 (<1%) 2472:2477 (<1%) 3471:3476 (<1%)	view
6	x 3	ROOT ROOT ROOT	analysis_os.ipynb analysis_os.ipynb analysis_os.ipynb	2791:2796 (<1%) 2848:2853 (<1%) 3024:3029 (<1%)	view

About This Analysis

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."