Duplication · Netflix/rend

Duplication Overall

23% duplication:

6,485 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,494 duplicated lines

118 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 118 duplicates...

Size	#	Folders	Files	Lines	Code
59	x 2	client/cmd/blast client/cmd/setops	main.go main.go	178:264 (28%) 161:247 (33%)	view
44	x 2	orcas orcas	l1l2.go l1l2batch.go	525:600 (11%) 476:551 (12%)	view
39	x 2	handlers/memcached/batched handlers/memcached/batched	handler.go handler.go	306:368 (16%) 391:453 (16%)	view
28	x 2	orcas orcas	l1l2.go l1l2batch.go	393:453 (7%) 349:409 (8%)	view
28	x 2	client/cmd/blast client/cmd/setops	main.go main.go	39:79 (13%) 39:79 (15%)	view
27	x 2	orcas orcas	l1l2.go l1l2batch.go	278:329 (6%) 234:285 (7%)	view
27	x 2	orcas orcas	l1l2.go l1l2batch.go	335:386 (6%) 291:342 (7%)	view
25	x 2	client/cmd/blast client/cmd/setops	main.go main.go	133:170 (12%) 119:156 (14%)	view
19	x 2	protocol/binprot protocol/binprot	parser.go parser.go	331:361 (7%) 400:430 (7%)	view
18	x 2	client/cmd/blast client/cmd/setops	main.go main.go	311:338 (8%) 278:305 (10%)	view
16	x 2	orcas orcas	l1l2.go l1l2batch.go	671:692 (4%) 579:600 (4%)	view
15	x 2	orcas orcas	locked.go locked.go	221:241 (8%) 277:297 (8%)	view
15	x 2	client/cmd/blast client/cmd/setops	main.go main.go	266:282 (7%) 248:264 (8%)	view
14	x 2	orcas orcas	l1l2batch.go l1only.go	512:535 (4%) 254:276 (6%)	view
14	x 2	orcas orcas	l1l2.go l1only.go	561:584 (3%) 254:276 (6%)	view
13	x 2	protocol/binprot protocol/binprot	parser.go parser.go	308:325 (4%) 377:394 (4%)	view
13	x 2	orcas orcas	l1l2.go l1l2batch.go	119:142 (3%) 113:136 (3%)	view
13	x 2	orcas orcas	l1l2.go l1l2batch.go	192:215 (3%) 169:192 (3%)	view
13	x 2	orcas orcas	l1l2.go l1l2batch.go	460:487 (3%) 416:443 (3%)	view
12	x 2	metrics timer	s lzcnt_amd64.s timer_linux_amd64.s	2:13 (41%) 2:13 (41%)	view
11	x 2	client/cmd/blast client/cmd/setops	main.go main.go	105:121 (5%) 99:115 (6%)	view
11	x 2	handlers/memcached/chunked handlers/memcached/std	handler.go handler.go	99:116 (2%) 26:43 (7%)	view
10	x 2	client/cmd/blast client/cmd/blast	main.go main.go	184:194 (4%) 208:218 (4%)	view
10	x 2	client/cmd/setops client/cmd/setops	main.go main.go	167:177 (5%) 191:201 (5%)	view
10	x 2	client/binprot client/binprot	prot.go prot.go	65:82 (6%) 89:106 (6%)	view
10	x 2	client/cmd/blast client/cmd/setops	main.go main.go	184:194 (4%) 191:201 (5%)	view
10	x 2	client/cmd/blast client/cmd/setops	main.go main.go	208:218 (4%) 167:177 (5%)	view
10	x 2	client/cmd/fill client/cmd/setget	main.go main.go	35:48 (23%) 38:51 (12%)	view
9	x 2	handlers/inmem handlers/inmem	inmem.go inmem.go	53:65 (5%) 79:91 (5%)	view
9	x 2	handlers/inmem handlers/inmem	inmem.go inmem.go	53:65 (5%) 105:117 (5%)	view
9	x 2	handlers/inmem handlers/inmem	inmem.go inmem.go	79:91 (5%) 105:117 (5%)	view
9	x 2	orcas orcas	l1l2.go l1l2batch.go	45:58 (2%) 45:58 (2%)	view
9	x 2	handlers/memcached/chunked handlers/memcached/std	handler.go handler.go	255:273 (2%) 110:128 (6%)	view
8	x 2	handlers/memcached/batched handlers/memcached/batched	handler.go handler.go	140:150 (3%) 310:320 (3%)	view
8	x 2	handlers/memcached/batched handlers/memcached/batched	handler.go handler.go	140:150 (3%) 395:405 (3%)	view
8	x 2	handlers/memcached/chunked handlers/memcached/chunked	handler.go handler.go	557:573 (1%) 681:697 (1%)	view
8	x 2	protocol/binprot protocol/binprot	parser.go parser.go	458:467 (2%) 486:495 (2%)	view
8	x 2	protocol/binprot protocol/binprot	headers.go headers.go	152:163 (5%) 213:224 (5%)	view
8	x 2	orcas orcas	l1only.go l1only.go	238:251 (3%) 303:316 (3%)	view
8	x 2	orcas orcas	l1l2.go l1l2batch.go	752:764 (2%) 633:653 (2%)	view
8	x 2	protocol/binprot protocol/textprot	components.go components.go	36:47 (53%) 36:47 (53%)	view
8	x 2	handlers/memcached/chunked handlers/memcached/std	handler.go handler.go	468:484 (1%) 137:146 (5%)	view
8	x 2	orcas orcas	l1l2batch.go l1only.go	501:508 (2%) 245:252 (3%)	view
8	x 2	orcas orcas	l1l2.go l1only.go	550:557 (2%) 245:252 (3%)	view
7	x 2	handlers/memcached/chunked handlers/memcached/chunked	handler.go handler.go	755:766 (1%) 805:816 (1%)	view
7	x 2	client/binprot client/binprot	prot.go prot.go	184:194 (4%) 206:216 (4%)	view
7	x 2	handlers/inmem handlers/inmem	inmem.go inmem.go	121:131 (3%) 142:152 (3%)	view
7	x 2	handlers/inmem handlers/inmem	inmem.go inmem.go	186:196 (3%) 224:234 (3%)	view
7	x 2	orcas orcas	locked.go locked.go	86:94 (3%) 108:116 (3%)	view
7	x 2	handlers/memcached/batched handlers/memcached/batched	conn.go conn.go	367:375 (1%) 380:388 (1%)	view

Most Frequent Duplicates

The list of 32 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 8	handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched	conn.go conn.go conn.go conn.go conn.go conn.go conn.go conn.go	368:375 (1%) 381:388 (1%) 394:401 (1%) 407:414 (1%) 420:427 (1%) 432:439 (1%) 444:451 (1%) 456:463 (1%)	view
6	x 5	orcas orcas orcas orcas orcas	l1l2.go l1only.go l1l2batch.go l1only.go l1l2batch.go	550:555 (1%) 245:250 (2%) 501:506 (1%) 310:315 (2%) 560:565 (1%)	view
6	x 5	orcas orcas orcas orcas orcas	l1l2.go l1only.go l1l2batch.go l1only.go l1l2batch.go	551:556 (1%) 246:251 (2%) 502:507 (1%) 311:316 (2%) 561:566 (1%)	view
6	x 5	handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched	conn.go conn.go conn.go conn.go conn.go	367:372 (1%) 380:385 (1%) 393:398 (1%) 406:411 (1%) 419:424 (1%)	view
6	x 5	client/textprot client/textprot client/textprot client/textprot client/textprot	prot.go prot.go prot.go prot.go prot.go	34:44 (4%) 59:69 (4%) 84:94 (4%) 244:253 (4%) 267:276 (4%)	view
6	x 5	client/textprot client/textprot client/textprot client/textprot client/textprot	prot.go prot.go prot.go prot.go prot.go	37:45 (4%) 62:70 (4%) 87:95 (4%) 247:254 (4%) 270:277 (4%)	view
6	x 4	client/cmd/blast client/cmd/setops client/cmd/setops client/cmd/blast	main.go main.go main.go main.go	188:194 (2%) 171:177 (3%) 195:201 (3%) 212:218 (2%)	view
6	x 4	client/cmd/blast client/cmd/setops client/cmd/setops client/cmd/blast	main.go main.go main.go main.go	185:190 (2%) 168:173 (3%) 192:197 (3%) 209:214 (2%)	view
6	x 4	handlers/inmem handlers/inmem handlers/inmem handlers/inmem	inmem.go inmem.go inmem.go inmem.go	95:102 (3%) 121:128 (3%) 142:149 (3%) 279:286 (3%)	view
6	x 4	client/cmd/blast client/cmd/setops client/cmd/setops client/cmd/blast	main.go main.go main.go main.go	187:192 (2%) 170:175 (3%) 194:199 (3%) 211:216 (2%)	view
6	x 4	client/cmd/blast client/cmd/setops client/cmd/setops client/cmd/blast	main.go main.go main.go main.go	184:189 (2%) 167:172 (3%) 191:196 (3%) 208:213 (2%)	view
6	x 4	client/cmd/blast client/cmd/setops client/cmd/setops client/cmd/blast	main.go main.go main.go main.go	186:191 (2%) 169:174 (3%) 193:198 (3%) 210:215 (2%)	view
6	x 3	handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched	handler.go handler.go handler.go	141:147 (2%) 311:317 (2%) 396:402 (2%)	view
6	x 3	handlers/inmem handlers/inmem handlers/inmem	inmem.go inmem.go inmem.go	53:60 (3%) 79:86 (3%) 105:112 (3%)	view
6	x 3	handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched	handler.go handler.go handler.go	140:146 (2%) 310:316 (2%) 395:401 (2%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	897:905 (1%) 399:407 (2%) 710:718 (1%)	view
6	x 3	handlers/memcached/chunked handlers/memcached/std handlers/memcached/std	localComm.go localComm.go localComm.go	56:63 (7%) 36:42 (13%) 64:70 (13%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	563:571 (1%) 256:264 (2%) 514:522 (1%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	552:557 (1%) 247:252 (2%) 503:508 (1%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	571:579 (1%) 264:272 (2%) 522:530 (1%)	view
6	x 3	handlers/inmem handlers/inmem handlers/inmem	inmem.go inmem.go inmem.go	58:65 (3%) 84:91 (3%) 110:117 (3%)	view
6	x 3	handlers/inmem handlers/inmem handlers/inmem	inmem.go inmem.go inmem.go	55:64 (3%) 81:90 (3%) 107:116 (3%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	525:539 (1%) 224:238 (2%) 476:490 (1%)	view
6	x 3	handlers/inmem handlers/inmem handlers/inmem	inmem.go inmem.go inmem.go	54:61 (3%) 80:87 (3%) 106:113 (3%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	569:574 (1%) 262:267 (2%) 520:525 (1%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	562:570 (1%) 255:263 (2%) 513:521 (1%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	568:573 (1%) 261:266 (2%) 519:524 (1%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	570:578 (1%) 263:271 (2%) 521:529 (1%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	561:569 (1%) 254:262 (2%) 512:520 (1%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	564:572 (1%) 258:265 (2%) 515:523 (1%)	view
6	x 3	handlers/memcached/batched handlers/memcached/batched handlers/memcached/batched	handler.go handler.go handler.go	143:150 (2%) 313:320 (2%) 398:405 (2%)	view
6	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	572:584 (1%) 265:276 (2%) 523:535 (1%)	view

Duplicated Units

The list of top 7 duplicated units.

See data for all 7 unit duplicates...

Size	#	Folders	Files	Lines	Code
32	x 2	orcas orcas	l1l2.go l1l2batch.go	389:454 345:410	view
31	x 2	orcas orcas	l1l2.go l1l2batch.go	264:330 221:286	view
31	x 2	orcas orcas	l1l2.go l1l2batch.go	332:387 288:343	view
10	x 2	handlers/memcached/chunked handlers/memcached/std	handler.go handler.go	99:112 26:39	view
9	x 2	client/cmd/setops client/cmd/blast	main.go main.go	223:235 240:252	view
8	x 2	client/cmd/setops client/cmd/blast	main.go main.go	295:306 328:339	view
7	x 3	orcas orcas orcas	l1l2.go l1only.go l1l2batch.go	896:906 398:408 709:719	view

About This Analysis

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."