anthropics / orjson Duplication

anthropics / orjson

Duplication

Places in code with 6 or more lines that are exactly the same.

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."

Duplication Overall

19% duplication:

16,523 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
3,190 duplicated lines

354 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 354 duplicates...

Size	#	Folders	Files	Lines	Code
48	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	2458:2519 (<1%) 2579:2640 (<1%)	view
47	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	5838:5897 (<1%) 6229:6288 (<1%)	view
44	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	5985:6041 (<1%) 6393:6449 (<1%)	view
44	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	5743:5791 (<1%) 6121:6169 (<1%)	view
35	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8797:8838 (<1%) 8987:9028 (<1%)	view
34	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8246:8286 (<1%) 8430:8470 (<1%)	view
26	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8557:8588 (<1%) 9118:9149 (<1%)	view
24	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	6872:6896 (<1%) 6904:6928 (<1%)	view
23	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8500:8525 (<1%) 9059:9084 (<1%)	view
21	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8357:8383 (<1%) 8912:8938 (<1%)	view
20	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	5898:5929 (<1%) 6293:6324 (<1%)	view
19	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8527:8548 (<1%) 9086:9107 (<1%)	view
18	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	5950:5972 (<1%) 6358:6380 (<1%)	view
18	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	6094:6112 (<1%) 6503:6521 (<1%)	view
17	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8315:8333 (<1%) 8868:8886 (<1%)	view
16	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	5639:5656 (<1%) 6121:6138 (<1%)	view
16	x 2	src/serialize/writer src/serialize/writer	json.rs json.rs	281:300 (3%) 570:589 (3%)	view
16	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	5639:5656 (<1%) 5743:5760 (<1%)	view
16	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	6071:6092 (<1%) 6480:6501 (<1%)	view
15	x 2	src/serialize/writer src/serialize/writer	num.rs num.rs	53:71 (20%) 77:95 (20%)	view
14	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	7514:7527 (<1%) 7535:7548 (<1%)	view
14	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	4382:4401 (<1%) 4973:4992 (<1%)	view
14	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8335:8350 (<1%) 8888:8903 (<1%)	view
14	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	7472:7485 (<1%) 7493:7506 (<1%)	view
14	x 2	src/serialize/writer src/serialize/writer	json.rs json.rs	123:139 (3%) 157:173 (3%)	view
13	x 2	src/serialize/writer/str src/serialize/writer/str	generic.rs sse2.rs	10:25 (19%) 13:28 (16%)	view
13	x 2	src/serialize/per_type src/serialize/per_type	dict.rs dict.rs	306:320 (2%) 529:543 (2%)	view
13	x 2	src/serialize/per_type src/serialize/per_type	dict.rs dict.rs	250:264 (2%) 306:320 (2%)	view
13	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8602:8617 (<1%) 9164:9179 (<1%)	view
13	x 2	src/serialize/per_type src/serialize/per_type	dict.rs dict.rs	250:264 (2%) 529:543 (2%)	view
13	x 2	src/serialize/writer/str src/serialize/writer/str	generic.rs sse2.rs	40:56 (19%) 51:66 (16%)	view
12	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8395:8409 (<1%) 8951:8965 (<1%)	view
12	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	5930:5947 (<1%) 6326:6343 (<1%)	view
12	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8300:8312 (<1%) 8485:8497 (<1%)	view
12	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8224:8236 (<1%) 8616:8628 (<1%)	view
12	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8851:8863 (<1%) 9042:9054 (<1%)	view
12	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	7469:7480 (<1%) 7511:7522 (<1%)	view
12	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8965:8977 (<1%) 9179:9191 (<1%)	view
12	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	7490:7501 (<1%) 7532:7543 (<1%)	view
11	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	9257:9268 (<1%) 9283:9294 (<1%)	view
11	x 2	src/ffi src/ffi	pydictref.rs pynoneref.rs	58:76 (13%) 26:44 (36%)	view
11	x 2	src/serialize/writer src/serialize/writer	json.rs json.rs	228:241 (2%) 459:472 (2%)	view
11	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8225:8236 (<1%) 8409:8420 (<1%)	view
11	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8409:8420 (<1%) 8617:8628 (<1%)	view
11	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8248:8262 (<1%) 8990:9004 (<1%)	view
11	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	5260:5274 (<1%) 7812:7826 (<1%)	view
11	x 2	include/yyjson include/yyjson	yyjson.h yyjson.h	7122:7135 (<1%) 7189:7202 (<1%)	view
11	x 2	src/ffi src/ffi	pybytearrayref.rs pybytesref.rs	38:52 (23%) 38:52 (25%)	view
11	x 2	src/serialize/writer src/serialize/writer	json.rs json.rs	241:254 (2%) 539:552 (2%)	view
11	x 2	include/yyjson include/yyjson	yyjson.c yyjson.c	8248:8262 (<1%) 8800:8814 (<1%)	view

Most Frequent Duplicates

The list of 50 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 11	src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type ...	numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs ...	476:482 (<1%) 517:523 (<1%) 558:564 (<1%) 601:607 (<1%) 642:648 (<1%) 683:689 (<1%) 724:730 (<1%) 765:771 (<1%) 806:812 (<1%) 847:853 (<1%) ...	view
6	x 11	src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type ...	numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs numpy.rs ...	475:481 (<1%) 516:522 (<1%) 557:563 (<1%) 600:606 (<1%) 641:647 (<1%) 682:688 (<1%) 723:729 (<1%) 764:770 (<1%) 805:811 (<1%) 846:852 (<1%) ...	view
6	x 9	src/serialize/writer/str src/serialize/writer/str src/serialize/writer/str src/serialize/writer/str src/serialize/writer/str src/serialize/writer/str src/serialize/writer/str src/serialize/writer/str src/serialize/writer/str	escape.rs escape.rs escape.rs escape.rs escape.rs escape.rs escape.rs escape.rs escape.rs	77:82 (4%) 83:88 (4%) 89:94 (4%) 95:100 (4%) 101:106 (4%) 107:112 (4%) 113:118 (4%) 119:124 (4%) 125:130 (4%)	view
6	x 7	include/yyjson include/yyjson include/yyjson include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c yyjson.c yyjson.c yyjson.c	7635:7640 (<1%) 7647:7652 (<1%) 7653:7658 (<1%) 7659:7664 (<1%) 7665:7670 (<1%) 7671:7676 (<1%) 7677:7682 (<1%)	view
6	x 6	src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type	dict.rs dict.rs dict.rs dict.rs dict.rs dict.rs	259:264 (1%) 275:280 (1%) 315:320 (1%) 332:337 (1%) 538:543 (1%) 557:562 (1%)	view
6	x 5	include/yyjson include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c yyjson.c	8227:8233 (<1%) 8411:8417 (<1%) 8619:8625 (<1%) 8968:8974 (<1%) 9182:9188 (<1%)	view
6	x 5	src/ffi src/ffi src/ffi src/ffi src/ffi	pylistref.rs pynoneref.rs pyfragmentref.rs pydictref.rs pytupleref.rs	47:54 (10%) 34:41 (20%) 39:46 (13%) 66:73 (7%) 45:52 (13%)	view
6	x 5	src/ffi src/ffi src/ffi src/ffi src/ffi	pylistref.rs pynoneref.rs pyfragmentref.rs pydictref.rs pytupleref.rs	46:53 (10%) 33:40 (20%) 38:45 (13%) 65:72 (7%) 44:51 (13%)	view
6	x 5	include/yyjson include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c yyjson.c	8230:8235 (<1%) 8414:8419 (<1%) 8622:8627 (<1%) 8971:8976 (<1%) 9185:9190 (<1%)	view
6	x 5	include/yyjson include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c yyjson.c	8231:8236 (<1%) 8415:8420 (<1%) 8623:8628 (<1%) 8972:8977 (<1%) 9186:9191 (<1%)	view
6	x 5	src/ffi src/ffi src/ffi src/ffi src/ffi	pylistref.rs pynoneref.rs pyfragmentref.rs pydictref.rs pytupleref.rs	45:52 (10%) 32:39 (20%) 37:44 (13%) 64:71 (7%) 43:50 (13%)	view
6	x 5	include/yyjson include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c yyjson.c	8229:8234 (<1%) 8413:8418 (<1%) 8621:8626 (<1%) 8970:8975 (<1%) 9184:9189 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	3694:3699 (<1%) 3707:3712 (<1%) 3713:3718 (<1%) 3719:3724 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	5838:5844 (<1%) 6000:6006 (<1%) 6229:6235 (<1%) 6408:6414 (<1%)	view
6	x 4	src/ffi src/ffi src/ffi src/ffi	pyfragmentref.rs pynoneref.rs pydictref.rs pytupleref.rs	31:40 (13%) 26:35 (20%) 58:67 (7%) 37:46 (13%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8397:8404 (<1%) 8606:8613 (<1%) 8953:8960 (<1%) 9168:9175 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	7475:7480 (<1%) 7496:7501 (<1%) 7517:7522 (<1%) 7538:7543 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8249:8256 (<1%) 8433:8440 (<1%) 8801:8808 (<1%) 8991:8998 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8274:8281 (<1%) 8458:8465 (<1%) 8826:8833 (<1%) 9016:9023 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8252:8257 (<1%) 8436:8441 (<1%) 8804:8809 (<1%) 8994:8999 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8273:8280 (<1%) 8457:8464 (<1%) 8825:8832 (<1%) 9015:9022 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8396:8403 (<1%) 8605:8612 (<1%) 8952:8959 (<1%) 9167:9174 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8248:8255 (<1%) 8432:8439 (<1%) 8800:8807 (<1%) 8990:8997 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8272:8277 (<1%) 8456:8461 (<1%) 8824:8829 (<1%) 9014:9019 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8675:8680 (<1%) 8701:8706 (<1%) 9258:9263 (<1%) 9284:9289 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	7472:7477 (<1%) 7493:7498 (<1%) 7514:7519 (<1%) 7535:7540 (<1%)	view
6	x 4	src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type	numpy.rs pytorch.rs numpy.rs numpy.rs	34:39 (<1%) 23:28 (7%) 324:329 (<1%) 968:973 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8253:8260 (<1%) 8437:8444 (<1%) 8805:8812 (<1%) 8995:9002 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8255:8262 (<1%) 8439:8446 (<1%) 8807:8814 (<1%) 8997:9004 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8275:8282 (<1%) 8459:8466 (<1%) 8827:8834 (<1%) 9017:9024 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8254:8261 (<1%) 8438:8445 (<1%) 8806:8813 (<1%) 8996:9003 (<1%)	view
6	x 4	src/ffi src/ffi src/ffi src/ffi	pyfragmentref.rs pynoneref.rs pydictref.rs pytupleref.rs	32:43 (13%) 27:38 (20%) 59:70 (7%) 38:49 (13%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8323:8329 (<1%) 8512:8518 (<1%) 8876:8882 (<1%) 9071:9077 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	7474:7479 (<1%) 7495:7500 (<1%) 7516:7521 (<1%) 7537:7542 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8271:8276 (<1%) 8455:8460 (<1%) 8823:8828 (<1%) 9013:9018 (<1%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	7473:7478 (<1%) 7494:7499 (<1%) 7515:7520 (<1%) 7536:7541 (<1%)	view
6	x 4	src/serialize/per_type src/serialize/per_type src/serialize/per_type src/serialize/per_type	datetime.rs datetime.rs datetime.rs datetime.rs	189:194 (3%) 200:205 (3%) 209:214 (3%) 229:234 (3%)	view
6	x 4	include/yyjson include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c yyjson.c	8264:8269 (<1%) 8448:8453 (<1%) 8816:8821 (<1%) 9006:9011 (<1%)	view
6	x 3	src/serialize/writer/str src/serialize/writer/str src/serialize/writer/str	generic.rs sse2.rs avx512.rs	46:51 (8%) 57:62 (7%) 46:51 (9%)	view
6	x 3	include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c	8226:8232 (<1%) 8410:8416 (<1%) 8618:8624 (<1%)	view
6	x 3	include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c	5720:5726 (<1%) 6095:6101 (<1%) 6504:6510 (<1%)	view
6	x 3	src/deserialize/backend src/deserialize/backend src/deserialize/backend	yyjson.rs yyjson.rs yyjson.rs	120:125 (2%) 264:269 (2%) 335:340 (2%)	view
6	x 3	src/deserialize/backend src/deserialize/backend src/deserialize/backend	yyjson.rs yyjson.rs yyjson.rs	118:123 (2%) 262:267 (2%) 333:338 (2%)	view
6	x 3	src/serialize/per_type src/serialize/per_type src/serialize/per_type	dict.rs dict.rs dict.rs	251:257 (1%) 307:313 (1%) 530:536 (1%)	view
6	x 3	src/serialize/writer/str src/serialize/writer/str src/serialize/writer/str	generic.rs sse2.rs avx512.rs	45:50 (8%) 56:61 (7%) 44:50 (9%)	view
6	x 3	include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c	5708:5716 (<1%) 6083:6091 (<1%) 6492:6500 (<1%)	view
6	x 3	src/serialize/per_type src/serialize/per_type src/serialize/per_type	dict.rs dict.rs dict.rs	253:260 (1%) 309:316 (1%) 532:539 (1%)	view
6	x 3	include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c	5642:5649 (<1%) 5746:5753 (<1%) 6124:6131 (<1%)	view
6	x 3	include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c	5651:5656 (<1%) 5755:5760 (<1%) 6133:6138 (<1%)	view
6	x 3	include/yyjson include/yyjson include/yyjson	yyjson.c yyjson.c yyjson.c	5646:5651 (<1%) 5750:5755 (<1%) 6128:6133 (<1%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
6	x 2	src/serialize/per_type src/serialize/per_type	datetime.rs uuid.rs	76:83 39:46	view