apache / incubator-pegasus

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

11% duplication:

129,193 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
15,075 duplicated lines

20,822 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 20,822 duplicates...

Size	#	Folders	Files	Lines	Code
92	x 2	go-client/idl/rrdb/meta-remote go-client/idl/rrdb/rrdb-remote	meta-remote.go rrdb-remote.go	31:144 (69%) 45:158 (20%)	view
49	x 2	src/shell/commands src/shell/commands	data_operations.cpp data_operations.cpp	1636:1691 (2%) 2358:2413 (2%)	view
48	x 2	src/shell/commands src/shell/commands	data_operations.cpp data_operations.cpp	1637:1691 (2%) 2001:2055 (2%)	view
48	x 2	src/shell/commands src/shell/commands	data_operations.cpp data_operations.cpp	2001:2055 (2%) 2359:2413 (2%)	view
45	x 2	go-client/idl/admin go-client/idl/admin	duplication.go partition_split.go	859:924 (2%) 420:485 (2%)	view
38	x 2	go-client/idl/admin go-client/idl/admin	bulk_load.go partition_split.go	2733:2788 (1%) 3090:3145 (1%)	view
38	x 2	go-client/idl/radmin go-client/idl/radmin	replica_admin.go replica_admin.go	1796:1851 (1%) 2353:2408 (1%)	view
37	x 2	go-client/idl/admin go-client/idl/admin	backup.go backup.go	956:1006 (1%) 3572:3622 (1%)	view
37	x 2	go-client/idl/admin go-client/idl/admin	partition_split.go partition_split.go	2026:2076 (1%) 2320:2370 (1%)	view
32	x 2	src/shell/commands src/shell/commands	data_operations.cpp data_operations.cpp	1284:1318 (1%) 1525:1559 (1%)	view
32	x 2	cmake_modules cmake_modules	FindDL.cmake FindRT.cmake	1:35 (40%) 1:35 (40%)	view
32	x 2	src/shell/commands src/shell/commands	data_operations.cpp data_operations.cpp	1408:1443 (1%) 2378:2413 (1%)	view
32	x 2	src/shell/commands src/shell/commands	data_operations.cpp data_operations.cpp	1408:1443 (1%) 2020:2055 (1%)	view
32	x 2	src/shell/commands src/shell/commands	data_operations.cpp data_operations.cpp	1408:1443 (1%) 1656:1691 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	bulk_load.go partition_split.go	3328:3373 (1%) 111:156 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/radmin	bulk_load.go replica_admin.go	4419:4464 (1%) 1988:2033 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go bulk_load.go	669:712 (<1%) 1773:1816 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go bulk_load.go	1243:1288 (<1%) 708:753 (1%)	view
31	x 2	go-client/idl/radmin go-client/idl/radmin	replica_admin.go replica_admin.go	1988:2033 (1%) 2648:2693 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	bulk_load.go partition_split.go	4419:4464 (1%) 651:696 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	bulk_load.go partition_split.go	4419:4464 (1%) 260:305 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go partition_split.go	1243:1288 (<1%) 260:305 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/radmin	bulk_load.go replica_admin.go	4419:4464 (1%) 2648:2693 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go backup.go	1243:1288 (<1%) 1838:1883 (<1%)	view
31	x 2	go-client/idl/admin go-client/idl/radmin	backup.go replica_admin.go	1838:1883 (<1%) 2648:2693 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go backup.go	1243:1288 (<1%) 2311:2356 (<1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go bulk_load.go	1243:1288 (<1%) 4419:4464 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/radmin	backup.go replica_admin.go	1838:1883 (<1%) 1988:2033 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go bulk_load.go	1243:1288 (<1%) 3487:3532 (1%)	view
31	x 2	go-client/idl/cmd go-client/idl/replication	command.go dsn.layer2.go	41:86 (9%) 761:806 (2%)	view
31	x 2	go-client/idl/admin go-client/idl/radmin	partition_split.go replica_admin.go	651:696 (1%) 2648:2693 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	bulk_load.go duplication.go	3189:3234 (1%) 1084:1129 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/radmin	partition_split.go replica_admin.go	651:696 (1%) 1988:2033 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go partition_split.go	1838:1883 (<1%) 260:305 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go partition_split.go	1838:1883 (<1%) 651:696 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go bulk_load.go	2311:2356 (<1%) 708:753 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go bulk_load.go	1838:1883 (<1%) 3487:3532 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	bulk_load.go bulk_load.go	708:753 (1%) 4419:4464 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/radmin	bulk_load.go replica_admin.go	3487:3532 (1%) 2648:2693 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go backup.go	1838:1883 (<1%) 2311:2356 (<1%)	view
31	x 2	go-client/idl/admin go-client/idl/replication	metadata.go dsn.layer2.go	1007:1050 (3%) 227:270 (2%)	view
31	x 2	go-client/idl/admin go-client/idl/radmin	backup.go replica_admin.go	2311:2356 (<1%) 2648:2693 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go bulk_load.go	1838:1883 (<1%) 4419:4464 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	bulk_load.go bulk_load.go	708:753 (1%) 3487:3532 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	bulk_load.go bulk_load.go	3487:3532 (1%) 4419:4464 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	partition_split.go partition_split.go	260:305 (1%) 651:696 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/radmin	bulk_load.go replica_admin.go	708:753 (1%) 2648:2693 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/radmin	backup.go replica_admin.go	237:280 (<1%) 943:986 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	bulk_load.go partition_split.go	708:753 (1%) 651:696 (1%)	view
31	x 2	go-client/idl/admin go-client/idl/admin	backup.go bulk_load.go	1838:1883 (<1%) 708:753 (1%)	view

Duplicated Units

The list of top 50 duplicated units.

See data for all 56 unit duplicates...

Size	#	Folders	Files	Lines	Code
65	x 2	go-client/idl/admin go-client/idl/admin	partition_split.go duplication.go	419:486 858:925	view
55	x 2	go-client/idl/admin go-client/idl/admin	partition_split.go bulk_load.go	3089:3146 2732:2789	view
45	x 2	go-client/idl/replication go-client/idl/admin	dsn.layer2.go bulk_load.go	505:551 2042:2088	view
45	x 2	go-client/idl/replication go-client/idl/cmd	dsn.layer2.go command.go	760:807 40:87	view
45	x 4	go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/radmin	backup.go partition_split.go bulk_load.go replica_admin.go	1242:1289 259:306 707:754 1987:2034	view
45	x 2	go-client/idl/admin go-client/idl/admin	partition_split.go bulk_load.go	110:157 3327:3374	view
45	x 2	go-client/idl/admin go-client/idl/admin	bulk_load.go duplication.go	3188:3235 1083:1130	view
39	x 3	go-client/idl/admin go-client/idl/admin go-client/idl/admin	metadata.go backup.go bulk_load.go	1207:1247 436:476 4073:4113	view
36	x 2	go-client/idl/admin go-client/idl/admin	metadata.go bulk_load.go	771:808 2537:2574	view
35	x 4	go-client/idl/admin go-client/idl/admin go-client/idl/radmin go-client/idl/cmd	backup.go partition_split.go replica_admin.go command.go	3784:3821 1462:1499 3057:3094 342:379	view
35	x 4	go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/radmin	partition_split.go bulk_load.go duplication.go replica_admin.go	785:822 3621:3658 1676:1713 2524:2561	view
30	x 3	go-client/idl/admin go-client/idl/admin go-client/idl/radmin	backup.go duplication.go replica_admin.go	1096:1127 685:716 1143:1174	view
27	x 5	go-client/idl/replication go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/admin	dsn.layer2.go backup.go partition_split.go bulk_load.go duplication.go	1082:1110 790:818 1336:1364 577:605 356:384	view
24	x 4	go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/radmin	backup.go partition_split.go duplication.go replica_admin.go	2952:2977 525:550 965:990 1667:1692	view
21	x 6	go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/radmin	metadata.go backup.go partition_split.go bulk_load.go duplication.go replica_admin.go	426:448 4111:4133 2967:2989 2819:2841 2088:2110 354:376	view
18	x 7	go-client/idl/replication go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/radmin go-client/idl/cmd	dsn.layer2.go backup.go partition_split.go bulk_load.go duplication.go replica_admin.go command.go	840:859 112:131 177:196 354:373 1149:1168 520:539 120:139	view
15	x 6	go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/radmin go-client/idl/cmd	backup.go partition_split.go bulk_load.go duplication.go replica_admin.go command.go	3831:3847 833:849 3669:3685 1724:1740 2572:2588 389:405	view
15	x 2	go-client/idl/radmin go-client/idl/cmd	replica_admin.go command.go	3211:3227 497:513	view
14	x 2	src/rpc src/http	raw_message_parser.cpp http_message_parser.cpp	116:132 234:250	view
14	x 2	src/base src/base	value_schema_v1.cpp value_schema_v2.cpp	35:50 36:51	view
13	x 2	go-client/pegasus go-client/pegasus/op	util.go utils.go	29:48 95:114	view
12	x 2	go-client/idl/admin go-client/idl/admin	backup.go partition_split.go	3491:3504 1121:1134	view
12	x 2	go-client/idl/admin go-client/idl/admin	partition_split.go bulk_load.go	750:763 3586:3599	view
10	x 5	go-client/idl/replication go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/radmin	dsn.layer2.go metadata.go backup.go bulk_load.go replica_admin.go	553:564 810:821 820:831 1491:1502 378:389	view
10	x 2	go-client/idl/replication go-client/idl/admin	dsn.layer2.go metadata.go	566:577 823:834	view
10	x 2	go-client/idl/replication go-client/idl/admin	dsn.layer2.go partition_split.go	592:603 2217:2228	view
10	x 4	go-client/idl/replication go-client/idl/admin go-client/idl/admin go-client/idl/admin	dsn.layer2.go partition_split.go bulk_load.go duplication.go	861:872 198:209 607:618 386:397	view
10	x 6	go-client/idl/replication go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/radmin	dsn.layer2.go backup.go partition_split.go bulk_load.go duplication.go replica_admin.go	1112:1123 1129:1140 346:357 794:805 718:729 541:552	view
10	x 2	go-client/idl/replication go-client/idl/admin	dsn.layer2.go backup.go	1125:1136 4354:4365	view
10	x 2	go-client/idl/replication go-client/idl/admin	dsn.layer2.go partition_split.go	1138:1149 3017:3028	view
10	x 2	go-client/idl/replication go-client/idl/admin	dsn.layer2.go backup.go	1383:1394 5050:5061	view
10	x 3	go-client/idl/replication go-client/idl/admin go-client/idl/admin	dsn.layer2.go backup.go bulk_load.go	1960:1971 846:857 2116:2127	view
10	x 2	go-client/idl/admin go-client/idl/admin	metadata.go bulk_load.go	836:847 1517:1528	view
10	x 3	go-client/idl/admin go-client/idl/admin go-client/idl/admin	backup.go partition_split.go bulk_load.go	1142:1153 3004:3015 2103:2114	view
10	x 3	go-client/idl/admin go-client/idl/admin go-client/idl/radmin	backup.go bulk_load.go replica_admin.go	4849:4860 1504:1515 1477:1488	view
10	x 2	go-client/idl/admin go-client/idl/admin	partition_split.go bulk_load.go	359:370 807:818	view
10	x 2	go-client/idl/admin go-client/idl/admin	partition_split.go bulk_load.go	1801:1812 3127:3138	view
10	x 2	go-client/idl/admin go-client/idl/admin	bulk_load.go duplication.go	2856:2867 1546:1557	view
10	x 2	go-client/pegasus go-client/pegasus/op	table_connector.go utils.go	333:344 31:42	view
9	x 3	src/base src/base src/base	value_schema_v0.cpp value_schema_v1.cpp value_schema_v2.cpp	55:65 58:68 60:70	view
8	x 3	go-client/pegasus/op go-client/pegasus/op go-client/pegasus/op	ttl.go get.go del.go	38:47 38:47 38:47	view
7	x 2	pegic/interactive/cmd admin-cli/cmd	init.go utils.go	59:67 26:34	view
6	x 2	go-client/idl/rrdb/rrdb-remote go-client/idl/rrdb/meta-remote	rrdb-remote.go meta-remote.go	56:63 42:49	view
6	x 4	go-client/idl/replication go-client/idl/admin go-client/idl/admin go-client/idl/admin	dsn.layer2.go metadata.go partition_split.go bulk_load.go	373:380 709:716 1715:1722 1401:1408	view
6	x 2	go-client/idl/replication go-client/idl/admin	dsn.layer2.go bulk_load.go	382:389 3970:3977	view
6	x 2	go-client/idl/replication go-client/idl/admin	dsn.layer2.go metadata.go	439:446 1152:1159	view
6	x 6	go-client/idl/replication go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/admin go-client/idl/radmin	dsn.layer2.go backup.go partition_split.go bulk_load.go duplication.go replica_admin.go	809:816 382:389 159:166 532:539 311:318 1423:1430	view
6	x 2	go-client/idl/replication go-client/idl/admin	dsn.layer2.go backup.go	1035:1042 391:398	view
6	x 2	go-client/idl/replication go-client/idl/admin	dsn.layer2.go partition_split.go	1044:1051 2646:2653	view
6	x 2	go-client/idl/replication go-client/idl/admin	dsn.layer2.go metadata.go	1741:1748 1179:1186	view