apache / uniffle
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
Learn more...
Duplication Overall
system16% (9,751 lines)
dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...
Duplication per Extension
java17% (8,797 lines)
js46% (356 lines)
vue19% (237 lines)
go6% (189 lines)
yaml44% (112 lines)
xml64% (60 lines)
Duplication per Component (primary)
client-tez27% (2,294 lines)
client-spark26% (1,928 lines)
server15% (1,558 lines)
internal-client20% (736 lines)
dashboard27% (607 lines)
common6% (571 lines)
client-mr19% (560 lines)
storage11% (384 lines)
client14% (365 lines)
coordinator8% (318 lines)
deploy8% (301 lines)
tools7% (45 lines)
conf81% (30 lines)
dev81% (30 lines)
cli3% (24 lines)
release0% (0 lines)
ROOT0% (0 lines)
proto0% (0 lines)

Duplication Between Components (50+ lines)

G client-mr client-mr client-tez client-tez client-mr--client-tez 1102 client-spark client-spark client-mr--client-spark 86 common common internal-client internal-client common--internal-client 188 client-spark--client-tez 172 client client client-spark--client 102 client--common 84 client--internal-client 104 coordinator coordinator server server coordinator--server 76 conf conf dev dev conf--dev 60

Download: SVG DOT (open online Graphviz editor)

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 50 longest duplicates.
See data for all 958 duplicates...
Size#FoldersFilesLinesCode
125 x 2 client-spark/spark2/src/...rg/apache/spark/shuffle
client-spark/spark3/src/...rg/apache/spark/shuffle
 43:204 (86%)
43:204 (57%)
 view
77 x 2 client-tez/src/main/java...ibrary/common/sort/impl
client-tez/src/main/java...ibrary/common/sort/impl
 57:141 (49%)
55:138 (50%)
 view
73 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 131:215 (34%)
129:213 (34%)
 view
71 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 245:332 (33%)
243:330 (33%)
 view
55 x 2 client-tez/src/main/java...z/runtime/library/input
client-tez/src/main/java...z/runtime/library/input
 261:318 (30%)
390:450 (21%)
 view
54 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 289:352 (24%)
270:332 (25%)
 view
54 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 289:352 (24%)
268:330 (25%)
 view
52 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
 312:377 (14%)
299:363 (14%)
 view
48 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
 142:200 (16%)
146:204 (19%)
 view
47 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
 248:303 (16%)
207:265 (19%)
 view
44 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 130:180 (19%)
125:175 (20%)
 view
41 x 2 dashboard/src/main/webapp/src/pages
dashboard/src/main/webapp/src/pages
 210:253 (20%)
94:137 (37%)
 view
40 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 134:180 (17%)
131:177 (18%)
 view
36 x 2 client-tez/src/main/java...ibrary/common/sort/impl
client-tez/src/main/java...ibrary/common/sort/impl
 178:230 (23%)
172:223 (23%)
 view
34 x 2 deploy/kubernetes/operator/config/manager
deploy/kubernetes/operator/config/manager
 96:129 (29%)
119:152 (24%)
 view
34 x 2 client-spark/spark2/src/...he/spark/shuffle/reader
client-spark/spark3/src/...he/spark/shuffle/reader
 223:265 (17%)
188:229 (13%)
 view
32 x 2 client-spark/spark2/src/...he/spark/shuffle/writer
client-spark/spark3/src/...he/spark/shuffle/writer
 308:352 (7%)
394:438 (4%)
 view
31 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
 71:110 (10%)
73:113 (12%)
 view
29 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 325:357 (7%)
395:427 (7%)
 view
29 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 360:392 (7%)
395:427 (7%)
 view
29 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 325:357 (7%)
360:392 (7%)
 view
29 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 290:322 (7%)
360:392 (7%)
 view
29 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 290:322 (7%)
395:427 (7%)
 view
29 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 290:322 (7%)
325:357 (7%)
 view
29 x 2 client-spark/spark2/src/...rg/apache/spark/shuffle
client-spark/spark3/src/...rg/apache/spark/shuffle
 395:424 (10%)
570:599 (5%)
 view
28 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
 306:352 (9%)
310:354 (11%)
 view
28 x 2 client-spark/spark2/src/...he/spark/shuffle/writer
client-spark/spark3/src/...he/spark/shuffle/writer
 189:216 (6%)
264:291 (3%)
 view
27 x 2 internal-client/src/main...niffle/client/impl/grpc
internal-client/src/main...niffle/client/impl/grpc
 849:881 (2%)
898:930 (2%)
 view
27 x 2 client-tez/src/main/java...ary/common/shuffle/impl
client-tez/src/main/java.../shuffle/orderedgrouped
 942:976 (2%)
689:723 (1%)
 view
26 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 21:48 (7%)
360:387 (7%)
 view
26 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 21:48 (7%)
395:422 (7%)
 view
26 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 21:48 (7%)
325:352 (7%)
 view
26 x 2 client-tez/src/main/java...ibrary/common/sort/impl
client-tez/src/main/java...ibrary/common/sort/impl
 146:171 (16%)
140:165 (16%)
 view
26 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 21:48 (7%)
290:317 (7%)
 view
26 x 2 coordinator/src/main/jav...tor/strategy/assignment
coordinator/src/main/jav...tor/strategy/assignment
 41:70 (50%)
59:88 (22%)
 view
24 x 2 conf
dev/local_dev_template
 1:48 (64%)
1:48 (64%)
 view
23 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 203:229 (10%)
183:210 (10%)
 view
23 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 203:229 (10%)
181:208 (10%)
 view
23 x 2 client/src/main/java/org...che/uniffle/client/impl
client/src/main/java/org...che/uniffle/client/impl
 1032:1058 (2%)
1105:1131 (2%)
 view
22 x 2 client-tez/src/main/java...z/runtime/library/input
client-tez/src/main/java...z/runtime/library/input
 124:153 (12%)
145:174 (8%)
 view
22 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 131:153 (5%)
157:179 (5%)
 view
22 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 235:257 (5%)
261:283 (5%)
 view
22 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 183:205 (5%)
261:283 (5%)
 view
22 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 209:231 (5%)
235:257 (5%)
 view
22 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 209:231 (5%)
261:283 (5%)
 view
22 x 2 client-mr/core/src/main/...p/mapreduce/task/reduce
client-tez/src/main/java.../shuffle/orderedgrouped
 171:202 (10%)
161:192 (11%)
 view
22 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 183:205 (5%)
235:257 (5%)
 view
22 x 2 dashboard/src/main/webapp/src/mock
dashboard/src/main/webapp/src/mock
 183:205 (5%)
209:231 (5%)
 view
22 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
 203:233 (7%)
268:295 (9%)
 view
22 x 2 client-spark/spark3/src/...rg/apache/spark/shuffle
client-spark/spark3/src/...rg/apache/spark/shuffle
 288:309 (4%)
324:345 (4%)
 view
Duplicated Units
The list of top 37 duplicated units.
See data for all 37 unit duplicates...
Size#FoldersFilesLinesCode
52 x 2 client-spark/spark2/src/...rg/apache/spark/shuffle
client-spark/spark3/src/...rg/apache/spark/shuffle
 119:176 
119:176 
 view
50 x 2 client-tez/src/main/java...z/runtime/library/input
client-tez/src/main/java...z/runtime/library/input
 392:443 
263:314 
 view
42 x 2 client-spark/spark2/src/...rg/apache/spark/shuffle
client-spark/spark3/src/...rg/apache/spark/shuffle
 72:117 
72:117 
 view
38 x 2 client-tez/src/main/java...rary/common/sort/buffer
client-mr/core/src/main/...rg/apache/hadoop/mapred
 224:266 
265:304 
 view
30 x 2 client-tez/src/main/java...rary/common/sort/buffer
client-mr/core/src/main/...rg/apache/hadoop/mapred
 299:330 
312:343 
 view
30 x 2 client-tez/src/main/java...rary/common/sort/buffer
client-mr/core/src/main/...rg/apache/hadoop/mapred
 172:205 
168:201 
 view
28 x 2 client-tez/src/main/java...rary/common/sort/buffer
client-mr/core/src/main/...rg/apache/hadoop/mapred
 80:109 
77:106 
 view
27 x 2 client-spark/spark2/src/...rg/apache/spark/shuffle
client-spark/spark3/src/...rg/apache/spark/shuffle
 396:425 
571:600 
 view
26 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 259:291 
257:289 
 view
24 x 3 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 323:348 
303:328 
301:326 
 view
23 x 2 client-tez/src/main/java...rary/common/sort/buffer
client-mr/core/src/main/...rg/apache/hadoop/mapred
 268:292 
203:230 
 view
21 x 2 client-spark/spark2/src/...he/spark/shuffle/writer
client-spark/spark3/src/...he/spark/shuffle/writer
 329:354 
415:440 
 view
20 x 2 client-tez/src/main/java...ibrary/common/sort/impl
client-tez/src/main/java...ibrary/common/sort/impl
 201:223 
195:216 
 view
18 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 200:219 
198:217 
 view
18 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 222:241 
220:239 
 view
16 x 2 client-tez/src/main/java...z/runtime/library/input
client-tez/src/main/java...z/runtime/library/input
 154:172 
133:151 
 view
16 x 2 client-spark/spark2/src/...rg/apache/spark/shuffle
client-spark/spark3/src/...rg/apache/spark/shuffle
 178:197 
178:197 
 view
15 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 106:122 
107:123 
 view
15 x 2 client-spark/spark2/src/...rg/apache/spark/shuffle
client-spark/spark3/src/...rg/apache/spark/shuffle
 53:70 
53:70 
 view
14 x 2 client-tez/src/main/java.../shuffle/orderedgrouped
client-tez/src/main/java...ary/common/shuffle/impl
 702:717 
955:970 
 view
14 x 2 coordinator/src/main/jav...tor/strategy/assignment
coordinator/src/main/jav...tor/strategy/assignment
 64:79 
46:61 
 view
13 x 2 client-tez/src/main/java...z/runtime/library/input
client-tez/src/main/java...z/runtime/library/input
 227:243 
160:176 
 view
12 x 2 client-tez/src/main/java...rary/common/sort/buffer
client-mr/core/src/main/...rg/apache/hadoop/mapred
 208:221 
249:262 
 view
11 x 2 client-tez/src/main/java.../shuffle/orderedgrouped
client-tez/src/main/java...ary/common/shuffle/impl
 728:740 
988:1000 
 view
11 x 3 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
 262:276 
244:257 
242:255 
 view
10 x 2 client-spark/spark2/src/...he/spark/shuffle/writer
client-spark/spark3/src/...he/spark/shuffle/writer
 247:258 
320:331 
 view
8 x 2 client-tez/src/main/java...rary/common/sort/buffer
client-mr/core/src/main/...rg/apache/hadoop/mapred
 386:395 
396:405 
 view
8 x 2 common/src/main/java/org...mon/serializer/writable
common/src/main/java/org...mon/serializer/writable
 86:95 
78:87 
 view
8 x 2 common/src/main/java/org...che/uniffle/common/util
client-spark/spark2/src/...ache/spark/network/util
 68:77 
73:82 
 view
7 x 2 client-tez/src/main/java.../shuffle/orderedgrouped
client-tez/src/main/java...ary/common/shuffle/impl
 677:685 
918:926 
 view
7 x 2 client-tez/src/main/java.../shuffle/orderedgrouped
client-tez/src/main/java...ary/common/shuffle/impl
 1804:1812 
238:246 
 view
7 x 2 common/src/main/java/org...e/common/netty/protocol
common/src/main/java/org...e/common/netty/protocol
 33:41 
33:41 
 view
7 x 2 client-spark/spark2/src/...he/spark/shuffle/writer
client-spark/spark3/src/...he/spark/shuffle/writer
 319:327 
405:413 
 view
7 x 2 server/src/main/java/org...he/uniffle/server/block
server/src/main/java/org...he/uniffle/server/block
 131:139 
186:194 
 view
7 x 2 coordinator/src/main/jav...inator/strategy/storage
coordinator/src/main/jav...inator/strategy/storage
 42:50 
44:52 
 view
6 x 2 client-spark/common/src/...rg/apache/spark/shuffle
client-spark/common/src/...uniffle/shuffle/manager
 521:530 
1499:1508 
 view
6 x 2 storage/src/main/java/or...le/storage/handler/impl
storage/src/main/java/or...le/storage/handler/impl
 68:75 
63:70 
 view