apache / incubator-uniffle
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
Learn more...
Duplication Overall
system34% (15,909 lines)
dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...
Duplication per Extension
yaml96% (9,580 lines)
java18% (6,168 lines)
go5% (161 lines)
Duplication per Component (primary)
deploy74% (9,741 lines)
client-tez27% (1,900 lines)
client-spark35% (1,513 lines)
server10% (567 lines)
client-mr23% (541 lines)
internal-client22% (468 lines)
client27% (419 lines)
storage12% (307 lines)
common4% (219 lines)
coordinator7% (210 lines)
cli5% (24 lines)
ROOT0% (0 lines)
proto0% (0 lines)

Duplication Between Components (50+ lines)

G client-mr client-mr client-tez client-tez client-mr--client-tez 1068 client-spark client-spark client-mr--client-spark 119 client client client-mr--client 60 client-tez--client 78 client-spark--client-tez 144 common common internal-client internal-client common--internal-client 100 storage storage common--storage 60 client--storage 69 coordinator coordinator server server coordinator--server 66

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 50 longest duplicates.
See data for all 1,520 duplicates...
Size#FoldersFilesLinesCode
1242 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
73:1314 (12%)
4901:6142 (12%)
view
1039 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
3803:4841 (10%)
8639:9677 (10%)
view
335 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1316:1650 (3%)
6144:6478 (3%)
view
279 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
2804:3082 (2%)
7617:7895 (2%)
view
271 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
3449:3719 (2%)
8285:8555 (2%)
view
244 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
2149:2392 (2%)
6962:7205 (2%)
view
242 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1906:2147 (2%)
6719:6960 (2%)
view
159 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
5132:5290 (1%)
5456:5614 (1%)
view
159 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
304:462 (1%)
628:786 (1%)
view
159 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
304:462 (1%)
5456:5614 (1%)
view
159 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
628:786 (1%)
5132:5290 (1%)
view
143 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
795:937 (1%)
5299:5441 (1%)
view
143 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
3305:3447 (1%)
8141:8283 (1%)
view
143 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
471:613 (1%)
795:937 (1%)
view
143 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
471:613 (1%)
5623:5765 (1%)
view
143 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
5299:5441 (1%)
5623:5765 (1%)
view
132 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
2484:2615 (1%)
3011:3142 (1%)
view
132 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
7297:7428 (1%)
7488:7619 (1%)
view
132 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
7297:7428 (1%)
7824:7955 (1%)
view
132 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
2675:2806 (1%)
3011:3142 (1%)
view
132 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
2484:2615 (1%)
2675:2806 (1%)
view
132 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
7488:7619 (1%)
7824:7955 (1%)
view
126 x 2 client-spark/spark2/src/...rg/apache/spark/shuffle
client-spark/spark3/src/...rg/apache/spark/shuffle
44:203 (86%)
44:203 (57%)
view
119 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
3140:3258 (1%)
7953:8071 (1%)
view
115 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1181:1295 (1%)
6270:6384 (1%)
view
115 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1442:1556 (1%)
6009:6123 (1%)
view
115 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
6009:6123 (1%)
6270:6384 (1%)
view
115 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1181:1295 (1%)
1442:1556 (1%)
view
111 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1321:1431 (1%)
6271:6381 (1%)
view
111 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1182:1292 (1%)
6149:6259 (1%)
view
111 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
6149:6259 (1%)
6271:6381 (1%)
view
111 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1443:1553 (1%)
6149:6259 (1%)
view
111 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1321:1431 (1%)
6010:6120 (1%)
view
111 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
6010:6120 (1%)
6149:6259 (1%)
view
111 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1657:1767 (1%)
6479:6589 (1%)
view
111 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1321:1431 (1%)
1443:1553 (1%)
view
111 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1182:1292 (1%)
1321:1431 (1%)
view
103 x 2 client-tez/src/main/java...ibrary/common/sort/impl
client-tez/src/main/java...ibrary/common/sort/impl
56:167 (68%)
55:165 (68%)
view
89 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
2394:2482 (<1%)
7207:7295 (<1%)
view
85 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
2295:2379 (<1%)
7207:7291 (<1%)
view
85 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
2394:2478 (<1%)
7108:7192 (<1%)
view
85 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
7108:7192 (<1%)
7207:7291 (<1%)
view
85 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
2295:2379 (<1%)
2394:2478 (<1%)
view
81 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
3721:3801 (<1%)
8557:8637 (<1%)
view
78 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
102:179 (<1%)
207:284 (<1%)
view
78 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
207:284 (<1%)
4930:5007 (<1%)
view
78 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
4930:5007 (<1%)
5035:5112 (<1%)
view
78 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
102:179 (<1%)
5035:5112 (<1%)
view
72 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
1794:1865 (<1%)
6609:6680 (<1%)
view
72 x 2 deploy/kubernetes/operator/config/crd/bases
deploy/kubernetes/operator/config/crd/bases
3011:3082 (<1%)
7297:7368 (<1%)
view
Duplicated Units
The list of top 29 duplicated units.
See data for all 29 unit duplicates...
Size#FoldersFilesLinesCode
58 x 2 client-spark/spark3/src/...rg/apache/spark/shuffle
client-spark/spark2/src/...rg/apache/spark/shuffle
113:175 
113:175 
view
38 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
236:275 
198:240 
view
37 x 2 client-spark/spark3/src/...rg/apache/spark/shuffle
client-spark/spark2/src/...rg/apache/spark/shuffle
71:111 
71:111 
view
36 x 2 client-spark/spark3/src/...he/spark/shuffle/writer
client-spark/spark2/src/...he/spark/shuffle/writer
159:196 
151:188 
view
28 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
239:268 
254:283 
view
28 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
141:172 
148:179 
view
26 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
250:282 
252:284 
view
24 x 3 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
293:318 
294:319 
296:321 
view
23 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
174:201 
242:266 
view
22 x 2 client-spark/spark3/src/...he/spark/shuffle/writer
client-spark/spark2/src/...he/spark/shuffle/writer
98:121 
93:116 
view
20 x 2 client-tez/src/main/java...ibrary/common/sort/impl
client-tez/src/main/java...ibrary/common/sort/impl
192:213 
194:216 
view
18 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
61:80 
66:85 
view
18 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
193:212 
195:214 
view
16 x 2 client-spark/spark3/src/...rg/apache/spark/shuffle
client-spark/spark2/src/...rg/apache/spark/shuffle
177:196 
177:196 
view
16 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
215:232 
217:234 
view
15 x 2 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
106:122 
105:121 
view
14 x 2 client-tez/src/main/java...ary/common/shuffle/impl
client-tez/src/main/java.../shuffle/orderedgrouped
951:966 
696:711 
view
12 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
220:233 
182:195 
view
12 x 2 client-spark/spark3/src/...rg/apache/spark/shuffle
client-spark/spark2/src/...rg/apache/spark/shuffle
55:69 
55:69 
view
11 x 3 client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
client-tez/src/main/java.../runtime/library/output
232:246 
235:248 
237:250 
view
11 x 2 client-tez/src/main/java...ary/common/shuffle/impl
client-tez/src/main/java.../shuffle/orderedgrouped
984:996 
722:734 
view
8 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
321:330 
339:348 
view
8 x 2 client-spark/spark2/src/...ache/spark/network/util
common/src/main/java/org...che/uniffle/common/util
68:77 
57:66 
view
7 x 2 coordinator/src/main/jav...rdinator/access/checker
coordinator/src/main/jav...che/uniffle/coordinator
156:164 
139:147 
view
7 x 2 coordinator/src/main/jav...inator/strategy/storage
coordinator/src/main/jav...inator/strategy/storage
42:50 
44:52 
view
7 x 2 client-mr/core/src/main/...rg/apache/hadoop/mapred
client-tez/src/main/java...rary/common/sort/buffer
102:110 
108:116 
view
7 x 2 client-tez/src/main/java...ary/common/shuffle/impl
client-tez/src/main/java.../shuffle/orderedgrouped
914:922 
669:677 
view
6 x 2 client-mr/core/src/main/...apache/hadoop/mapreduce
client-tez/src/main/java/org/apache/tez/common
235:242 
201:208 
view
6 x 2 client-spark/spark3/src/...he/spark/shuffle/writer
client-spark/spark2/src/...he/spark/shuffle/writer
203:210 
203:210 
view