apache / tez
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
Learn more...
Duplication Overall
system11% (10,455 lines)
dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...
Duplication per Extension
java8% (6,795 lines)
hbs62% (1,856 lines)
js20% (1,536 lines)
proto19% (170 lines)
less3% (62 lines)
xml5% (36 lines)
Duplication per Component (primary)
tez-ui27% (3,454 lines)
tez-runtime-library13% (2,468 lines)
tez-dag6% (1,927 lines)
tez-plugins14% (911 lines)
tez-api5% (572 lines)
tez-mapreduce6% (447 lines)
tez-common12% (278 lines)
tez-runtime-internals4% (188 lines)
tez-tools4% (139 lines)
tez-dist52% (36 lines)
hadoop-shim15% (21 lines)
hadoop-shim-impls25% (14 lines)
ROOT0% (0 lines)
tez-examples0% (0 lines)

Duplication Between Components (50+ lines)

G tez-dag tez-dag tez-runtime-library tez-runtime-library tez-dag--tez-runtime-library 255 tez-plugins tez-plugins tez-dag--tez-plugins 185 tez-runtime-internals tez-runtime-internals tez-dag--tez-runtime-internals 77 tez-mapreduce tez-mapreduce tez-dag--tez-mapreduce 82 tez-api tez-api tez-api--tez-dag 206 tez-api--tez-runtime-library 231 tez-api--tez-plugins 80 tez-api--tez-runtime-internals 113 tez-api--tez-mapreduce 132 tez-common tez-common tez-api--tez-common 100 tez-plugins--tez-runtime-library 68 tez-runtime-internals--tez-runtime-library 158 tez-mapreduce--tez-runtime-library 68 tez-mapreduce--tez-plugins 58

Download: SVG DOT (open online Graphviz editor)

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 50 longest duplicates.
See data for all 3,765 duplicates...
Size#FoldersFilesLinesCode
75 x 2 tez-ui/src/main/webapp/app/controllers/task
tez-ui/src/main/webapp/app/controllers/vertex
40:120 (83%)
52:132 (74%)
view
75 x 2 tez-ui/src/main/webapp/app/controllers/dag
tez-ui/src/main/webapp/app/controllers/task
62:142 (66%)
40:120 (83%)
view
75 x 2 tez-ui/src/main/webapp/app/controllers/dag
tez-ui/src/main/webapp/app/controllers/vertex
62:142 (66%)
52:132 (74%)
view
48 x 2 tez-ui/src/main/webapp/app/controllers/app
tez-ui/src/main/webapp/app/controllers/home
28:77 (67%)
100:149 (31%)
view
45 x 2 tez-ui/src/main/webapp/app/controllers/dag
tez-ui/src/main/webapp/app/controllers/dag
31:78 (35%)
26:73 (48%)
view
43 x 2 tez-ui/src/main/webapp/app/controllers/dag
tez-ui/src/main/webapp/app/controllers/vertex
50:96 (62%)
40:86 (74%)
view
41 x 2 tez-mapreduce/src/main/j...che/hadoop/mapred/split
tez-mapreduce/src/main/j.../hadoop/mapreduce/split
91:149 (37%)
99:157 (35%)
view
41 x 2 tez-plugins/tez-yarn-tim...ez/dag/history/ats/acls
tez-plugins/tez-yarn-tim...ez/dag/history/ats/acls
57:113 (29%)
58:114 (28%)
view
38 x 2 tez-plugins/tez-yarn-tim...dag/history/logging/ats
tez-plugins/tez-yarn-tim...dag/history/logging/ats
395:454 (12%)
355:414 (14%)
view
37 x 2 tez-ui/src/main/webapp/app/controllers/dag
tez-ui/src/main/webapp/app/controllers/dag
55:93 (33%)
43:81 (53%)
view
34 x 2 tez-api/src/main/java/org/apache/tez/common
tez-common/src/main/java/org/apache/tez/common
62:112 (65%)
63:113 (62%)
view
33 x 2 tez-ui/src/main/webapp/app/controllers/dag
tez-ui/src/main/webapp/app/controllers/dag
61:94 (26%)
54:87 (28%)
view
33 x 2 tez-dag/src/main/java/org/apache/tez/dag/app/rm
tez-dag/src/main/java/org/apache/tez/dag/app/rm
200:238 (2%)
303:341 (2%)
view
33 x 2 tez-runtime-library/src/.../library/common/shuffle
tez-runtime-library/src/.../shuffle/orderedgrouped
80:120 (4%)
91:131 (3%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/vertex
tez-ui/src/main/webapp/app/templates/vertex
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/vertex
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/vertex
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/controllers/task
tez-ui/src/main/webapp/app/controllers/vertex
38:71 (35%)
38:71 (55%)
view
32 x 2 tez-plugins/tez-yarn-tim...ez/dag/history/ats/acls
tez-plugins/tez-yarn-tim...ez/dag/history/ats/acls
203:250 (22%)
207:254 (22%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/app
tez-ui/src/main/webapp/app/templates/dag
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/vertex
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/task
tez-ui/src/main/webapp/app/templates/vertex
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/vertex
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/app
tez-ui/src/main/webapp/app/templates/vertex
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/dag
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/task
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/app
tez-ui/src/main/webapp/app/templates/vertex
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/dag
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/task
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/task
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/app
tez-ui/src/main/webapp/app/templates/dag
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/app
tez-ui/src/main/webapp/app/templates/task
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/app
tez-ui/src/main/webapp/app/templates/dag
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/task
tez-ui/src/main/webapp/app/templates/vertex
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/vertex
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/vertex
1:37 (100%)
1:37 (100%)
view
32 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/dag
1:37 (100%)
1:37 (100%)
view
31 x 2 tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
464:528 (12%)
426:493 (13%)
view
30 x 2 tez-ui/src/main/webapp/app/controllers/vertex
tez-ui/src/main/webapp/app/controllers/vertex
52:83 (29%)
40:71 (51%)
view
30 x 2 tez-ui/src/main/webapp/app/controllers/dag
tez-ui/src/main/webapp/app/controllers/task
50:81 (43%)
40:71 (33%)
view
30 x 2 tez-ui/src/main/webapp/app/templates/attempt
tez-ui/src/main/webapp/app/templates/vertex
1:34 (100%)
1:34 (100%)
view
30 x 2 tez-ui/src/main/webapp/app/templates/attempt
tez-ui/src/main/webapp/app/templates/task
1:34 (100%)
1:34 (100%)
view
30 x 2 tez-ui/src/main/webapp/app/controllers/dag
tez-ui/src/main/webapp/app/controllers/vertex
50:81 (43%)
52:83 (29%)
view
30 x 2 tez-ui/src/main/webapp/app/templates/attempt
tez-ui/src/main/webapp/app/templates/dag
1:34 (100%)
1:34 (100%)
view
30 x 2 tez-ui/src/main/webapp/app/controllers/dag
tez-ui/src/main/webapp/app/controllers/vertex
62:93 (26%)
40:71 (51%)
view
30 x 2 tez-ui/src/main/webapp/app/templates/task
tez-ui/src/main/webapp/app/templates/vertex
1:34 (100%)
1:34 (100%)
view
30 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/vertex
1:34 (100%)
1:34 (100%)
view
30 x 2 tez-ui/src/main/webapp/app/templates/dag
tez-ui/src/main/webapp/app/templates/task
1:34 (100%)
1:34 (100%)
view
30 x 2 tez-ui/src/main/webapp/app/templates/app
tez-ui/src/main/webapp/app/templates/query
1:34 (100%)
1:34 (100%)
view
29 x 2 tez-ui/src/main/webapp/app/controllers/dag
tez-ui/src/main/webapp/app/controllers/home
49:78 (23%)
120:149 (19%)
view
Duplicated Units
The list of top 49 duplicated units.
See data for all 49 unit duplicates...
Size#FoldersFilesLinesCode
32 x 2 tez-plugins/tez-yarn-tim...dag/history/logging/ats
tez-plugins/tez-yarn-tim...dag/history/logging/ats
414:455 
374:415 
view
31 x 2 tez-api/src/main/java/org/apache/tez/common
tez-common/src/main/java/org/apache/tez/common
67:105 
68:106 
view
29 x 2 tez-plugins/tez-yarn-tim...dag/history/logging/ats
tez-plugins/tez-yarn-tim...dag/history/logging/ats
334:371 
292:329 
view
26 x 2 tez-mapreduce/src/main/j...che/hadoop/mapred/split
tez-mapreduce/src/main/j.../hadoop/mapreduce/split
117:147 
125:155 
view
26 x 2 tez-plugins/tez-yarn-tim...ez/dag/history/ats/acls
tez-plugins/tez-yarn-tim...ez/dag/history/ats/acls
58:85 
57:84 
view
23 x 2 tez-plugins/tez-yarn-tim...ez/dag/history/ats/acls
tez-plugins/tez-yarn-tim...ez/dag/history/ats/acls
87:115 
86:114 
view
23 x 2 hadoop-shim/src/main/jav.../apache/tez/hadoop/shim
tez-dag/src/main/java/org/apache/tez/dag/utils
158:182 
44:68 
view
19 x 2 tez-plugins/tez-yarn-tim...dag/history/logging/ats
tez-plugins/tez-yarn-tim...dag/history/logging/ats
483:506 
443:466 
view
18 x 2 tez-mapreduce/src/main/j...che/hadoop/mapred/split
tez-mapreduce/src/main/j.../hadoop/mapreduce/split
92:113 
100:121 
view
17 x 2 tez-common/src/main/java/org/apache/tez/common
tez-common/src/main/java/org/apache/tez/common
229:250 
257:278 
view
15 x 2 tez-runtime-library/src/.../shuffle/orderedgrouped
tez-runtime-library/src/.../library/common/shuffle
111:127 
100:116 
view
13 x 2 tez-ui/src/main/webapp/app/routes/vertex
tez-ui/src/main/webapp/app/routes/dag
46:60 
46:60 
view
13 x 2 tez-runtime-library/src/...ibrary/common/sort/impl
tez-runtime-library/src/...ibrary/common/sort/impl
92:116 
154:169 
view
11 x 5 tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
429:442 
285:298 
285:298 
314:327 
467:480 
view
11 x 2 tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
458:471 
494:507 
view
11 x 2 tez-runtime-library/src/...g/library/vertexmanager
tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
663:677 
347:361 
view
10 x 3 tez-ui/src/main/webapp/app/controllers/vertex
tez-ui/src/main/webapp/app/controllers/dag
tez-ui/src/main/webapp/app/controllers/task
99:110 
109:120 
87:98 
view
9 x 2 tez-mapreduce/src/main/j...che/hadoop/mapred/split
tez-mapreduce/src/main/j.../hadoop/mapreduce/split
117:127 
111:121 
view
9 x 2 tez-plugins/tez-yarn-tim...dag/history/logging/ats
tez-plugins/tez-yarn-tim...dag/history/logging/ats
462:472 
422:432 
view
9 x 2 tez-ui/src/main/webapp/app/serializers
tez-ui/src/main/webapp/app/serializers
39:51 
23:35 
view
9 x 2 tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
416:427 
405:416 
view
9 x 5 tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
483:494 
330:341 
250:261 
339:350 
518:529 
view
9 x 2 tez-runtime-library/src/...g/library/vertexmanager
tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
392:402 
363:373 
view
9 x 2 tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
126:137 
82:93 
view
8 x 3 tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
148:157 
152:161 
146:155 
view
8 x 2 tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
134:143 
128:137 
view
8 x 2 tez-dag/src/main/java/or.../tez/dag/history/events
tez-dag/src/main/java/or.../tez/dag/history/events
87:96 
87:96 
view
7 x 2 tez-runtime-internals/sr...he/tez/runtime/api/impl
tez-runtime-internals/sr...he/tez/runtime/api/impl
130:138 
77:85 
view
7 x 2 tez-mapreduce/src/main/j...che/hadoop/mapred/split
tez-mapreduce/src/main/j.../hadoop/mapreduce/split
190:198 
206:214 
view
7 x 2 tez-common/src/main/java/org/apache/tez/common
tez-common/src/main/java/org/apache/tez/common
361:369 
409:417 
view
7 x 2 tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
296:305 
218:227 
view
7 x 2 tez-runtime-library/src/.../shuffle/orderedgrouped
tez-runtime-library/src/...ary/common/shuffle/impl
529:537 
735:743 
view
6 x 2 tez-mapreduce/src/main/j...che/hadoop/mapred/split
tez-mapreduce/src/main/j.../hadoop/mapreduce/split
57:64 
64:71 
view
6 x 2 tez-mapreduce/src/main/j...che/hadoop/mapred/split
tez-mapreduce/src/main/j.../hadoop/mapreduce/split
82:89 
86:93 
view
6 x 2 tez-plugins/tez-yarn-tim...ez/dag/history/ats/acls
tez-plugins/tez-yarn-tim...ez/dag/history/ats/acls
242:249 
238:245 
view
6 x 2 tez-api/src/main/java/org/apache/tez/common
tez-common/src/main/java/org/apache/tez/common
107:114 
108:115 
view
6 x 3 tez-api/src/main/java/or...che/tez/common/counters
tez-api/src/main/java/or...che/tez/common/counters
tez-api/src/main/java/or...che/tez/common/counters
264:271 
181:188 
304:311 
view
6 x 2 tez-api/src/main/java/or.../tez/serviceplugins/api
tez-api/src/main/java/or.../tez/serviceplugins/api
42:49 
78:85 
view
6 x 2 tez-ui/src/main/webapp/app/routes/dag
tez-ui/src/main/webapp/app/routes/dag
37:44 
37:44 
view
6 x 2 tez-ui/src/main/webapp/app/controllers/vertex
tez-ui/src/main/webapp/app/controllers/dag
77:84 
87:94 
view
6 x 2 tez-runtime-library/src/...ez/runtime/library/conf
tez-runtime-library/src/...ez/runtime/library/conf
319:327 
373:381 
view
6 x 2 tez-runtime-library/src/.../shuffle/orderedgrouped
tez-runtime-library/src/...ary/common/shuffle/impl
557:564 
771:778 
view
6 x 2 hadoop-shim-impls/hadoop.../apache/tez/hadoop/shim
hadoop-shim-impls/hadoop.../apache/tez/hadoop/shim
43:50 
45:52 
view
6 x 3 tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
589:596 
839:846 
1397:1404 
view
6 x 3 tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
tez-dag/src/main/java/or...ez/dag/app/rm/container
604:611 
911:918 
356:363 
view
6 x 2 tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
792:799 
1467:1474 
view
6 x 2 tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
903:910 
1630:1637 
view
6 x 2 tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
1568:1575 
1654:1661 
view
6 x 2 tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
tez-dag/src/main/java/or...he/tez/dag/app/dag/impl
1943:1952 
3513:3523 
view