elastic / elasticsearch-hadoop
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
Learn more...
Duplication Overall
system8% (2,593 lines)
dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...
Duplication per Extension
java7% (1,682 lines)
scala15% (785 lines)
yaml47% (92 lines)
sql30% (18 lines)
groovy<1% (16 lines)
Duplication per Component (primary)
spark15% (1,054 lines)
mr5% (848 lines)
hive17% (404 lines)
qa21% (143 lines)
ROOT47% (92 lines)
buildSrc1% (52 lines)

Duplication Between Components (50+ lines)

G hive hive mr mr hive--mr 59

Download: SVG DOT (open online Graphviz editor)

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 50 longest duplicates.
See data for all 487 duplicates...
Size#FoldersFilesLinesCode
31 x 2 qa/kerberos/src/itest/ja...arch/hadoop/qa/kerberos
qa/kerberos/src/main/jav...adoop/qa/kerberos/setup
210:240 (11%)
81:111 (32%)
view
24 x 2 mr/src/itest/java/org/el...commonshttp/auth/spnego
mr/src/itest/java/org/el...commonshttp/auth/spnego
162:197 (15%)
231:266 (15%)
view
20 x 2 mr/src/itest/java/org/el...commonshttp/auth/spnego
mr/src/itest/java/org/el...commonshttp/auth/spnego
221:252 (10%)
303:335 (10%)
view
19 x 2 spark/core/src/itest/sca...rch/spark/serialization
spark/sql-30/src/itest/s...rch/spark/serialization
23:49 (100%)
23:49 (100%)
view
19 x 2 qa/kerberos/src/itest/ja...arch/hadoop/qa/kerberos
qa/kerberos/src/itest/ja...arch/hadoop/qa/kerberos
89:116 (7%)
127:154 (7%)
view
18 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
276:298 (5%)
319:341 (5%)
view
18 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
200:222 (5%)
319:341 (5%)
view
18 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
200:222 (5%)
237:259 (5%)
view
18 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
200:222 (5%)
276:298 (5%)
view
18 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
237:259 (5%)
319:341 (5%)
view
18 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
237:259 (5%)
276:298 (5%)
view
17 x 2 mr/src/itest/java/org/el...commonshttp/auth/spnego
mr/src/itest/java/org/el...commonshttp/auth/spnego
135:159 (10%)
204:228 (10%)
view
17 x 2 spark/core/src/itest/sca...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
587:603 (2%)
316:332 (6%)
view
16 x 2 mr/src/itest/java/org/el...commonshttp/auth/spnego
mr/src/itest/java/org/el...commonshttp/auth/spnego
100:120 (10%)
165:185 (10%)
view
16 x 2 mr/src/itest/java/org/el...commonshttp/auth/spnego
mr/src/itest/java/org/el...commonshttp/auth/spnego
100:120 (10%)
234:254 (10%)
view
16 x 2 hive/src/main/java/org/elasticsearch/hadoop/hive
mr/src/main/java/org/elasticsearch/hadoop/mr
155:174 (22%)
96:116 (34%)
view
14 x 2 hive/src/itest/java/org/...hadoop/integration/hive
hive/src/itest/java/org/...hadoop/integration/hive
183:206 (13%)
278:301 (7%)
view
14 x 2 hive/src/itest/java/org/...hadoop/integration/hive
hive/src/itest/java/org/...hadoop/integration/hive
183:206 (13%)
454:477 (4%)
view
14 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
165:182 (4%)
237:254 (4%)
view
14 x 2 spark/core/src/itest/sca...earch/spark/integration
spark/core/src/itest/sca...earch/spark/integration
344:363 (2%)
381:400 (2%)
view
14 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
165:182 (4%)
276:293 (4%)
view
14 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
165:182 (4%)
319:336 (4%)
view
14 x 2 hive/src/itest/java/org/...hadoop/integration/hive
hive/src/itest/java/org/...hadoop/integration/hive
278:301 (7%)
454:477 (4%)
view
14 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
165:182 (4%)
200:217 (4%)
view
13 x 2 mr/src/itest/java/org/el...commonshttp/auth/spnego
mr/src/itest/java/org/el...commonshttp/auth/spnego
75:93 (8%)
204:222 (8%)
view
13 x 2 mr/src/itest/java/org/el...h/hadoop/integration/mr
mr/src/itest/java/org/el...h/hadoop/integration/mr
247:265 (5%)
324:342 (3%)
view
13 x 2 mr/src/itest/java/org/el...commonshttp/auth/spnego
mr/src/itest/java/org/el...commonshttp/auth/spnego
75:93 (8%)
135:153 (8%)
view
13 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
1701:1719 (<1%)
1735:1753 (<1%)
view
13 x 2 ROOT
ROOT
142:154 (6%)
183:195 (6%)
view
13 x 2 qa/kerberos/src/itest/ja...arch/hadoop/qa/kerberos
qa/kerberos/src/itest/ja...arch/hadoop/qa/kerberos
85:101 (4%)
156:172 (4%)
view
13 x 2 hive/src/itest/java/org/...hadoop/integration/hive
hive/src/itest/java/org/...hadoop/integration/hive
69:87 (12%)
71:89 (7%)
view
12 x 2 spark/sql-30/src/itest/j...earch/spark/integration
spark/sql-30/src/itest/j...earch/spark/integration
142:155 (2%)
398:411 (2%)
view
12 x 2 spark/sql-30/src/itest/j...earch/spark/integration
spark/sql-30/src/itest/j...earch/spark/integration
178:191 (2%)
398:411 (2%)
view
12 x 2 mr/src/itest/java/org/el...h/hadoop/integration/mr
mr/src/itest/java/org/el...h/hadoop/integration/mr
89:103 (11%)
126:140 (3%)
view
12 x 2 mr/src/itest/java/org/el...h/hadoop/integration/mr
mr/src/itest/java/org/el...h/hadoop/integration/mr
289:306 (4%)
366:383 (3%)
view
12 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
2029:2045 (<1%)
2125:2141 (<1%)
view
12 x 2 spark/core/src/itest/sca...earch/spark/integration
spark/core/src/itest/sca...earch/spark/integration
485:497 (2%)
540:552 (2%)
view
12 x 2 spark/sql-30/src/itest/j...earch/spark/integration
spark/sql-30/src/itest/j...earch/spark/integration
142:155 (2%)
178:191 (2%)
view
12 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
1983:1997 (<1%)
2224:2238 (<1%)
view
11 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
1985:1997 (<1%)
2079:2091 (<1%)
view
11 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
1801:1811 (<1%)
1873:1883 (<1%)
view
11 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
1962:1972 (<1%)
2203:2213 (<1%)
view
11 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
1917:1927 (<1%)
2150:2160 (<1%)
view
11 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
2100:2110 (<1%)
2150:2160 (<1%)
view
11 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
1962:1972 (<1%)
2248:2258 (<1%)
view
11 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
1917:1927 (<1%)
2100:2110 (<1%)
view
11 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
1801:1811 (<1%)
1836:1846 (<1%)
view
11 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
1760:1770 (<1%)
1801:1811 (<1%)
view
11 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
2150:2160 (<1%)
2203:2213 (<1%)
view
11 x 2 spark/sql-30/src/itest/s...earch/spark/integration
spark/sql-30/src/itest/s...earch/spark/integration
1760:1770 (<1%)
1836:1846 (<1%)
view
Duplicated Units
The list of top 5 duplicated units.
See data for all 5 unit duplicates...
Size#FoldersFilesLinesCode
18 x 2 hive/src/itest/java/org/...hadoop/integration/hive
hive/src/itest/java/org/...hadoop/integration/hive
92:116 
338:362 
view
9 x 2 hive/src/itest/java/org/...hadoop/integration/hive
hive/src/itest/java/org/...hadoop/integration/hive
248:260 
207:219 
view
8 x 2 mr/src/main/java/org/ela...p/serialization/handler
mr/src/main/java/org/ela...adoop/rest/bulk/handler
47:56 
76:85 
view
6 x 3 hive/src/itest/java/org/...hadoop/integration/hive
hive/src/itest/java/org/...hadoop/integration/hive
hive/src/itest/java/org/...hadoop/integration/hive
454:462 
183:191 
278:286 
view
6 x 3 hive/src/itest/java/org/...hadoop/integration/hive
hive/src/itest/java/org/...hadoop/integration/hive
hive/src/itest/java/org/...hadoop/integration/hive
464:471 
193:200 
288:295 
view