apache / carbondata
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
Learn more...
Duplication Overall
system11% (15,706 lines)
dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...
Duplication per Extension
java13% (11,583 lines)
scala8% (3,673 lines)
py20% (402 lines)
cpp5% (48 lines)
Duplication per Component (primary)
integration12% (6,497 lines)
core12% (6,334 lines)
processing12% (1,684 lines)
python25% (402 lines)
mv11% (274 lines)
sdk5% (227 lines)
hadoop4% (140 lines)
index4% (77 lines)
streaming4% (44 lines)
tools1% (15 lines)
geo1% (12 lines)
common0% (0 lines)
format0% (0 lines)
ROOT0% (0 lines)
dev0% (0 lines)

Duplication Between Components (50+ lines)

G core core integration integration core--integration 178 processing processing core--processing 108 integration--processing 84 mv mv integration--mv 81 hadoop hadoop hadoop--integration 64

Download: SVG DOT (open online Graphviz editor)

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 50 longest duplicates.
See data for all 1,564 duplicates...
Size#FoldersFilesLinesCode
171 x 2 integration/presto/src/m.../carbondata/presto/impl
integration/presto/src/m.../carbondata/presto/impl
95:371 (76%)
90:366 (80%)
view
138 x 2 integration/presto/src/m...pache/carbondata/presto
integration/presto/src/m...pache/carbondata/presto
138:324 (48%)
144:330 (47%)
view
115 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
45:193 (100%)
45:193 (100%)
view
105 x 2 integration/spark/src/ma....4/org/apache/spark/sql
integration/spark/src/ma....1/org/apache/spark/sql
247:390 (42%)
277:420 (38%)
view
100 x 2 integration/presto/src/m...pache/carbondata/presto
integration/presto/src/m...pache/carbondata/presto
189:325 (53%)
102:238 (76%)
view
99 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
39:185 (100%)
39:185 (100%)
view
85 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
45:162 (100%)
45:162 (100%)
view
58 x 2 core/src/main/java/org/a...ata/core/datastore/page
core/src/main/java/org/a...ata/core/datastore/page
259:344 (22%)
332:417 (17%)
view
58 x 2 core/src/main/java/org/a...ore/scan/collector/impl
core/src/main/java/org/a...ore/scan/collector/impl
74:165 (75%)
46:137 (92%)
view
56 x 2 integration/spark/src/ma....4/org/apache/spark/sql
integration/spark/src/ma....1/org/apache/spark/sql
46:118 (35%)
46:118 (38%)
view
52 x 2 core/src/main/java/org/a.../page/encoding/adaptive
core/src/main/java/org/a.../page/encoding/adaptive
105:186 (25%)
93:174 (27%)
view
50 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
209:272 (12%)
206:269 (12%)
view
43 x 2 integration/spark/src/ma...g/apache/spark/sql/hive
integration/spark/src/ma...g/apache/spark/sql/hive
63:152 (57%)
63:152 (51%)
view
42 x 2 core/src/main/java/org/a.../page/encoding/adaptive
core/src/main/java/org/a.../page/encoding/adaptive
124:179 (12%)
102:157 (14%)
view
41 x 2 integration/presto/src/m.../carbondata/presto/impl
integration/presto/src/m.../carbondata/presto/impl
397:456 (18%)
369:428 (19%)
view
41 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
28:92 (100%)
28:92 (100%)
view
40 x 2 integration/presto/src/m...pache/carbondata/presto
integration/presto/src/m...pache/carbondata/presto
389:450 (13%)
400:461 (13%)
view
38 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
28:87 (100%)
28:87 (100%)
view
38 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
28:87 (100%)
28:87 (100%)
view
37 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
28:86 (100%)
28:86 (100%)
view
37 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
305:350 (9%)
240:284 (9%)
view
37 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
28:86 (100%)
28:86 (100%)
view
37 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
31:89 (100%)
31:89 (100%)
view
37 x 2 integration/spark/src/ma...apache/spark/sql/parser
integration/spark/src/ma...apache/spark/sql/parser
39:77 (88%)
39:77 (88%)
view
37 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
31:89 (100%)
31:89 (100%)
view
37 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
31:89 (100%)
31:89 (100%)
view
36 x 2 integration/spark/src/ma...g/apache/spark/sql/hive
integration/spark/src/ma...g/apache/spark/sql/hive
66:146 (42%)
66:146 (43%)
view
36 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
249:293 (9%)
238:281 (9%)
view
36 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
107:160 (9%)
107:160 (9%)
view
36 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
305:351 (9%)
301:347 (9%)
view
36 x 2 integration/spark/src/ma...g/apache/spark/sql/hive
integration/spark/src/ma...g/apache/spark/sql/hive
66:146 (48%)
66:146 (43%)
view
35 x 2 integration/flink/src/ma...org/apache/carbon/flink
integration/flink/src/ma...org/apache/carbon/flink
101:150 (25%)
108:157 (26%)
view
33 x 2 core/src/main/java/org/a...ore/scan/collector/impl
core/src/main/java/org/a...ore/scan/collector/impl
38:102 (45%)
44:108 (42%)
view
32 x 2 integration/spark/src/ma...apache/spark/sql/parser
integration/spark/src/ma...apache/spark/sql/parser
48:89 (39%)
49:90 (34%)
view
31 x 2 processing/src/main/java...ding/sort/unsafe/holder
processing/src/main/java...rocessing/sort/sortdata
313:366 (17%)
323:376 (16%)
view
30 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
107:150 (7%)
109:152 (7%)
view
29 x 2 core/src/main/java/org/a...ata/core/datastore/page
core/src/main/java/org/a...ata/core/datastore/page
47:89 (29%)
374:416 (8%)
view
29 x 2 core/src/main/java/org/a...ata/core/datastore/page
core/src/main/java/org/a...ata/core/datastore/page
47:89 (29%)
301:343 (11%)
view
29 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
416:466 (7%)
411:461 (7%)
view
29 x 2 integration/presto/src/m...pache/carbondata/presto
integration/presto/src/m...pache/carbondata/presto
77:105 (15%)
64:92 (22%)
view
28 x 2 core/src/main/java/org/a...ata/core/datastore/page
core/src/main/java/org/a...ata/core/datastore/page
212:251 (10%)
63:102 (8%)
view
28 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
438:486 (7%)
434:482 (7%)
view
28 x 2 integration/spark/src/ma...apache/spark/sql/parser
integration/spark/src/ma...apache/spark/sql/parser
100:132 (34%)
100:131 (30%)
view
28 x 2 core/src/main/java/org/a...ata/core/datastore/page
core/src/main/java/org/a...ata/core/datastore/page
387:426 (10%)
272:311 (8%)
view
28 x 2 core/src/main/java/org/a.../page/encoding/adaptive
core/src/main/java/org/a.../page/encoding/compress
407:441 (9%)
437:471 (7%)
view
26 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
305:338 (6%)
237:269 (6%)
view
26 x 2 core/src/main/java/org/a...tastore/page/statistics
core/src/main/java/org/a...tastore/page/statistics
63:88 (9%)
99:124 (9%)
view
26 x 2 core/src/main/java/org/a...ta/core/scan/expression
core/src/main/java/org/a...ta/core/scan/expression
322:354 (6%)
375:407 (6%)
view
25 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
342:373 (6%)
155:184 (6%)
view
25 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
209:241 (6%)
267:298 (6%)
view
Duplicated Units
The list of top 50 duplicated units.
See data for all 86 unit duplicates...
Size#FoldersFilesLinesCode
77 x 2 integration/presto/src/m...pache/carbondata/presto
integration/presto/src/m...pache/carbondata/presto
189:286 
102:199 
view
61 x 2 integration/presto/src/m.../carbondata/presto/impl
integration/presto/src/m.../carbondata/presto/impl
307:372 
302:367 
view
49 x 2 integration/presto/src/m.../carbondata/presto/impl
integration/presto/src/m.../carbondata/presto/impl
178:242 
173:237 
view
42 x 2 integration/presto/src/m...pache/carbondata/presto
integration/presto/src/m...pache/carbondata/presto
242:287 
248:293 
view
38 x 2 core/src/main/java/org/a.../page/encoding/adaptive
core/src/main/java/org/a.../page/encoding/adaptive
133:174 
110:151 
view
38 x 2 integration/spark/src/ma...apache/spark/sql/parser
integration/spark/src/ma...apache/spark/sql/parser
42:81 
42:81 
view
38 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
66:105 
66:105 
view
37 x 2 integration/presto/src/m...pache/carbondata/presto
integration/presto/src/m...pache/carbondata/presto
201:240 
207:246 
view
37 x 2 integration/presto/src/m.../carbondata/presto/impl
integration/presto/src/m.../carbondata/presto/impl
244:287 
239:282 
view
36 x 2 integration/presto/src/m...pache/carbondata/presto
integration/presto/src/m...pache/carbondata/presto
288:326 
201:239 
view
31 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
116:150 
116:150 
view
31 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
118:153 
116:151 
view
29 x 2 integration/presto/src/m...pache/carbondata/presto
integration/presto/src/m...pache/carbondata/presto
77:107 
64:94 
view
28 x 2 core/src/main/java/org/a.../page/encoding/adaptive
core/src/main/java/org/a.../page/encoding/adaptive
114:145 
126:157 
view
28 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
78:107 
78:107 
view
28 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
116:150 
116:150 
view
28 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
152:181 
152:181 
view
27 x 2 core/src/main/java/org/a...ore/scan/collector/impl
core/src/main/java/org/a...ore/scan/collector/impl
74:119 
46:91 
view
26 x 2 processing/src/main/java...rocessing/sort/sortdata
processing/src/main/java...ding/sort/unsafe/holder
212:239 
198:225 
view
26 x 2 processing/src/main/java...rocessing/loading/steps
processing/src/main/java...rocessing/loading/steps
130:165 
93:128 
view
26 x 2 core/src/main/java/org/a...ore/scan/collector/impl
core/src/main/java/org/a...ore/scan/collector/impl
121:153 
93:125 
view
24 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
424:449 
419:444 
view
24 x 2 integration/spark/src/ma...apache/spark/sql/parser
integration/spark/src/ma...apache/spark/sql/parser
49:74 
48:73 
view
22 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
112:135 
112:135 
view
21 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
442:464 
446:468 
view
18 x 3 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
603:622 
584:603 
577:596 
view
18 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
232:256 
174:198 
view
16 x 2 integration/presto/src/m...pache/carbondata/presto
integration/presto/src/m...pache/carbondata/presto
417:436 
428:447 
view
14 x 2 processing/src/main/java...rocessing/loading/steps
processing/src/main/java...rocessing/loading/steps
301:320 
166:185 
view
14 x 2 core/src/main/java/org/a...core/metadata/converter
core/src/main/java/org/apache/carbondata/core/util
622:637 
2068:2083 
view
14 x 2 integration/presto/src/m.../carbondata/presto/impl
integration/presto/src/m.../carbondata/presto/impl
153:169 
148:164 
view
13 x 2 core/src/main/java/org/a.../page/encoding/adaptive
core/src/main/java/org/a.../page/encoding/adaptive
311:325 
285:300 
view
13 x 2 integration/spark/src/ma....1/org/apache/spark/sql
integration/spark/src/ma....4/org/apache/spark/sql
69:83 
69:83 
view
12 x 2 mv/plan/src/main/scala/o...che/carbondata/mv/plans
integration/spark/src/ma...che/spark/sql/optimizer
53:66 
1058:1071 
view
12 x 2 integration/flink/src/ma...org/apache/carbon/flink
integration/flink/src/ma...org/apache/carbon/flink
122:135 
129:142 
view
12 x 3 integration/spark/src/ma....3/org/apache/spark/sql
integration/spark/src/ma....1/org/apache/spark/sql
integration/spark/src/ma....4/org/apache/spark/sql
144:157 
148:161 
173:186 
view
12 x 2 integration/spark/src/ma....3/org/apache/spark/sql
integration/spark/src/ma....4/org/apache/spark/sql
216:229 
258:271 
view
12 x 2 integration/presto/src/m...pache/carbondata/presto
integration/presto/src/m...pache/carbondata/presto
289:302 
295:308 
view
12 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
62:75 
62:75 
view
12 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
142:155 
142:155 
view
12 x 2 integration/presto/src/m.../carbondata/presto/impl
integration/presto/src/m.../carbondata/presto/impl
422:435 
394:407 
view
11 x 2 processing/src/main/java...rocessing/sort/sortdata
processing/src/main/java...ding/sort/unsafe/holder
351:363 
341:353 
view
11 x 2 core/src/main/java/org/a...ta/core/datastore/block
core/src/main/java/org/a...e/metadata/schema/table
397:409 
427:439 
view
11 x 2 core/src/main/java/org/a...re/scan/filter/executer
core/src/main/java/org/a...re/scan/filter/executer
305:319 
301:315 
view
11 x 2 core/src/main/java/org/a...data/core/statusmanager
core/src/main/java/org/a...data/core/statusmanager
574:587 
858:871 
view
11 x 2 integration/spark/src/ma....1/org/apache/spark/sql
integration/spark/src/ma....4/org/apache/spark/sql
85:97 
85:97 
view
11 x 2 integration/presto/src/m...rbondata/presto/readers
integration/presto/src/m...rbondata/presto/readers
142:154 
142:154 
view
10 x 2 core/src/main/java/org/a...scan/expression/logical
core/src/main/java/org/a...scan/expression/logical
37:48 
44:55 
view
10 x 2 core/src/main/java/org/a...ore/scan/collector/impl
core/src/main/java/org/a...ore/scan/collector/impl
52:64 
46:58 
view
10 x 2 core/src/main/java/org/a...e/carbondata/core/locks
core/src/main/java/org/a...e/carbondata/core/locks
69:80 
83:94 
view