Places in code with 6 or more lines that are exactly the same.
| From Component --> To Component |
Duplicated Lines |
File Pairs | Details |
|---|---|---|---|
| cpp-ch (7%) --> gluten-core (11%) |
3894 | 12 file pairs | details... |
| backends-clickhouse (8%) --> shims (10%) |
1491 | 12 file pairs | details... |
| backends-clickhouse (4%) --> backends-velox (11%) |
858 | 18 file pairs | details... |
| backends-clickhouse (3%) --> gluten-core (1%) |
566 | 21 file pairs | details... |
| backends-velox (3%) --> gluten-core (<1%) |
266 | 16 file pairs | details... |
| backends-clickhouse (1%) --> gluten-data (2%) |
254 | 7 file pairs | details... |
| gluten-celeborn (13%) --> gluten-data (2%) |
215 | 4 file pairs | details... |
| backends-clickhouse (1%) --> gluten-celeborn (13%) |
209 | 4 file pairs | details... |
| backends-velox (1%) --> shims (<1%) |
82 | 8 file pairs | details... |
| gluten-core (<1%) --> shims (<1%) |
74 | 5 file pairs | details... |
| gluten-delta (22%) --> shims (<1%) |
56 | 3 file pairs | details... |
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 1175 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | 1:1388 (100%)1:1388 (100%) | view | |
| 202 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | proto |
1:241 (100%)1:241 (100%) | view |
| 193 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 308:623 (53%)310:625 (52%) | view | |
| 193 | x 2 | shims/spark32/src/main/s...park/sql/execution/statshims/spark33/src/main/s...park/sql/execution/stat | 41:354 (100%)41:362 (100%) | view | |
| 134 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | 1:160 (100%)1:160 (100%) | view | |
| 121 | x 2 | shims/spark33/src/main/j...ql/execution/vectorizedshims/spark34/src/main/j...ql/execution/vectorized | 28:221 (100%)28:221 (100%) | view | |
| 115 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | 1:148 (100%)1:148 (100%) | view | |
| 106 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | 1:128 (100%)1:128 (100%) | view | |
| 105 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 287:441 (29%)279:433 (29%) | view | |
| 99 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 463:623 (27%)449:609 (27%) | view | |
| 98 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 140:286 (57%)142:288 (57%) | view | |
| 93 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 51:209 (25%)44:202 (25%) | view | |
| 92 | x 2 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark33/src/main/s...l/execution/datasources | 530:662 (23%)493:625 (25%) | view | |
| 92 | x 2 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark32/src/main/s...l/execution/datasources | 530:662 (23%)491:623 (25%) | view | |
| 81 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 280:395 (29%)301:415 (27%) | view | |
| 79 | x 2 | shims/spark32/src/main/s...park/sql/hive/executionshims/spark33/src/main/s...park/sql/hive/execution | 56:163 (67%)54:160 (61%) | view | |
| 77 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 47:180 (59%)39:172 (59%) | view | |
| 73 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 60:165 (26%)52:157 (25%) | view | |
| 69 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 194:281 (30%)265:352 (24%) | view | |
| 68 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | proto |
1:82 (100%)1:82 (100%) | view |
| 64 | x 2 | cpp-ch/local-engine/proto/substrait/extensionsgluten-core/src/main/res...to/substrait/extensions | 1:81 (100%)1:81 (100%) | view | |
| 63 | x 2 | shims/spark32/src/main/j...ql/execution/vectorizedshims/spark34/src/main/j...ql/execution/vectorized | 63:157 (54%)70:164 (52%) | view | |
| 63 | x 2 | shims/spark32/src/main/j...ql/execution/vectorizedshims/spark33/src/main/j...ql/execution/vectorized | 63:157 (54%)70:164 (52%) | view | |
| 63 | x 2 | backends-clickhouse/src/...es/v2/clickhouse/sourcebackends-clickhouse/src/...es/v2/clickhouse/source | 32:108 (96%)31:107 (98%) | view | |
| 58 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 37:131 (53%)37:136 (53%) | view | |
| 56 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 107:192 (24%)178:263 (19%) | view | |
| 55 | x 2 | shims/spark32/src/main/s...che/spark/sql/executionshims/spark33/src/main/s...che/spark/sql/execution | 74:146 (64%)75:147 (64%) | view | |
| 55 | x 2 | shims/spark32/src/main/s...ecution/datasources/orcshims/spark33/src/main/s...ecution/datasources/orc | 227:300 (28%)191:264 (35%) | view | |
| 54 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 66:154 (15%)58:146 (15%) | view | |
| 54 | x 2 | gluten-celeborn/velox/sr...rg/apache/spark/shufflegluten-data/src/main/sca...lutenproject/vectorized | 175:263 (37%)156:250 (39%) | view | |
| 52 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 67:135 (30%)69:137 (30%) | view | |
| 48 | x 2 | gluten-data/src/main/jav...enproject/columnarbatchgluten-data/src/main/jav...enproject/columnarbatch | 80:157 (61%)38:115 (88%) | view | |
| 48 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 397:462 (17%)417:482 (16%) | view | |
| 45 | x 2 | shims/spark32/src/main/s...che/spark/sql/executionshims/spark33/src/main/s...che/spark/sql/execution | 26:91 (100%)26:91 (100%) | view | |
| 43 | x 2 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark33/src/main/s...l/execution/datasources | 224:308 (10%)202:286 (11%) | view | |
| 43 | x 2 | gluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metrics | 27:76 (97%)23:71 (97%) | view | |
| 41 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | 1:51 (100%)1:51 (100%) | view | |
| 40 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 159:230 (36%)160:232 (37%) | view | |
| 38 | x 2 | shims/spark32/src/main/s...park/sql/hive/executionshims/spark33/src/main/s...park/sql/hive/execution | 170:223 (32%)182:235 (29%) | view | |
| 37 | x 2 | gluten-core/src/main/res...es/substrait/extensionsgluten-core/src/main/res...es/substrait/extensions | 45:81 (13%)84:120 (13%) | view | |
| 37 | x 2 | gluten-core/src/main/res...es/substrait/extensionsgluten-core/src/main/res...es/substrait/extensions | 6:42 (13%)84:120 (13%) | view | |
| 37 | x 2 | gluten-core/src/main/res...es/substrait/extensionsgluten-core/src/main/res...es/substrait/extensions | 6:42 (13%)45:81 (13%) | view | |
| 36 | x 2 | backends-velox/src/main/...oject/backendsapi/veloxbackends-velox/src/main/...oject/backendsapi/velox | 90:125 (7%)131:166 (7%) | view | |
| 36 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 157:216 (10%)153:212 (10%) | view | |
| 36 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 223:263 (10%)218:258 (10%) | view | |
| 35 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 213:258 (26%)205:250 (26%) | view | |
| 35 | x 2 | tools/gluten-it/common/s...ject/integration/tpc/dstools/gluten-it/common/s...oject/integration/tpc/h | 28:63 (22%)28:63 (46%) | view | |
| 34 | x 2 | shims/spark32/src/main/s...ecution/datasources/orcshims/spark33/src/main/s...ecution/datasources/orc | 106:154 (17%)85:133 (21%) | view | |
| 33 | x 2 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark33/src/main/s...l/execution/datasources | 398:442 (8%)369:413 (8%) | view | |
| 33 | x 2 | backends-clickhouse/src/...lutenproject/vectorizedgluten-celeborn/clickhou...rg/apache/spark/shuffle | 130:185 (35%)191:246 (25%) | view |
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 78 | x 2 | shims/spark32/src/main/s...park/sql/hive/executionshims/spark33/src/main/s...park/sql/hive/execution | 72:167 70:164 | view | |
| 71 | x 2 | shims/spark32/src/main/s...park/sql/execution/statshims/spark33/src/main/s...park/sql/execution/stat | 269:355 276:363 | view | |
| 48 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 464:521 450:507 | view | |
| 40 | x 2 | shims/spark32/src/main/s...park/sql/execution/statshims/spark33/src/main/s...park/sql/execution/stat | 77:124 75:123 | view | |
| 39 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 89:148 81:140 | view | |
| 39 | x 2 | shims/spark32/src/main/s...park/sql/execution/statshims/spark33/src/main/s...park/sql/execution/stat | 216:266 219:273 | view | |
| 35 | x 3 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 614:651 575:612 577:614 | view | |
| 35 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 91:139 83:131 | view | |
| 34 | x 2 | backends-clickhouse/src/...es/v2/clickhouse/sourcebackends-clickhouse/src/...es/v2/clickhouse/source | 70:110 71:111 | view | |
| 33 | x 3 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 538:581 499:542 501:544 | view | |
| 32 | x 2 | backends-clickhouse/src/.../io/glutenproject/utilsgluten-core/src/main/scala/io/glutenproject/utils | 90:125 77:112 | view | |
| 26 | x 2 | gluten-celeborn/velox/sr...rg/apache/spark/shufflegluten-data/src/main/sca...lutenproject/vectorized | 187:215 168:196 | view | |
| 25 | x 2 | shims/spark32/src/main/s...che/spark/sql/executionshims/spark33/src/main/s...che/spark/sql/execution | 116:147 117:148 | view | |
| 24 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 229:256 231:258 | view | |
| 22 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 112:137 107:132 | view | |
| 22 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 528:554 514:540 | view | |
| 21 | x 2 | gluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metrics | 55:78 50:73 | view | |
| 21 | x 2 | shims/spark32/src/main/s...che/spark/sql/executionshims/spark33/src/main/s...che/spark/sql/execution | 68:92 68:92 | view | |
| 20 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 407:429 409:431 | view | |
| 20 | x 2 | cpp/velox/benchmarkscpp/velox/benchmarks | 60:89 54:83 | view | |
| 19 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 441:464 461:484 | view | |
| 18 | x 3 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 414:436 383:405 385:407 | view | |
| 17 | x 3 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 584:603 545:564 547:566 | view | |
| 17 | x 2 | cpp-ch/local-engine/Storagescpp-ch/local-engine/Storages/ch_parquet | 36:57 99:120 | view | |
| 17 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 265:283 267:285 | view | |
| 17 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 604:624 590:610 | view | |
| 17 | x 2 | shims/spark33/src/main/s...oject/sql/shims/spark33shims/spark34/src/main/s...oject/sql/shims/spark34 | 88:106 89:107 | view | |
| 16 | x 2 | backends-clickhouse/src/...es/v2/clickhouse/sourcebackends-clickhouse/src/...es/v2/clickhouse/source | 39:56 40:57 | view | |
| 15 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 73:91 71:89 | view | |
| 15 | x 2 | backends-clickhouse/src/...glutenproject/executionbackends-velox/src/main/...glutenproject/execution | 29:48 29:49 | view | |
| 14 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 381:400 302:321 | view | |
| 14 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 72:87 64:79 | view | |
| 14 | x 2 | shims/spark32/src/main/s...che/spark/sql/executionshims/spark33/src/main/s...che/spark/sql/execution | 89:104 90:105 | view | |
| 13 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 419:433 339:353 | view | |
| 13 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 570:588 556:574 | view | |
| 12 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 198:213 197:212 | view | |
| 12 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 484:497 486:499 | view | |
| 12 | x 2 | shims/spark32/src/main/s...park/sql/execution/statshims/spark33/src/main/s...park/sql/execution/stat | 154:167 155:168 | view | |
| 12 | x 2 | shims/spark33/src/main/s...che/spark/sql/executionshims/spark34/src/main/s...che/spark/sql/execution | 36:49 36:49 | view | |
| 11 | x 2 | cpp-ch/local-engine/Operatorcpp-ch/local-engine/Operator | 261:273 36:48 | view | |
| 11 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 223:235 218:230 | view | |
| 10 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 72:85 67:80 | view | |
| 10 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 95:110 90:105 | view | |
| 10 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 96:107 94:105 | view | |
| 10 | x 3 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 196:209 181:194 174:187 | view | |
| 10 | x 3 | cpp-ch/local-engine/Operatorcpp-ch/local-engine/Operatorcpp-ch/local-engine/Operator | 90:101 34:45 37:48 | view | |
| 10 | x 6 | gluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metrics | 23:34 23:34 23:34 23:34 23:34 23:34 | view | |
| 10 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 159:173 152:166 | view | |
| 10 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 63:76 63:76 | view | |
| 10 | x 2 | cpp/core/benchmarkscpp/velox/benchmarks | 41:52 39:50 | view |
