Places in code with 6 or more lines that are exactly the same.
| From Component --> To Component |
Duplicated Lines |
File Pairs | Details |
|---|---|---|---|
| cpp-ch (7%) --> gluten-core (11%) |
3894 | 12 file pairs | details... |
| backends-clickhouse (8%) --> shims (10%) |
1491 | 12 file pairs | details... |
| backends-clickhouse (4%) --> backends-velox (11%) |
858 | 18 file pairs | details... |
| backends-clickhouse (3%) --> gluten-core (1%) |
566 | 21 file pairs | details... |
| backends-velox (3%) --> gluten-core (<1%) |
266 | 16 file pairs | details... |
| backends-clickhouse (1%) --> gluten-data (2%) |
254 | 7 file pairs | details... |
| gluten-celeborn (13%) --> gluten-data (2%) |
215 | 4 file pairs | details... |
| backends-clickhouse (1%) --> gluten-celeborn (13%) |
209 | 4 file pairs | details... |
| backends-velox (1%) --> shims (<1%) |
82 | 8 file pairs | details... |
| gluten-core (<1%) --> shims (<1%) |
74 | 5 file pairs | details... |
| gluten-delta (22%) --> shims (<1%) |
56 | 3 file pairs | details... |
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 1175 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | 1:1388 (100%)1:1388 (100%) | view | |
| 202 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | proto |
1:241 (100%)1:241 (100%) | view |
| 193 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 308:623 (53%)310:625 (52%) | view | |
| 193 | x 2 | shims/spark32/src/main/s...park/sql/execution/statshims/spark33/src/main/s...park/sql/execution/stat | 41:354 (100%)41:362 (100%) | view | |
| 134 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | 1:160 (100%)1:160 (100%) | view | |
| 121 | x 2 | shims/spark33/src/main/j...ql/execution/vectorizedshims/spark34/src/main/j...ql/execution/vectorized | 28:221 (100%)28:221 (100%) | view | |
| 115 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | 1:148 (100%)1:148 (100%) | view | |
| 106 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | 1:128 (100%)1:128 (100%) | view | |
| 105 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 287:441 (29%)279:433 (29%) | view | |
| 99 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 463:623 (27%)449:609 (27%) | view | |
| 98 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 140:286 (57%)142:288 (57%) | view | |
| 93 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 51:209 (25%)44:202 (25%) | view | |
| 92 | x 2 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark33/src/main/s...l/execution/datasources | 530:662 (23%)493:625 (25%) | view | |
| 92 | x 2 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark32/src/main/s...l/execution/datasources | 530:662 (23%)491:623 (25%) | view | |
| 81 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 280:395 (29%)301:415 (27%) | view | |
| 79 | x 2 | shims/spark32/src/main/s...park/sql/hive/executionshims/spark33/src/main/s...park/sql/hive/execution | 56:163 (67%)54:160 (61%) | view | |
| 77 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 47:180 (59%)39:172 (59%) | view | |
| 73 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 60:165 (26%)52:157 (25%) | view | |
| 69 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 194:281 (30%)265:352 (24%) | view | |
| 68 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | proto |
1:82 (100%)1:82 (100%) | view |
| 64 | x 2 | cpp-ch/local-engine/proto/substrait/extensionsgluten-core/src/main/res...to/substrait/extensions | 1:81 (100%)1:81 (100%) | view | |
| 63 | x 2 | shims/spark32/src/main/j...ql/execution/vectorizedshims/spark34/src/main/j...ql/execution/vectorized | 63:157 (54%)70:164 (52%) | view | |
| 63 | x 2 | shims/spark32/src/main/j...ql/execution/vectorizedshims/spark33/src/main/j...ql/execution/vectorized | 63:157 (54%)70:164 (52%) | view | |
| 63 | x 2 | backends-clickhouse/src/...es/v2/clickhouse/sourcebackends-clickhouse/src/...es/v2/clickhouse/source | 32:108 (96%)31:107 (98%) | view | |
| 58 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 37:131 (53%)37:136 (53%) | view | |
| 56 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 107:192 (24%)178:263 (19%) | view | |
| 55 | x 2 | shims/spark32/src/main/s...che/spark/sql/executionshims/spark33/src/main/s...che/spark/sql/execution | 74:146 (64%)75:147 (64%) | view | |
| 55 | x 2 | shims/spark32/src/main/s...ecution/datasources/orcshims/spark33/src/main/s...ecution/datasources/orc | 227:300 (28%)191:264 (35%) | view | |
| 54 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 66:154 (15%)58:146 (15%) | view | |
| 54 | x 2 | gluten-celeborn/velox/sr...rg/apache/spark/shufflegluten-data/src/main/sca...lutenproject/vectorized | 175:263 (37%)156:250 (39%) | view | |
| 52 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 67:135 (30%)69:137 (30%) | view | |
| 48 | x 2 | gluten-data/src/main/jav...enproject/columnarbatchgluten-data/src/main/jav...enproject/columnarbatch | 80:157 (61%)38:115 (88%) | view | |
| 48 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 397:462 (17%)417:482 (16%) | view | |
| 45 | x 2 | shims/spark32/src/main/s...che/spark/sql/executionshims/spark33/src/main/s...che/spark/sql/execution | 26:91 (100%)26:91 (100%) | view | |
| 43 | x 2 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark33/src/main/s...l/execution/datasources | 224:308 (10%)202:286 (11%) | view | |
| 43 | x 2 | gluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metrics | 27:76 (97%)23:71 (97%) | view | |
| 41 | x 2 | cpp-ch/local-engine/proto/substraitgluten-core/src/main/res...bstrait/proto/substrait | 1:51 (100%)1:51 (100%) | view | |
| 40 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 159:230 (36%)160:232 (37%) | view | |
| 38 | x 2 | shims/spark32/src/main/s...park/sql/hive/executionshims/spark33/src/main/s...park/sql/hive/execution | 170:223 (32%)182:235 (29%) | view | |
| 37 | x 2 | gluten-core/src/main/res...es/substrait/extensionsgluten-core/src/main/res...es/substrait/extensions | 45:81 (13%)84:120 (13%) | view | |
| 37 | x 2 | gluten-core/src/main/res...es/substrait/extensionsgluten-core/src/main/res...es/substrait/extensions | 6:42 (13%)84:120 (13%) | view | |
| 37 | x 2 | gluten-core/src/main/res...es/substrait/extensionsgluten-core/src/main/res...es/substrait/extensions | 6:42 (13%)45:81 (13%) | view | |
| 36 | x 2 | backends-velox/src/main/...oject/backendsapi/veloxbackends-velox/src/main/...oject/backendsapi/velox | 90:125 (7%)131:166 (7%) | view | |
| 36 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 157:216 (10%)153:212 (10%) | view | |
| 36 | x 2 | shims/spark32/src/main/s...ion/datasources/parquetshims/spark33/src/main/s...ion/datasources/parquet | 223:263 (10%)218:258 (10%) | view | |
| 35 | x 2 | shims/spark32/src/main/s...l/execution/datasourcesshims/spark33/src/main/s...l/execution/datasources | 213:258 (26%)205:250 (26%) | view | |
| 35 | x 2 | tools/gluten-it/common/s...ject/integration/tpc/dstools/gluten-it/common/s...oject/integration/tpc/h | 28:63 (22%)28:63 (46%) | view | |
| 34 | x 2 | shims/spark32/src/main/s...ecution/datasources/orcshims/spark33/src/main/s...ecution/datasources/orc | 106:154 (17%)85:133 (21%) | view | |
| 33 | x 2 | backends-clickhouse/src/...tasources/v1/clickhouseshims/spark33/src/main/s...l/execution/datasources | 398:442 (8%)369:413 (8%) | view | |
| 33 | x 2 | backends-clickhouse/src/...lutenproject/vectorizedgluten-celeborn/clickhou...rg/apache/spark/shuffle | 130:185 (35%)191:246 (25%) | view |
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 78 | x 2 | shims/spark33/src/main/s...park/sql/hive/executionshims/spark32/src/main/s...park/sql/hive/execution | 70:164 72:167 | view | |
| 71 | x 2 | shims/spark33/src/main/s...park/sql/execution/statshims/spark32/src/main/s...park/sql/execution/stat | 276:363 269:355 | view | |
| 48 | x 2 | shims/spark33/src/main/s...ion/datasources/parquetshims/spark32/src/main/s...ion/datasources/parquet | 450:507 464:521 | view | |
| 40 | x 2 | shims/spark33/src/main/s...park/sql/execution/statshims/spark32/src/main/s...park/sql/execution/stat | 75:123 77:124 | view | |
| 39 | x 2 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasources | 81:140 89:148 | view | |
| 39 | x 2 | shims/spark33/src/main/s...park/sql/execution/statshims/spark32/src/main/s...park/sql/execution/stat | 219:273 216:266 | view | |
| 35 | x 2 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasources | 83:131 91:139 | view | |
| 35 | x 3 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasourcesbackends-clickhouse/src/...tasources/v1/clickhouse | 577:614 575:612 614:651 | view | |
| 34 | x 2 | backends-clickhouse/src/...es/v2/clickhouse/sourcebackends-clickhouse/src/...es/v2/clickhouse/source | 70:110 71:111 | view | |
| 33 | x 3 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasourcesbackends-clickhouse/src/...tasources/v1/clickhouse | 501:544 499:542 538:581 | view | |
| 32 | x 2 | backends-clickhouse/src/.../io/glutenproject/utilsgluten-core/src/main/scala/io/glutenproject/utils | 90:125 77:112 | view | |
| 26 | x 2 | gluten-celeborn/velox/sr...rg/apache/spark/shufflegluten-data/src/main/sca...lutenproject/vectorized | 187:215 168:196 | view | |
| 25 | x 2 | shims/spark33/src/main/s...che/spark/sql/executionshims/spark32/src/main/s...che/spark/sql/execution | 117:148 116:147 | view | |
| 24 | x 2 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasources | 231:258 229:256 | view | |
| 22 | x 2 | shims/spark33/src/main/s...ion/datasources/parquetshims/spark32/src/main/s...ion/datasources/parquet | 514:540 528:554 | view | |
| 22 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 112:137 107:132 | view | |
| 21 | x 2 | shims/spark33/src/main/s...che/spark/sql/executionshims/spark32/src/main/s...che/spark/sql/execution | 68:92 68:92 | view | |
| 21 | x 2 | gluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metrics | 50:73 55:78 | view | |
| 20 | x 2 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasources | 409:431 407:429 | view | |
| 20 | x 2 | cpp/velox/benchmarkscpp/velox/benchmarks | 54:83 60:89 | view | |
| 19 | x 2 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasources | 461:484 441:464 | view | |
| 18 | x 3 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasourcesbackends-clickhouse/src/...tasources/v1/clickhouse | 385:407 383:405 414:436 | view | |
| 17 | x 2 | shims/spark34/src/main/s...oject/sql/shims/spark34shims/spark33/src/main/s...oject/sql/shims/spark33 | 89:107 88:106 | view | |
| 17 | x 2 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasources | 267:285 265:283 | view | |
| 17 | x 3 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasourcesbackends-clickhouse/src/...tasources/v1/clickhouse | 547:566 545:564 584:603 | view | |
| 17 | x 2 | shims/spark33/src/main/s...ion/datasources/parquetshims/spark32/src/main/s...ion/datasources/parquet | 590:610 604:624 | view | |
| 17 | x 2 | cpp-ch/local-engine/Storagescpp-ch/local-engine/Storages/ch_parquet | 36:57 99:120 | view | |
| 16 | x 2 | backends-clickhouse/src/...es/v2/clickhouse/sourcebackends-clickhouse/src/...es/v2/clickhouse/source | 39:56 40:57 | view | |
| 15 | x 2 | backends-velox/src/main/...glutenproject/executionbackends-clickhouse/src/...glutenproject/execution | 29:49 29:48 | view | |
| 15 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 73:91 71:89 | view | |
| 14 | x 2 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasources | 64:79 72:87 | view | |
| 14 | x 2 | shims/spark33/src/main/s...che/spark/sql/executionshims/spark32/src/main/s...che/spark/sql/execution | 90:105 89:104 | view | |
| 14 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 381:400 302:321 | view | |
| 13 | x 2 | shims/spark33/src/main/s...ion/datasources/parquetshims/spark32/src/main/s...ion/datasources/parquet | 556:574 570:588 | view | |
| 13 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 419:433 339:353 | view | |
| 12 | x 2 | shims/spark34/src/main/s...che/spark/sql/executionshims/spark33/src/main/s...che/spark/sql/execution | 36:49 36:49 | view | |
| 12 | x 2 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasources | 486:499 484:497 | view | |
| 12 | x 2 | shims/spark33/src/main/s...park/sql/execution/statshims/spark32/src/main/s...park/sql/execution/stat | 155:168 154:167 | view | |
| 12 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 198:213 197:212 | view | |
| 11 | x 2 | shims/spark33/src/main/s...ion/datasources/parquetshims/spark32/src/main/s...ion/datasources/parquet | 218:230 223:235 | view | |
| 11 | x 2 | cpp-ch/local-engine/Operatorcpp-ch/local-engine/Operator | 261:273 36:48 | view | |
| 10 | x 2 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasources | 63:76 63:76 | view | |
| 10 | x 2 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasources | 152:166 159:173 | view | |
| 10 | x 3 | shims/spark33/src/main/s...l/execution/datasourcesshims/spark32/src/main/s...l/execution/datasourcesbackends-clickhouse/src/...tasources/v1/clickhouse | 174:187 181:194 196:209 | view | |
| 10 | x 3 | cpp-ch/local-engine/Operatorcpp-ch/local-engine/Operatorcpp-ch/local-engine/Operator | 37:48 34:45 90:101 | view | |
| 10 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 72:85 67:80 | view | |
| 10 | x 2 | backends-clickhouse/src/...e/spark/sql/delta/filesbackends-clickhouse/src/...e/spark/sql/delta/files | 95:110 90:105 | view | |
| 10 | x 2 | backends-clickhouse/src/.../v1/clickhouse/commandsbackends-clickhouse/src/.../v1/clickhouse/commands | 96:107 94:105 | view | |
| 10 | x 2 | cpp/velox/benchmarkscpp/core/benchmarks | 39:50 41:52 | view | |
| 10 | x 6 | gluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metricsgluten-data/src/main/sca...o/glutenproject/metrics | 23:34 23:34 23:34 23:34 23:34 23:34 | view |
