duplicated block id: 1 size: 89 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2363:2471) - native/core/src/parquet/util/bit_packing.rs (2379:2487) duplicated block id: 2 size: 85 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2921:3025) - native/core/src/parquet/util/bit_packing.rs (2957:3061) duplicated block id: 3 size: 76 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2363:2455) - native/core/src/parquet/util/bit_packing.rs (2395:2487) duplicated block id: 4 size: 73 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1849:1935) - native/core/src/parquet/util/bit_packing.rs (1879:1965) duplicated block id: 5 size: 63 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2363:2439) - native/core/src/parquet/util/bit_packing.rs (2411:2487) duplicated block id: 6 size: 61 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (611:677) - native/core/src/parquet/util/bit_packing.rs (621:687) duplicated block id: 7 size: 61 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (977:1045) - native/core/src/parquet/util/bit_packing.rs (1001:1069) duplicated block id: 8 size: 59 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3219:3291) - native/core/src/parquet/util/bit_packing.rs (3295:3367) duplicated block id: 9 size: 56 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2921:2989) - native/core/src/parquet/util/bit_packing.rs (2993:3061) duplicated block id: 10 size: 55 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2633:2699) - native/core/src/parquet/util/bit_packing.rs (2703:2769) duplicated block id: 11 size: 52 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (611:667) - native/core/src/parquet/util/bit_packing.rs (631:687) duplicated block id: 12 size: 51 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2099:2159) - native/core/src/parquet/util/bit_packing.rs (2163:2223) duplicated block id: 13 size: 50 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2363:2423) - native/core/src/parquet/util/bit_packing.rs (2427:2487) duplicated block id: 14 size: 49 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (289:339) - native/core/src/parquet/util/bit_packing.rs (307:357) duplicated block id: 15 size: 48 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1849:1905) - native/core/src/parquet/util/bit_packing.rs (1909:1965) duplicated block id: 16 size: 47 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1609:1663) - native/core/src/parquet/util/bit_packing.rs (1667:1721) duplicated block id: 17 size: 43 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (611:657) - native/core/src/parquet/util/bit_packing.rs (641:687) duplicated block id: 18 size: 43 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1179:1227) - native/core/src/parquet/util/bit_packing.rs (1231:1279) duplicated block id: 19 size: 40 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (977:1021) - native/core/src/parquet/util/bit_packing.rs (1025:1069) duplicated block id: 20 size: 39 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (785:827) - native/core/src/parquet/util/bit_packing.rs (831:873) duplicated block id: 21 size: 37 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2363:2407) - native/core/src/parquet/util/bit_packing.rs (2443:2487) duplicated block id: 22 size: 35 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (443:479) - native/core/src/parquet/util/bit_packing.rs (483:519) duplicated block id: 23 size: 34 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (611:647) - native/core/src/parquet/util/bit_packing.rs (651:687) duplicated block id: 24 size: 32 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (289:321) - native/core/src/parquet/util/bit_packing.rs (325:357) duplicated block id: 25 size: 31 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (146:176) - native/core/src/parquet/util/bit_packing.rs (179:209) duplicated block id: 26 size: 27 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2921:2953) - native/core/src/parquet/util/bit_packing.rs (3029:3061) duplicated block id: 27 size: 25 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (611:637) - native/core/src/parquet/util/bit_packing.rs (661:687) duplicated block id: 28 size: 24 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/correlation.rs (82:107) - native/spark-expr/src/agg_funcs/covariance.rs (91:116) duplicated block id: 29 size: 24 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2363:2391) - native/core/src/parquet/util/bit_packing.rs (2459:2487) duplicated block id: 30 size: 23 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (70:102) - native/spark-expr/src/datetime_funcs/minute.rs (70:102) duplicated block id: 31 size: 23 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/minute.rs (70:102) - native/spark-expr/src/datetime_funcs/second.rs (70:102) duplicated block id: 32 size: 23 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1849:1875) - native/core/src/parquet/util/bit_packing.rs (1939:1965) duplicated block id: 33 size: 23 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (70:102) - native/spark-expr/src/datetime_funcs/second.rs (70:102) duplicated block id: 34 size: 20 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/stddev.rs (100:127) - native/spark-expr/src/agg_funcs/variance.rs (90:117) duplicated block id: 35 size: 20 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (167:187) - native/core/src/parquet/read/column.rs (243:263) duplicated block id: 36 size: 20 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (134:154) - native/core/src/parquet/read/column.rs (167:187) duplicated block id: 37 size: 20 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (134:154) - native/core/src/parquet/read/column.rs (243:263) duplicated block id: 38 size: 19 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (977:997) - native/core/src/parquet/util/bit_packing.rs (1049:1069) duplicated block id: 39 size: 19 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/covariance.rs (173:196) - native/spark-expr/src/agg_funcs/covariance.rs (214:236) duplicated block id: 40 size: 18 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (901:921) - native/spark-expr/src/kernels/temporal.rs (1072:1092) duplicated block id: 41 size: 18 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/BatchReader.java (380:410) - common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java (410:440) duplicated block id: 42 size: 17 cleaned lines of code in 2 files: - native/proto/src/proto/expr.proto (1:20) - native/proto/src/proto/operator.proto (1:20) duplicated block id: 43 size: 17 cleaned lines of code in 2 files: - native/proto/src/proto/expr.proto (1:20) - native/proto/src/proto/partitioning.proto (1:20) duplicated block id: 44 size: 17 cleaned lines of code in 2 files: - native/proto/src/proto/metric.proto (1:20) - native/proto/src/proto/operator.proto (1:20) duplicated block id: 45 size: 17 cleaned lines of code in 2 files: - native/core/Cargo.toml (1:18) - native/proto/Cargo.toml (1:18) duplicated block id: 46 size: 17 cleaned lines of code in 2 files: - native/proto/src/proto/operator.proto (1:20) - native/proto/src/proto/partitioning.proto (1:20) duplicated block id: 47 size: 17 cleaned lines of code in 2 files: - native/proto/Cargo.toml (1:18) - native/spark-expr/Cargo.toml (1:18) duplicated block id: 48 size: 17 cleaned lines of code in 2 files: - native/proto/src/proto/metric.proto (1:20) - native/proto/src/proto/partitioning.proto (1:20) duplicated block id: 49 size: 17 cleaned lines of code in 2 files: - native/proto/src/proto/expr.proto (1:20) - native/proto/src/proto/metric.proto (1:20) duplicated block id: 50 size: 17 cleaned lines of code in 2 files: - native/core/Cargo.toml (1:18) - native/spark-expr/Cargo.toml (1:18) duplicated block id: 51 size: 16 cleaned lines of code in 2 files: - native/Cargo.toml (1:16) - rust-toolchain.toml (1:16) duplicated block id: 52 size: 16 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (611:627) - native/core/src/parquet/util/bit_packing.rs (671:687) duplicated block id: 53 size: 16 cleaned lines of code in 2 files: - native/proto/Cargo.toml (1:16) - rust-toolchain.toml (1:16) duplicated block id: 54 size: 16 cleaned lines of code in 2 files: - native/Cargo.toml (1:16) - native/hdfs/Cargo.toml (1:16) duplicated block id: 55 size: 16 cleaned lines of code in 2 files: - native/Cargo.toml (1:16) - native/rustfmt.toml (1:16) duplicated block id: 56 size: 16 cleaned lines of code in 2 files: - native/rustfmt.toml (1:16) - rust-toolchain.toml (1:16) duplicated block id: 57 size: 16 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/minute.rs (18:34) - native/spark-expr/src/datetime_funcs/second.rs (18:34) duplicated block id: 58 size: 16 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (18:34) - native/spark-expr/src/datetime_funcs/minute.rs (18:34) duplicated block id: 59 size: 16 cleaned lines of code in 2 files: - native/spark-expr/Cargo.toml (1:16) - rust-toolchain.toml (1:16) duplicated block id: 60 size: 16 cleaned lines of code in 2 files: - native/hdfs/Cargo.toml (1:16) - native/rustfmt.toml (1:16) duplicated block id: 61 size: 16 cleaned lines of code in 2 files: - native/spark-expr/benches/aggregate.rs (164:186) - native/spark-expr/src/agg_funcs/sum_decimal.rs (534:556) duplicated block id: 62 size: 16 cleaned lines of code in 2 files: - native/proto/Cargo.toml (1:16) - native/rustfmt.toml (1:16) duplicated block id: 63 size: 16 cleaned lines of code in 2 files: - native/Cargo.toml (1:16) - native/spark-expr/Cargo.toml (1:16) duplicated block id: 64 size: 16 cleaned lines of code in 2 files: - native/Cargo.toml (1:16) - native/core/Cargo.toml (1:16) duplicated block id: 65 size: 16 cleaned lines of code in 2 files: - native/core/Cargo.toml (1:16) - native/rustfmt.toml (1:16) duplicated block id: 66 size: 16 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (18:34) - native/spark-expr/src/datetime_funcs/second.rs (18:34) duplicated block id: 67 size: 16 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometBroadcastExchangeExec.scala (184:202) - spark/src/main/scala/org/apache/spark/sql/comet/CometColumnarToRowExec.scala (128:146) duplicated block id: 68 size: 16 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2564:2583) - native/core/src/execution/planner.rs (2648:2668) duplicated block id: 69 size: 16 cleaned lines of code in 2 files: - native/core/Cargo.toml (1:16) - native/hdfs/Cargo.toml (1:16) duplicated block id: 70 size: 16 cleaned lines of code in 2 files: - native/hdfs/Cargo.toml (1:16) - rust-toolchain.toml (1:16) duplicated block id: 71 size: 16 cleaned lines of code in 2 files: - native/core/Cargo.toml (1:16) - rust-toolchain.toml (1:16) duplicated block id: 72 size: 16 cleaned lines of code in 2 files: - native/hdfs/Cargo.toml (1:16) - native/spark-expr/Cargo.toml (1:16) duplicated block id: 73 size: 16 cleaned lines of code in 2 files: - native/Cargo.toml (1:16) - native/proto/Cargo.toml (1:16) duplicated block id: 74 size: 16 cleaned lines of code in 2 files: - native/hdfs/Cargo.toml (1:16) - native/proto/Cargo.toml (1:16) duplicated block id: 75 size: 16 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (737:756) - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (932:951) duplicated block id: 76 size: 16 cleaned lines of code in 2 files: - native/rustfmt.toml (1:16) - native/spark-expr/Cargo.toml (1:16) duplicated block id: 77 size: 15 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2621:2640) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2694:2713) duplicated block id: 78 size: 15 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (289:303) - native/core/src/parquet/util/bit_packing.rs (343:357) duplicated block id: 79 size: 15 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (973:987) - native/spark-expr/src/kernels/temporal.rs (1008:1022) duplicated block id: 80 size: 14 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (762:779) - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (903:920) duplicated block id: 81 size: 14 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (677:691) - native/spark-expr/src/conversion_funcs/cast.rs (740:754) duplicated block id: 82 size: 14 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2842:2855) - native/core/src/execution/planner.rs (2962:2975) duplicated block id: 83 size: 14 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/parquet/CometParquetFileFormat.scala (157:171) - spark/src/main/scala/org/apache/comet/parquet/CometParquetFileFormat.scala (191:205) duplicated block id: 84 size: 14 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/avg_decimal.rs (223:246) - native/spark-expr/src/agg_funcs/sum_decimal.rs (176:200) duplicated block id: 85 size: 13 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2566:2582) - native/core/src/execution/planner.rs (2918:2934) duplicated block id: 86 size: 13 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (78:91) - native/spark-expr/src/hash_funcs/utils.rs (107:120) duplicated block id: 87 size: 13 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2651:2667) - native/core/src/execution/planner.rs (2918:2934) duplicated block id: 88 size: 13 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometBatchScanExec.scala (51:67) - spark/src/main/scala/org/apache/spark/sql/comet/CometScanExec.scala (251:267) duplicated block id: 89 size: 13 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (728:740) - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (783:795) duplicated block id: 90 size: 13 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:49) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:85) duplicated block id: 91 size: 13 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (145:158) - native/spark-expr/src/hash_funcs/utils.rs (183:196) duplicated block id: 92 size: 12 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (23:34) - native/spark-expr/src/hash_funcs/utils.rs (50:61) duplicated block id: 93 size: 12 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometCollectLimitExec.scala (52:64) - spark/src/main/scala/org/apache/spark/sql/comet/CometTakeOrderedAndProjectExec.scala (51:63) duplicated block id: 94 size: 12 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/parquet/SourceFilterSerde.scala (72:85) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (776:787) duplicated block id: 95 size: 12 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/array_insert.rs (26:37) - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (21:32) duplicated block id: 96 size: 12 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (2606:2617) - native/spark-expr/src/conversion_funcs/cast.rs (2640:2651) duplicated block id: 97 size: 12 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (50:61) - native/spark-expr/src/hash_funcs/utils.rs (184:196) duplicated block id: 98 size: 12 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (544:558) - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (577:591) duplicated block id: 99 size: 12 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (262:273) - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (287:298) duplicated block id: 100 size: 12 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/string_space.rs (21:33) - native/spark-expr/src/string_funcs/substring.rs (21:33) duplicated block id: 101 size: 12 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (129:144) - native/core/src/execution/shuffle/map.rs (339:354) duplicated block id: 102 size: 12 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (2577:2588) - native/spark-expr/src/conversion_funcs/cast.rs (2606:2617) duplicated block id: 103 size: 12 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (23:34) - native/spark-expr/src/hash_funcs/utils.rs (184:196) duplicated block id: 104 size: 12 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (50:61) - native/spark-expr/src/hash_funcs/utils.rs (146:158) duplicated block id: 105 size: 12 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (2577:2588) - native/spark-expr/src/conversion_funcs/cast.rs (2640:2651) duplicated block id: 106 size: 12 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/avg_decimal.rs (392:408) - native/spark-expr/src/agg_funcs/sum_decimal.rs (348:365) duplicated block id: 107 size: 12 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/BatchReader.java (260:272) - common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java (260:272) duplicated block id: 108 size: 12 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (23:34) - native/spark-expr/src/hash_funcs/utils.rs (146:158) duplicated block id: 109 size: 12 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometNativeScanExec.scala (194:212) - spark/src/main/scala/org/apache/spark/sql/comet/CometScanExec.scala (506:524) duplicated block id: 110 size: 11 cleaned lines of code in 2 files: - native/core/benches/filter.rs (96:111) - native/spark-expr/benches/aggregate.rs (185:200) duplicated block id: 111 size: 11 cleaned lines of code in 2 files: - native/core/benches/bloom_filter_agg.rs (147:162) - native/core/benches/filter.rs (96:111) duplicated block id: 112 size: 11 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometNativeScanExec.scala (76:86) - spark/src/main/scala/org/apache/spark/sql/comet/CometScanExec.scala (465:475) duplicated block id: 113 size: 11 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (591:602) - native/spark-expr/src/conversion_funcs/cast.rs (706:717) duplicated block id: 114 size: 11 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffleExchangeExec.scala (136:146) - spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffleExchangeExec.scala (150:160) duplicated block id: 115 size: 11 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (565:576) - native/spark-expr/src/conversion_funcs/cast.rs (627:638) duplicated block id: 116 size: 11 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/murmur3.rs (157:170) - native/spark-expr/src/hash_funcs/xxhash64.rs (103:116) duplicated block id: 117 size: 11 cleaned lines of code in 2 files: - native/core/benches/bloom_filter_agg.rs (147:162) - native/spark-expr/benches/aggregate.rs (185:200) duplicated block id: 118 size: 11 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/correlation.rs (61:80) - native/spark-expr/src/agg_funcs/covariance.rs (69:88) duplicated block id: 119 size: 11 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (2363:2375) - native/core/src/parquet/util/bit_packing.rs (2475:2487) duplicated block id: 120 size: 11 cleaned lines of code in 2 files: - native/core/src/parquet/mod.rs (393:404) - native/core/src/parquet/mod.rs (414:425) duplicated block id: 121 size: 11 cleaned lines of code in 2 files: - native/core/src/common/bit.rs (1349:1362) - native/core/src/common/bit.rs (1399:1412) duplicated block id: 122 size: 11 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/covariance.rs (90:102) - native/spark-expr/src/agg_funcs/stddev.rs (100:112) duplicated block id: 123 size: 11 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/covariance.rs (90:102) - native/spark-expr/src/agg_funcs/variance.rs (90:102) duplicated block id: 124 size: 11 cleaned lines of code in 2 files: - spark/src/main/spark-3.4/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala (41:51) - spark/src/main/spark-3.5/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala (51:61) duplicated block id: 125 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (1123:1133) - native/spark-expr/src/kernels/temporal.rs (1136:1146) duplicated block id: 126 size: 10 cleaned lines of code in 2 files: - spark/src/main/spark-3.4/org/apache/comet/shims/CometExprShim.scala (27:43) - spark/src/main/spark-3.5/org/apache/comet/shims/CometExprShim.scala (27:43) duplicated block id: 127 size: 10 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/arrays.scala (83:92) - spark/src/main/scala/org/apache/comet/serde/arrays.scala (125:134) duplicated block id: 128 size: 10 cleaned lines of code in 2 files: - spark/src/main/spark-3.5/org/apache/comet/shims/CometExprShim.scala (27:43) - spark/src/main/spark-4.0/org/apache/comet/shims/CometExprShim.scala (27:43) duplicated block id: 129 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (23:32) - native/spark-expr/src/hash_funcs/utils.rs (78:87) duplicated block id: 130 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (107:116) - native/spark-expr/src/hash_funcs/utils.rs (184:193) duplicated block id: 131 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1419:1429) - native/core/src/parquet/util/bit_packing.rs (1455:1465) duplicated block id: 132 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1419:1429) - native/core/src/parquet/util/bit_packing.rs (1467:1477) duplicated block id: 133 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1419:1429) - native/core/src/parquet/util/bit_packing.rs (1431:1441) duplicated block id: 134 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1419:1429) - native/core/src/parquet/util/bit_packing.rs (1443:1453) duplicated block id: 135 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/correlation.rs (82:93) - native/spark-expr/src/agg_funcs/variance.rs (91:102) duplicated block id: 136 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (78:87) - native/spark-expr/src/hash_funcs/utils.rs (184:193) duplicated block id: 137 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (1110:1120) - native/spark-expr/src/kernels/temporal.rs (1136:1146) duplicated block id: 138 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (1110:1120) - native/spark-expr/src/kernels/temporal.rs (1123:1133) duplicated block id: 139 size: 10 cleaned lines of code in 2 files: - spark/src/main/spark-3.4/org/apache/comet/shims/CometExprShim.scala (27:43) - spark/src/main/spark-4.0/org/apache/comet/shims/CometExprShim.scala (27:43) duplicated block id: 140 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (78:87) - native/spark-expr/src/hash_funcs/utils.rs (146:155) duplicated block id: 141 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/math_funcs/hex.rs (191:206) - native/spark-expr/src/math_funcs/hex.rs (220:235) duplicated block id: 142 size: 10 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1712:1723) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1729:1740) duplicated block id: 143 size: 10 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/BatchReader.java (172:183) - common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java (169:180) duplicated block id: 144 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (1097:1107) - native/spark-expr/src/kernels/temporal.rs (1136:1146) duplicated block id: 145 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (1097:1107) - native/spark-expr/src/kernels/temporal.rs (1123:1133) duplicated block id: 146 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (1097:1107) - native/spark-expr/src/kernels/temporal.rs (1110:1120) duplicated block id: 147 size: 10 cleaned lines of code in 2 files: - native/hdfs/src/object_store/hdfs.rs (162:172) - native/hdfs/src/object_store/hdfs.rs (211:221) duplicated block id: 148 size: 10 cleaned lines of code in 2 files: - spark/src/main/java/org/apache/spark/shuffle/sort/CometShuffleExternalSorter.java (558:567) - spark/src/main/java/org/apache/spark/shuffle/sort/CometShuffleExternalSorter.java (586:595) duplicated block id: 149 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/bitwise_funcs/bitwise_not.rs (80:95) - native/spark-expr/src/math_funcs/negative.rs (100:118) duplicated block id: 150 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/correlation.rs (82:93) - native/spark-expr/src/agg_funcs/stddev.rs (101:112) duplicated block id: 151 size: 10 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/ColumnReader.java (159:174) - common/src/main/java/org/apache/comet/parquet/NativeColumnReader.java (109:124) duplicated block id: 152 size: 10 cleaned lines of code in 2 files: - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (257:274) - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (303:320) duplicated block id: 153 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1431:1441) - native/core/src/parquet/util/bit_packing.rs (1455:1465) duplicated block id: 154 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1431:1441) - native/core/src/parquet/util/bit_packing.rs (1443:1453) duplicated block id: 155 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (50:59) - native/spark-expr/src/hash_funcs/utils.rs (78:87) duplicated block id: 156 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1431:1441) - native/core/src/parquet/util/bit_packing.rs (1467:1477) duplicated block id: 157 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (50:59) - native/spark-expr/src/hash_funcs/utils.rs (107:116) duplicated block id: 158 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (24:34) - native/spark-expr/src/array_funcs/list_extract.rs (24:34) duplicated block id: 159 size: 10 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/BatchReader.java (205:214) - common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java (204:213) duplicated block id: 160 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (107:116) - native/spark-expr/src/hash_funcs/utils.rs (146:155) duplicated block id: 161 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1407:1417) - native/core/src/parquet/util/bit_packing.rs (1419:1429) duplicated block id: 162 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1395:1405) - native/core/src/parquet/util/bit_packing.rs (1467:1477) duplicated block id: 163 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1407:1417) - native/core/src/parquet/util/bit_packing.rs (1431:1441) duplicated block id: 164 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1395:1405) - native/core/src/parquet/util/bit_packing.rs (1455:1465) duplicated block id: 165 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1407:1417) - native/core/src/parquet/util/bit_packing.rs (1443:1453) duplicated block id: 166 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1407:1417) - native/core/src/parquet/util/bit_packing.rs (1455:1465) duplicated block id: 167 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1395:1405) - native/core/src/parquet/util/bit_packing.rs (1419:1429) duplicated block id: 168 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1395:1405) - native/core/src/parquet/util/bit_packing.rs (1407:1417) duplicated block id: 169 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1395:1405) - native/core/src/parquet/util/bit_packing.rs (1443:1453) duplicated block id: 170 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1395:1405) - native/core/src/parquet/util/bit_packing.rs (1431:1441) duplicated block id: 171 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1455:1465) - native/core/src/parquet/util/bit_packing.rs (1467:1477) duplicated block id: 172 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (19:28) - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (20:29) duplicated block id: 173 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1407:1417) - native/core/src/parquet/util/bit_packing.rs (1467:1477) duplicated block id: 174 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1443:1453) - native/core/src/parquet/util/bit_packing.rs (1455:1465) duplicated block id: 175 size: 10 cleaned lines of code in 2 files: - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (234:251) - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (279:296) duplicated block id: 176 size: 10 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1443:1453) - native/core/src/parquet/util/bit_packing.rs (1467:1477) duplicated block id: 177 size: 10 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (23:32) - native/spark-expr/src/hash_funcs/utils.rs (107:116) duplicated block id: 178 size: 10 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2550:2562) - native/core/src/execution/planner.rs (2634:2646) duplicated block id: 179 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (886:899) - native/spark-expr/src/kernels/temporal.rs (1057:1070) duplicated block id: 180 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (69:85) - native/spark-expr/src/string_funcs/substring.rs (71:87) duplicated block id: 181 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/stddev.rs (48:57) - native/spark-expr/src/agg_funcs/variance.rs (46:55) duplicated block id: 182 size: 9 cleaned lines of code in 2 files: - spark/src/main/spark-3.4/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala (35:45) - spark/src/main/spark-4.0/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala (33:43) duplicated block id: 183 size: 9 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (173:185) - native/core/src/execution/shuffle/map.rs (280:292) duplicated block id: 184 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/math_funcs/hex.rs (222:235) - native/spark-expr/src/math_funcs/hex.rs (251:264) duplicated block id: 185 size: 9 cleaned lines of code in 2 files: - native/spark-expr/benches/cast_from_string.rs (62:76) - native/spark-expr/benches/cast_numeric.rs (55:69) duplicated block id: 186 size: 9 cleaned lines of code in 2 files: - native/core/src/parquet/parquet_support.rs (185:195) - native/spark-expr/src/conversion_funcs/cast.rs (1081:1091) duplicated block id: 187 size: 9 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/BatchReader.java (94:102) - common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java (104:112) duplicated block id: 188 size: 9 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2854:2862) - native/core/src/execution/planner.rs (2974:2982) duplicated block id: 189 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/string_space.rs (24:33) - native/spark-expr/src/struct_funcs/get_struct_field.rs (22:31) duplicated block id: 190 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/list_extract.rs (25:34) - native/spark-expr/src/datetime_funcs/minute.rs (25:34) duplicated block id: 191 size: 9 cleaned lines of code in 2 files: - spark/src/main/spark-3.5/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala (57:68) - spark/src/main/spark-4.0/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala (46:58) duplicated block id: 192 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (25:34) - native/spark-expr/src/datetime_funcs/second.rs (25:34) duplicated block id: 193 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/math_funcs/hex.rs (193:206) - native/spark-expr/src/math_funcs/hex.rs (251:264) duplicated block id: 194 size: 9 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometBroadcastExchangeExec.scala (230:239) - spark/src/main/scala/org/apache/spark/sql/comet/CometColumnarToRowExec.scala (158:167) duplicated block id: 195 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/murmur3.rs (234:242) - native/spark-expr/src/hash_funcs/xxhash64.rs (220:228) duplicated block id: 196 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (25:34) - native/spark-expr/src/datetime_funcs/minute.rs (25:34) duplicated block id: 197 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/list_extract.rs (25:34) - native/spark-expr/src/datetime_funcs/second.rs (25:34) duplicated block id: 198 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/murmur3.rs (234:242) - native/spark-expr/src/hash_funcs/xxhash64.rs (198:206) duplicated block id: 199 size: 9 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2874:2882) - native/core/src/execution/planner.rs (2996:3004) duplicated block id: 200 size: 9 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometNativeScanExec.scala (219:227) - spark/src/main/scala/org/apache/spark/sql/comet/CometScanExec.scala (529:537) duplicated block id: 201 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/murmur3.rs (251:259) - native/spark-expr/src/hash_funcs/xxhash64.rs (220:228) duplicated block id: 202 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/xxhash64.rs (198:206) - native/spark-expr/src/hash_funcs/xxhash64.rs (220:228) duplicated block id: 203 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/array_insert.rs (29:37) - native/spark-expr/src/array_funcs/list_extract.rs (24:32) duplicated block id: 204 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/murmur3.rs (251:259) - native/spark-expr/src/hash_funcs/xxhash64.rs (198:206) duplicated block id: 205 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/covariance.rs (50:59) - native/spark-expr/src/agg_funcs/variance.rs (46:55) duplicated block id: 206 size: 9 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/FileReader.java (712:726) - common/src/main/java/org/apache/comet/parquet/FileReader.java (736:750) duplicated block id: 207 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/list_extract.rs (25:34) - native/spark-expr/src/datetime_funcs/hour.rs (25:34) duplicated block id: 208 size: 9 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (1272:1280) - native/core/src/execution/planner.rs (1346:1354) duplicated block id: 209 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/math_funcs/internal/checkoverflow.rs (25:38) - native/spark-expr/src/math_funcs/internal/normalize_nan.rs (24:33) duplicated block id: 210 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/struct_funcs/create_named_struct.rs (130:138) - native/spark-expr/src/struct_funcs/create_named_struct.rs (147:155) duplicated block id: 211 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (604:613) - native/spark-expr/src/conversion_funcs/cast.rs (720:729) duplicated block id: 212 size: 9 cleaned lines of code in 2 files: - common/src/main/spark-3.4/org/apache/comet/shims/ShimBatchReader.scala (26:35) - common/src/main/spark-3.5/org/apache/comet/shims/ShimBatchReader.scala (26:35) duplicated block id: 213 size: 9 cleaned lines of code in 2 files: - native/core/benches/bit_util.rs (204:215) - native/core/benches/bloom_filter_agg.rs (151:162) duplicated block id: 214 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/stddev.rs (72:88) - native/spark-expr/src/agg_funcs/variance.rs (65:81) duplicated block id: 215 size: 9 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (94:106) - native/core/src/execution/shuffle/map.rs (173:185) duplicated block id: 216 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (25:34) - native/spark-expr/src/datetime_funcs/hour.rs (25:34) duplicated block id: 217 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (556:564) - native/spark-expr/src/conversion_funcs/cast.rs (617:625) duplicated block id: 218 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/covariance.rs (50:59) - native/spark-expr/src/agg_funcs/stddev.rs (48:57) duplicated block id: 219 size: 9 cleaned lines of code in 2 files: - native/core/benches/bit_util.rs (204:215) - native/core/benches/filter.rs (100:111) duplicated block id: 220 size: 9 cleaned lines of code in 2 files: - native/core/benches/bit_util.rs (204:215) - native/spark-expr/benches/aggregate.rs (189:200) duplicated block id: 221 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/substring.rs (24:33) - native/spark-expr/src/struct_funcs/get_struct_field.rs (22:31) duplicated block id: 222 size: 9 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2864:2872) - native/core/src/execution/planner.rs (2985:2993) duplicated block id: 223 size: 9 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (94:106) - native/core/src/execution/shuffle/map.rs (280:292) duplicated block id: 224 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/avg.rs (272:282) - native/spark-expr/src/agg_funcs/avg_decimal.rs (408:418) duplicated block id: 225 size: 9 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/murmur3.rs (234:242) - native/spark-expr/src/hash_funcs/murmur3.rs (251:259) duplicated block id: 226 size: 9 cleaned lines of code in 2 files: - spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle/CometUnsafeShuffleWriter.java (410:420) - spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle/CometUnsafeShuffleWriter.java (479:489) duplicated block id: 227 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3563:3572) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 228 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3563:3572) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 229 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3563:3572) - native/core/src/parquet/util/bit_packing.rs (3619:3628) duplicated block id: 230 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3563:3572) - native/core/src/parquet/util/bit_packing.rs (3611:3620) duplicated block id: 231 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (2623:2630) - native/spark-expr/src/conversion_funcs/cast.rs (2654:2661) duplicated block id: 232 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3563:3572) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 233 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2873:2882) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2923:2932) duplicated block id: 234 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3579:3588) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 235 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3579:3588) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 236 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3579:3588) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 237 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (923:930) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1455:1462) duplicated block id: 238 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3579:3588) - native/core/src/parquet/util/bit_packing.rs (3611:3620) duplicated block id: 239 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3579:3588) - native/core/src/parquet/util/bit_packing.rs (3619:3628) duplicated block id: 240 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 241 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3595:3604) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 242 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (25:32) - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (22:29) duplicated block id: 243 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (711:718) - native/spark-expr/src/conversion_funcs/cast.rs (765:772) duplicated block id: 244 size: 8 cleaned lines of code in 2 files: - native/spark-expr/benches/aggregate.rs (43:51) - native/spark-expr/src/agg_funcs/sum_decimal.rs (488:496) duplicated block id: 245 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3595:3604) - native/core/src/parquet/util/bit_packing.rs (3619:3628) duplicated block id: 246 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3595:3604) - native/core/src/parquet/util/bit_packing.rs (3611:3620) duplicated block id: 247 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3595:3604) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 248 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3595:3604) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 249 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 250 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 251 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 252 size: 8 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2660:2667) - native/core/src/execution/planner.rs (3056:3063) duplicated block id: 253 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3611:3620) duplicated block id: 254 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/utils.rs (155:162) - native/spark-expr/src/utils.rs (174:181) duplicated block id: 255 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3619:3628) duplicated block id: 256 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1419:1427) - native/core/src/parquet/util/bit_packing.rs (1479:1487) duplicated block id: 257 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3555:3564) - native/core/src/parquet/util/bit_packing.rs (3611:3620) duplicated block id: 258 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3555:3564) - native/core/src/parquet/util/bit_packing.rs (3619:3628) duplicated block id: 259 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3555:3564) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 260 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3571:3580) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 261 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3555:3564) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 262 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3571:3580) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 263 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3555:3564) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 264 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3571:3580) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 265 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3587:3596) - native/core/src/parquet/util/bit_packing.rs (3619:3628) duplicated block id: 266 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3587:3596) - native/core/src/parquet/util/bit_packing.rs (3611:3620) duplicated block id: 267 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3587:3596) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 268 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3587:3596) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 269 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/string_space.rs (24:31) - native/spark-expr/src/struct_funcs/create_named_struct.rs (22:29) duplicated block id: 270 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3619:3628) duplicated block id: 271 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3587:3596) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 272 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/array_insert.rs (30:37) - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (22:29) duplicated block id: 273 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3611:3620) duplicated block id: 274 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 275 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 276 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 277 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3571:3580) - native/core/src/parquet/util/bit_packing.rs (3619:3628) duplicated block id: 278 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3571:3580) - native/core/src/parquet/util/bit_packing.rs (3611:3620) duplicated block id: 279 size: 8 cleaned lines of code in 2 files: - native/core/benches/bloom_filter_agg.rs (96:106) - native/spark-expr/benches/aggregate.rs (127:137) duplicated block id: 280 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/avg.rs (100:111) - native/spark-expr/src/agg_funcs/avg_decimal.rs (104:115) duplicated block id: 281 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/avg.rs (295:306) - native/spark-expr/src/agg_funcs/avg_decimal.rs (431:442) duplicated block id: 282 size: 8 cleaned lines of code in 2 files: - native/core/src/execution/expressions/subquery.rs (66:79) - native/spark-expr/src/math_funcs/internal/checkoverflow.rs (82:95) duplicated block id: 283 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (21:28) - native/spark-expr/src/datetime_funcs/hour.rs (25:32) duplicated block id: 284 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (701:709) - native/core/src/parquet/read/column.rs (724:732) duplicated block id: 285 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3619:3628) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 286 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3619:3628) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 287 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3619:3628) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 288 size: 8 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2575:2582) - native/core/src/execution/planner.rs (3056:3063) duplicated block id: 289 size: 8 cleaned lines of code in 2 files: - native/core/benches/bloom_filter_agg.rs (113:121) - native/spark-expr/benches/aggregate.rs (144:152) duplicated block id: 290 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (25:32) - native/spark-expr/src/datetime_funcs/date_trunc.rs (21:28) duplicated block id: 291 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/list_extract.rs (25:32) - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (22:29) duplicated block id: 292 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (25:32) - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (22:29) duplicated block id: 293 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (262:269) - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (306:313) duplicated block id: 294 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1467:1475) - native/core/src/parquet/util/bit_packing.rs (1479:1487) duplicated block id: 295 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (287:294) - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (306:313) duplicated block id: 296 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3555:3564) duplicated block id: 297 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3547:3556) duplicated block id: 298 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/substring.rs (24:31) - native/spark-expr/src/struct_funcs/create_named_struct.rs (22:29) duplicated block id: 299 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3563:3572) duplicated block id: 300 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3539:3548) duplicated block id: 301 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (1293:1300) - native/spark-expr/src/conversion_funcs/cast.rs (1306:1313) duplicated block id: 302 size: 8 cleaned lines of code in 2 files: - native/core/benches/bloom_filter_agg.rs (124:133) - native/spark-expr/benches/aggregate.rs (155:164) duplicated block id: 303 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (545:552) - native/core/src/parquet/read/column.rs (821:828) duplicated block id: 304 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2108:2115) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2144:2151) duplicated block id: 305 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/prediction.rs (29:36) - native/spark-expr/src/struct_funcs/get_struct_field.rs (22:29) duplicated block id: 306 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/struct_funcs/create_named_struct.rs (22:29) - native/spark-expr/src/struct_funcs/get_struct_field.rs (22:29) duplicated block id: 307 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/covariance.rs (69:82) - native/spark-expr/src/agg_funcs/stddev.rs (72:85) duplicated block id: 308 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/avg.rs (238:245) - native/spark-expr/src/agg_funcs/avg_decimal.rs (378:385) duplicated block id: 309 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/prediction.rs (29:36) - native/spark-expr/src/struct_funcs/create_named_struct.rs (22:29) duplicated block id: 310 size: 8 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2927:2934) - native/core/src/execution/planner.rs (3056:3063) duplicated block id: 311 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3627:3636) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 312 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3579:3588) - native/core/src/parquet/util/bit_packing.rs (3603:3612) duplicated block id: 313 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3579:3588) - native/core/src/parquet/util/bit_packing.rs (3587:3596) duplicated block id: 314 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3579:3588) - native/core/src/parquet/util/bit_packing.rs (3595:3604) duplicated block id: 315 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3603:3612) - native/core/src/parquet/util/bit_packing.rs (3619:3628) duplicated block id: 316 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3603:3612) duplicated block id: 317 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3603:3612) - native/core/src/parquet/util/bit_packing.rs (3611:3620) duplicated block id: 318 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3579:3588) duplicated block id: 319 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3603:3612) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 320 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3571:3580) duplicated block id: 321 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3595:3604) duplicated block id: 322 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3627:3636) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 323 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3603:3612) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 324 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3603:3612) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 325 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3587:3596) duplicated block id: 326 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3595:3604) - native/core/src/parquet/util/bit_packing.rs (3603:3612) duplicated block id: 327 size: 8 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/BatchReader.java (215:222) - common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java (215:222) duplicated block id: 328 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/second.rs (25:32) - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (22:29) duplicated block id: 329 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/murmur3.rs (265:272) - native/spark-expr/src/hash_funcs/xxhash64.rs (239:246) duplicated block id: 330 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/correlation.rs (156:164) - native/spark-expr/src/agg_funcs/correlation.rs (176:184) duplicated block id: 331 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3563:3572) - native/core/src/parquet/util/bit_packing.rs (3603:3612) duplicated block id: 332 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/array_insert.rs (30:37) - native/spark-expr/src/datetime_funcs/date_trunc.rs (21:28) duplicated block id: 333 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3563:3572) - native/core/src/parquet/util/bit_packing.rs (3595:3604) duplicated block id: 334 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3563:3572) - native/core/src/parquet/util/bit_packing.rs (3587:3596) duplicated block id: 335 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3563:3572) - native/core/src/parquet/util/bit_packing.rs (3579:3588) duplicated block id: 336 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/array_insert.rs (30:37) - native/spark-expr/src/datetime_funcs/minute.rs (25:32) duplicated block id: 337 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3563:3572) - native/core/src/parquet/util/bit_packing.rs (3571:3580) duplicated block id: 338 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/prediction.rs (29:36) - native/spark-expr/src/string_funcs/substring.rs (24:31) duplicated block id: 339 size: 8 cleaned lines of code in 2 files: - native/core/src/execution/util/spark_bloom_filter.rs (106:115) - native/core/src/execution/util/spark_bloom_filter.rs (123:132) duplicated block id: 340 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3587:3596) duplicated block id: 341 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3595:3604) duplicated block id: 342 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3603:3612) duplicated block id: 343 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3587:3596) - native/core/src/parquet/util/bit_packing.rs (3603:3612) duplicated block id: 344 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3587:3596) - native/core/src/parquet/util/bit_packing.rs (3595:3604) duplicated block id: 345 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1431:1439) - native/core/src/parquet/util/bit_packing.rs (1479:1487) duplicated block id: 346 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/read/values.rs (212:223) - native/core/src/parquet/read/values.rs (366:374) duplicated block id: 347 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (21:28) - native/spark-expr/src/datetime_funcs/minute.rs (25:32) duplicated block id: 348 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/covariance.rs (69:82) - native/spark-expr/src/agg_funcs/variance.rs (65:78) duplicated block id: 349 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1309:1316) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1332:1339) duplicated block id: 350 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3563:3572) duplicated block id: 351 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3571:3580) duplicated block id: 352 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3579:3588) duplicated block id: 353 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/expressions/CometCast.scala (39:46) - spark/src/main/scala/org/apache/comet/testing/ParquetGenerator.scala (48:55) duplicated block id: 354 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3547:3556) - native/core/src/parquet/util/bit_packing.rs (3555:3564) duplicated block id: 355 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3571:3580) - native/core/src/parquet/util/bit_packing.rs (3595:3604) duplicated block id: 356 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3571:3580) - native/core/src/parquet/util/bit_packing.rs (3587:3596) duplicated block id: 357 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3571:3580) - native/core/src/parquet/util/bit_packing.rs (3603:3612) duplicated block id: 358 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (258:265) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (285:292) duplicated block id: 359 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3571:3580) - native/core/src/parquet/util/bit_packing.rs (3579:3588) duplicated block id: 360 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/list_extract.rs (141:149) - native/spark-expr/src/array_funcs/list_extract.rs (153:161) duplicated block id: 361 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/read/values.rs (429:436) - native/core/src/parquet/read/values.rs (693:700) duplicated block id: 362 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/prediction.rs (29:36) - native/spark-expr/src/string_funcs/string_space.rs (24:31) duplicated block id: 363 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3547:3556) duplicated block id: 364 size: 8 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1064:1074) - native/core/src/execution/shuffle/row.rs (1091:1101) duplicated block id: 365 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/read/values.rs (235:249) - native/core/src/parquet/read/values.rs (387:401) duplicated block id: 366 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3555:3564) duplicated block id: 367 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3563:3572) duplicated block id: 368 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3579:3588) duplicated block id: 369 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3571:3580) duplicated block id: 370 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/murmur3.rs (43:51) - native/spark-expr/src/hash_funcs/xxhash64.rs (51:59) duplicated block id: 371 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3635:3644) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 372 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3587:3596) duplicated block id: 373 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3595:3604) duplicated block id: 374 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3539:3548) - native/core/src/parquet/util/bit_packing.rs (3603:3612) duplicated block id: 375 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/array_insert.rs (30:37) - native/spark-expr/src/datetime_funcs/second.rs (25:32) duplicated block id: 376 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/correlation.rs (61:74) - native/spark-expr/src/agg_funcs/variance.rs (65:78) duplicated block id: 377 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/minute.rs (25:32) - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (22:29) duplicated block id: 378 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3611:3620) - native/core/src/parquet/util/bit_packing.rs (3619:3628) duplicated block id: 379 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3555:3564) - native/core/src/parquet/util/bit_packing.rs (3563:3572) duplicated block id: 380 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1395:1403) - native/core/src/parquet/util/bit_packing.rs (1479:1487) duplicated block id: 381 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3555:3564) - native/core/src/parquet/util/bit_packing.rs (3571:3580) duplicated block id: 382 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3555:3564) - native/core/src/parquet/util/bit_packing.rs (3579:3588) duplicated block id: 383 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3555:3564) - native/core/src/parquet/util/bit_packing.rs (3587:3596) duplicated block id: 384 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3555:3564) - native/core/src/parquet/util/bit_packing.rs (3595:3604) duplicated block id: 385 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3555:3564) - native/core/src/parquet/util/bit_packing.rs (3603:3612) duplicated block id: 386 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/correlation.rs (61:74) - native/spark-expr/src/agg_funcs/stddev.rs (72:85) duplicated block id: 387 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3611:3620) - native/core/src/parquet/util/bit_packing.rs (3643:3652) duplicated block id: 388 size: 8 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/shuffle_writer.rs (646:656) - native/core/src/execution/shuffle/shuffle_writer.rs (859:868) duplicated block id: 389 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (1019:1026) - native/spark-expr/src/conversion_funcs/cast.rs (1032:1039) duplicated block id: 390 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3611:3620) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 391 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/arrays.scala (43:54) - spark/src/main/scala/org/apache/comet/serde/arrays.scala (228:238) duplicated block id: 392 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3611:3620) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 393 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1455:1463) - native/core/src/parquet/util/bit_packing.rs (1479:1487) duplicated block id: 394 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/read/values.rs (273:283) - native/core/src/parquet/read/values.rs (382:391) duplicated block id: 395 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1407:1415) - native/core/src/parquet/util/bit_packing.rs (1479:1487) duplicated block id: 396 size: 8 cleaned lines of code in 2 files: - native/core/Cargo.toml (20:27) - native/proto/Cargo.toml (20:27) duplicated block id: 397 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (1443:1451) - native/core/src/parquet/util/bit_packing.rs (1479:1487) duplicated block id: 398 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (783:790) - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (924:931) duplicated block id: 399 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/array_insert.rs (30:37) - native/spark-expr/src/datetime_funcs/hour.rs (25:32) duplicated block id: 400 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (21:28) - native/spark-expr/src/datetime_funcs/second.rs (25:32) duplicated block id: 401 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (728:735) - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (924:931) duplicated block id: 402 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2544:2552) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2588:2596) duplicated block id: 403 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3619:3628) duplicated block id: 404 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3611:3620) duplicated block id: 405 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3635:3644) duplicated block id: 406 size: 8 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (3531:3540) - native/core/src/parquet/util/bit_packing.rs (3627:3636) duplicated block id: 407 size: 8 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/list_extract.rs (25:32) - native/spark-expr/src/datetime_funcs/date_trunc.rs (21:28) duplicated block id: 408 size: 8 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1649:1656) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1664:1671) duplicated block id: 409 size: 7 cleaned lines of code in 2 files: - native/core/benches/parquet_decode.rs (47:56) - native/spark-expr/benches/cast_from_string.rs (67:76) duplicated block id: 410 size: 7 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (325:332) - native/core/src/execution/shuffle/map.rs (359:366) duplicated block id: 411 size: 7 cleaned lines of code in 2 files: - native/core/benches/parquet_decode.rs (47:56) - native/core/benches/shuffle_writer.rs (143:152) duplicated block id: 412 size: 7 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/BatchReader.java (188:196) - common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java (185:193) duplicated block id: 413 size: 7 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1092:1101) - native/core/src/execution/shuffle/row.rs (1127:1136) duplicated block id: 414 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/expressions/CometCast.scala (239:245) - spark/src/main/scala/org/apache/comet/expressions/CometCast.scala (252:258) duplicated block id: 415 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/math_funcs/ceil.rs (18:24) - native/spark-expr/src/math_funcs/floor.rs (18:24) duplicated block id: 416 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (109:120) - native/spark-expr/src/datetime_funcs/second.rs (109:120) duplicated block id: 417 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (173:179) - native/core/src/parquet/read/column.rs (216:222) duplicated block id: 418 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/parquet/CometParquetFileFormat.scala (133:143) - spark/src/main/scala/org/apache/comet/parquet/CometParquetFileFormat.scala (173:183) duplicated block id: 419 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (2555:2563) - native/spark-expr/src/conversion_funcs/cast.rs (2567:2575) duplicated block id: 420 size: 7 cleaned lines of code in 2 files: - native/core/benches/bloom_filter_agg.rs (41:48) - native/spark-expr/benches/aggregate.rs (43:50) duplicated block id: 421 size: 7 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (1130:1136) - native/core/src/parquet/parquet_exec.rs (138:144) duplicated block id: 422 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (251:257) - native/core/src/parquet/read/column.rs (405:411) duplicated block id: 423 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/util/bit_packing.rs (611:617) - native/core/src/parquet/util/bit_packing.rs (681:687) duplicated block id: 424 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (650:656) - native/spark-expr/src/conversion_funcs/cast.rs (711:717) duplicated block id: 425 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (100:111) - native/spark-expr/src/datetime_funcs/minute.rs (109:120) duplicated block id: 426 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/math_funcs/ceil.rs (30:36) - native/spark-expr/src/math_funcs/floor.rs (30:36) duplicated block id: 427 size: 7 cleaned lines of code in 2 files: - native/core/benches/parquet_decode.rs (47:56) - native/spark-expr/benches/cast_numeric.rs (60:69) duplicated block id: 428 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (606:613) - native/spark-expr/src/conversion_funcs/cast.rs (776:783) duplicated block id: 429 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (100:111) - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (138:149) duplicated block id: 430 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (290:296) - native/core/src/parquet/read/column.rs (350:356) duplicated block id: 431 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (181:187) - native/core/src/parquet/read/column.rs (208:214) duplicated block id: 432 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/array_repeat.rs (111:118) - native/spark-expr/src/array_funcs/array_repeat.rs (169:176) duplicated block id: 433 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/string_space.rs (94:105) - native/spark-expr/src/string_funcs/substring.rs (97:108) duplicated block id: 434 size: 7 cleaned lines of code in 2 files: - native/core/benches/shuffle_writer.rs (143:152) - native/spark-expr/benches/cast_numeric.rs (60:69) duplicated block id: 435 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2075:2083) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2105:2113) duplicated block id: 436 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/values.rs (181:187) - native/core/src/parquet/read/values.rs (430:436) duplicated block id: 437 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (614:621) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (682:689) duplicated block id: 438 size: 7 cleaned lines of code in 2 files: - native/core/src/jvm_bridge/mod.rs (58:64) - native/core/src/jvm_bridge/mod.rs (85:91) duplicated block id: 439 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (251:257) - native/core/src/parquet/read/column.rs (292:298) duplicated block id: 440 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (109:120) - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (138:149) duplicated block id: 441 size: 7 cleaned lines of code in 2 files: - native/core/src/execution/operators/copy.rs (79:86) - native/core/src/execution/operators/expand.rs (55:62) duplicated block id: 442 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/parquet/CometParquetFileFormat.scala (121:127) - spark/src/main/scala/org/apache/comet/parquet/CometParquetPartitionReaderFactory.scala (203:209) duplicated block id: 443 size: 7 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (927:933) - native/core/src/execution/planner.rs (972:978) duplicated block id: 444 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (596:602) - native/spark-expr/src/conversion_funcs/cast.rs (765:771) duplicated block id: 445 size: 7 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1065:1074) - native/core/src/execution/shuffle/row.rs (1127:1136) duplicated block id: 446 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (210:216) - native/core/src/parquet/read/column.rs (292:298) duplicated block id: 447 size: 7 cleaned lines of code in 2 files: - native/Cargo.toml (25:31) - native/proto/Cargo.toml (21:27) duplicated block id: 448 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (208:214) - native/core/src/parquet/read/column.rs (257:263) duplicated block id: 449 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (650:656) - native/spark-expr/src/conversion_funcs/cast.rs (765:771) duplicated block id: 450 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/parquet/CometParquetFileFormat.scala (191:197) - spark/src/main/scala/org/apache/comet/parquet/CometParquetPartitionReaderFactory.scala (146:152) duplicated block id: 451 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/murmur3.rs (34:40) - native/spark-expr/src/hash_funcs/xxhash64.rs (42:48) duplicated block id: 452 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/minute.rs (109:120) - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (138:149) duplicated block id: 453 size: 7 cleaned lines of code in 2 files: - common/src/main/scala/org/apache/comet/CometConf.scala (734:740) - common/src/main/scala/org/apache/comet/CometConf.scala (749:755) duplicated block id: 454 size: 7 cleaned lines of code in 2 files: - native/core/src/execution/expressions/subquery.rs (31:38) - native/spark-expr/src/struct_funcs/create_named_struct.rs (24:31) duplicated block id: 455 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (125:133) - native/spark-expr/src/conversion_funcs/cast.rs (1754:1762) duplicated block id: 456 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/values.rs (181:187) - native/core/src/parquet/read/values.rs (694:700) duplicated block id: 457 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (148:154) - native/core/src/parquet/read/column.rs (208:214) duplicated block id: 458 size: 7 cleaned lines of code in 2 files: - native/core/src/jvm_bridge/mod.rs (70:77) - native/core/src/jvm_bridge/mod.rs (97:104) duplicated block id: 459 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (210:216) - native/core/src/parquet/read/column.rs (405:411) duplicated block id: 460 size: 7 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/BatchReader.java (223:235) - common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java (224:237) duplicated block id: 461 size: 7 cleaned lines of code in 2 files: - native/core/benches/bloom_filter_agg.rs (41:48) - native/spark-expr/src/agg_funcs/sum_decimal.rs (488:495) duplicated block id: 462 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/minute.rs (109:120) - native/spark-expr/src/datetime_funcs/second.rs (109:120) duplicated block id: 463 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/math_funcs/internal/checkoverflow.rs (152:163) - native/spark-expr/src/struct_funcs/get_struct_field.rs (102:113) duplicated block id: 464 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometTakeOrderedAndProjectExec.scala (54:60) - spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffleExchangeExec.scala (69:75) duplicated block id: 465 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/parquet/CometParquetFileFormat.scala (157:163) - spark/src/main/scala/org/apache/comet/parquet/CometParquetPartitionReaderFactory.scala (146:152) duplicated block id: 466 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (58:64) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (173:179) duplicated block id: 467 size: 7 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (316:326) - native/core/src/execution/shuffle/row.rs (370:380) duplicated block id: 468 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (94:100) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (173:179) duplicated block id: 469 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/parquet_support.rs (86:92) - native/spark-expr/src/conversion_funcs/cast.rs (829:835) duplicated block id: 470 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (121:132) - native/spark-expr/src/math_funcs/internal/checkoverflow.rs (152:163) duplicated block id: 471 size: 7 cleaned lines of code in 2 files: - native/core/src/execution/operators/copy.rs (19:25) - native/core/src/execution/operators/expand.rs (30:36) duplicated block id: 472 size: 7 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (246:255) - native/core/src/execution/shuffle/map.rs (377:386) duplicated block id: 473 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (175:181) - native/core/src/parquet/read/column.rs (292:298) duplicated block id: 474 size: 7 cleaned lines of code in 2 files: - native/Cargo.toml (25:31) - native/core/Cargo.toml (21:27) duplicated block id: 475 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (140:146) - native/core/src/parquet/read/column.rs (216:222) duplicated block id: 476 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (100:111) - native/spark-expr/src/datetime_funcs/hour.rs (109:120) duplicated block id: 477 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometNativeScanExec.scala (51:57) - spark/src/main/scala/org/apache/spark/sql/comet/CometScanExec.scala (58:64) duplicated block id: 478 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometCollectLimitExec.scala (55:61) - spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/CometShuffleExchangeExec.scala (69:75) duplicated block id: 479 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2845:2853) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2906:2914) duplicated block id: 480 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (210:216) - native/core/src/parquet/read/column.rs (251:257) duplicated block id: 481 size: 7 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/BatchReader.java (510:518) - common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java (501:509) duplicated block id: 482 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (596:602) - native/spark-expr/src/conversion_funcs/cast.rs (650:656) duplicated block id: 483 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/values.rs (561:568) - native/core/src/parquet/read/values.rs (590:597) duplicated block id: 484 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (175:181) - native/core/src/parquet/read/column.rs (210:216) duplicated block id: 485 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (142:148) - native/core/src/parquet/read/column.rs (405:411) duplicated block id: 486 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/second.rs (109:120) - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (138:149) duplicated block id: 487 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/list_extract.rs (91:103) - native/spark-expr/src/struct_funcs/get_struct_field.rs (66:78) duplicated block id: 488 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (292:298) - native/core/src/parquet/read/column.rs (405:411) duplicated block id: 489 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (109:120) - native/spark-expr/src/datetime_funcs/minute.rs (109:120) duplicated block id: 490 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (216:222) - native/core/src/parquet/read/column.rs (249:255) duplicated block id: 491 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (490:497) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (548:555) duplicated block id: 492 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/parquet/SourceFilterSerde.scala (131:138) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (810:817) duplicated block id: 493 size: 7 cleaned lines of code in 2 files: - native/hdfs/Cargo.toml (26:32) - native/spark-expr/Cargo.toml (21:27) duplicated block id: 494 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (142:148) - native/core/src/parquet/read/column.rs (292:298) duplicated block id: 495 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometMetricNode.scala (122:128) - spark/src/main/scala/org/apache/spark/sql/comet/CometMetricNode.scala (138:144) duplicated block id: 496 size: 7 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/shuffle_writer.rs (830:836) - native/core/src/execution/shuffle/shuffle_writer.rs (871:877) duplicated block id: 497 size: 7 cleaned lines of code in 2 files: - native/core/benches/shuffle_writer.rs (143:152) - native/spark-expr/benches/cast_from_string.rs (67:76) duplicated block id: 498 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (722:729) - native/spark-expr/src/conversion_funcs/cast.rs (776:783) duplicated block id: 499 size: 7 cleaned lines of code in 2 files: - native/core/benches/bloom_filter_agg.rs (76:86) - native/spark-expr/benches/aggregate.rs (108:117) duplicated block id: 500 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (201:208) - native/core/src/parquet/read/column.rs (283:290) duplicated block id: 501 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (121:132) - native/spark-expr/src/struct_funcs/get_struct_field.rs (102:113) duplicated block id: 502 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (100:111) - native/spark-expr/src/datetime_funcs/second.rs (109:120) duplicated block id: 503 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (175:181) - native/core/src/parquet/read/column.rs (405:411) duplicated block id: 504 size: 7 cleaned lines of code in 2 files: - native/core/src/errors.rs (636:646) - native/core/src/errors.rs (717:729) duplicated block id: 505 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/parquet_support.rs (73:79) - native/spark-expr/src/conversion_funcs/cast.rs (819:825) duplicated block id: 506 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (2457:2464) - native/spark-expr/src/conversion_funcs/cast.rs (2489:2496) duplicated block id: 507 size: 7 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (58:64) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (94:100) duplicated block id: 508 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (109:116) - native/spark-expr/src/kernels/temporal.rs (134:141) duplicated block id: 509 size: 7 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (1005:1011) - native/spark-expr/src/conversion_funcs/cast.rs (1042:1048) duplicated block id: 510 size: 7 cleaned lines of code in 2 files: - spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle/CometBypassMergeSortShuffleWriter.java (342:350) - spark/src/main/java/org/apache/spark/sql/comet/execution/shuffle/CometUnsafeShuffleWriter.java (532:539) duplicated block id: 511 size: 7 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (142:148) - native/core/src/parquet/read/column.rs (210:216) duplicated block id: 512 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometCollectLimitExec.scala (86:92) - spark/src/main/scala/org/apache/spark/sql/comet/CometTakeOrderedAndProjectExec.scala (93:99) duplicated block id: 513 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 514 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 515 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/serde.rs (135:140) - native/core/src/execution/serde.rs (163:168) duplicated block id: 516 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/arrays.scala (168:173) - spark/src/main/scala/org/apache/comet/serde/arrays.scala (185:190) duplicated block id: 517 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (908:916) - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (961:969) duplicated block id: 518 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (659:664) - native/spark-expr/src/conversion_funcs/cast.rs (778:783) duplicated block id: 519 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/string_space.rs (98:105) - native/spark-expr/src/struct_funcs/get_struct_field.rs (106:113) duplicated block id: 520 size: 6 cleaned lines of code in 2 files: - native/spark-expr/benches/aggregate.rs (57:62) - native/spark-expr/benches/aggregate.rs (86:91) duplicated block id: 521 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/second.rs (87:94) - native/spark-expr/src/string_funcs/string_space.rs (80:87) duplicated block id: 522 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 523 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 524 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (659:664) - native/spark-expr/src/conversion_funcs/cast.rs (724:729) duplicated block id: 525 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 526 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1936:1941) - native/core/src/execution/shuffle/row.rs (2227:2232) duplicated block id: 527 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 528 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (944:950) - native/spark-expr/src/kernels/temporal.rs (953:959) duplicated block id: 529 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 530 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1092:1099) - native/core/src/execution/shuffle/row.rs (1158:1165) duplicated block id: 531 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2891:2896) - native/core/src/execution/planner.rs (3014:3019) duplicated block id: 532 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (1754:1761) - native/spark-expr/src/string_funcs/substring.rs (101:108) duplicated block id: 533 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1936:1941) - native/core/src/execution/shuffle/row.rs (2715:2720) duplicated block id: 534 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/serde.rs (117:122) - native/core/src/execution/serde.rs (163:168) duplicated block id: 535 size: 6 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/BatchReader.java (331:339) - common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java (366:374) duplicated block id: 536 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) duplicated block id: 537 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 538 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 539 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2518:2523) - native/core/src/execution/shuffle/row.rs (2715:2720) duplicated block id: 540 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1005:1012) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1080:1087) duplicated block id: 541 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2877:2882) - native/core/src/execution/planner.rs (2988:2993) duplicated block id: 542 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) duplicated block id: 543 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 544 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 545 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1936:1941) - native/core/src/execution/shuffle/row.rs (2812:2817) duplicated block id: 546 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 547 size: 6 cleaned lines of code in 2 files: - native/core/benches/shuffle_writer.rs (39:44) - native/core/benches/shuffle_writer.rs (62:67) duplicated block id: 548 size: 6 cleaned lines of code in 2 files: - native/core/src/parquet/parquet_support.rs (77:82) - native/core/src/parquet/parquet_support.rs (90:95) duplicated block id: 549 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2033:2038) - native/core/src/execution/shuffle/row.rs (2615:2620) duplicated block id: 550 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2421:2426) - native/core/src/execution/shuffle/row.rs (3006:3011) duplicated block id: 551 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 552 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2867:2872) - native/core/src/execution/planner.rs (2999:3004) duplicated block id: 553 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 554 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 555 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2518:2523) - native/core/src/execution/shuffle/row.rs (2812:2817) duplicated block id: 556 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 557 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2909:2914) - native/core/src/execution/shuffle/row.rs (3006:3011) duplicated block id: 558 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/hash.scala (29:34) - spark/src/main/scala/org/apache/comet/serde/hash.scala (49:54) duplicated block id: 559 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) duplicated block id: 560 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 561 size: 6 cleaned lines of code in 2 files: - native/core/src/errors.rs (686:693) - native/core/src/errors.rs (707:714) duplicated block id: 562 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 563 size: 6 cleaned lines of code in 2 files: - native/core/src/common/bit.rs (1330:1336) - native/core/src/common/bit.rs (1629:1635) duplicated block id: 564 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) duplicated block id: 565 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (1754:1761) - native/spark-expr/src/string_funcs/string_space.rs (98:105) duplicated block id: 566 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 567 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2421:2426) - native/core/src/execution/shuffle/row.rs (2812:2817) duplicated block id: 568 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 569 size: 6 cleaned lines of code in 2 files: - native/core/src/common/bit.rs (1330:1336) - native/core/src/common/bit.rs (1603:1609) duplicated block id: 570 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (233:239) - native/core/src/execution/shuffle/map.rs (267:273) duplicated block id: 571 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) duplicated block id: 572 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1936:1941) - native/core/src/execution/shuffle/row.rs (2324:2329) duplicated block id: 573 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) duplicated block id: 574 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 575 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 576 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 577 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) duplicated block id: 578 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 579 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (689:695) - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (698:704) duplicated block id: 580 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) duplicated block id: 581 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 582 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2078:2083) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2144:2149) duplicated block id: 583 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) duplicated block id: 584 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) duplicated block id: 585 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) duplicated block id: 586 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2130:2135) - native/core/src/execution/shuffle/row.rs (2615:2620) duplicated block id: 587 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/serde.rs (117:122) - native/core/src/execution/serde.rs (135:140) duplicated block id: 588 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/arrays.scala (154:159) - spark/src/main/scala/org/apache/comet/serde/arrays.scala (168:173) duplicated block id: 589 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2021:2027) - native/core/src/execution/planner.rs (2066:2072) duplicated block id: 590 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) duplicated block id: 591 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) duplicated block id: 592 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/arrays.scala (154:159) - spark/src/main/scala/org/apache/comet/serde/arrays.scala (185:190) duplicated block id: 593 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) duplicated block id: 594 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 595 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometTakeOrderedAndProjectExec.scala (107:116) - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (217:226) duplicated block id: 596 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) duplicated block id: 597 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 598 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 599 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 600 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2988:2993) - native/core/src/execution/planner.rs (2999:3004) duplicated block id: 601 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) duplicated block id: 602 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) duplicated block id: 603 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/math_funcs/internal/normalize_nan.rs (59:68) - native/spark-expr/src/string_funcs/substring.rs (71:80) duplicated block id: 604 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2130:2135) - native/core/src/execution/shuffle/row.rs (2518:2523) duplicated block id: 605 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (1022:1027) - native/spark-expr/src/conversion_funcs/cast.rs (1044:1049) duplicated block id: 606 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) duplicated block id: 607 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1936:1941) - native/core/src/execution/shuffle/row.rs (2909:2914) duplicated block id: 608 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/second.rs (109:119) - native/spark-expr/src/string_funcs/substring.rs (97:107) duplicated block id: 609 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/substring.rs (101:108) - native/spark-expr/src/struct_funcs/get_struct_field.rs (106:113) duplicated block id: 610 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2518:2523) - native/core/src/execution/shuffle/row.rs (2909:2914) duplicated block id: 611 size: 6 cleaned lines of code in 2 files: - native/core/src/parquet/read/mod.rs (104:109) - native/core/src/parquet/read/values.rs (156:161) duplicated block id: 612 size: 6 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/FileReader.java (258:263) - common/src/main/java/org/apache/comet/parquet/FileReader.java (326:331) duplicated block id: 613 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2421:2426) - native/core/src/execution/shuffle/row.rs (2909:2914) duplicated block id: 614 size: 6 cleaned lines of code in 2 files: - native/core/src/parquet/read/values.rs (316:321) - native/core/src/parquet/read/values.rs (372:377) duplicated block id: 615 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2033:2038) - native/core/src/execution/shuffle/row.rs (2909:2914) duplicated block id: 616 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 617 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 618 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/utils.rs (89:95) - native/spark-expr/src/utils.rs (101:107) duplicated block id: 619 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) duplicated block id: 620 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2227:2232) - native/core/src/execution/shuffle/row.rs (2421:2426) duplicated block id: 621 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (83:92) - native/core/src/execution/shuffle/map.rs (118:127) duplicated block id: 622 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 623 size: 6 cleaned lines of code in 2 files: - native/core/src/jvm_bridge/comet_metric_node.rs (18:23) - native/core/src/jvm_bridge/comet_task_memory_manager.rs (18:23) duplicated block id: 624 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) duplicated block id: 625 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 626 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) duplicated block id: 627 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 628 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 629 size: 6 cleaned lines of code in 2 files: - native/core/src/parquet/mod.rs (584:589) - native/core/src/parquet/mod.rs (805:810) duplicated block id: 630 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) duplicated block id: 631 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) duplicated block id: 632 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) duplicated block id: 633 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) duplicated block id: 634 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) duplicated block id: 635 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) duplicated block id: 636 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) duplicated block id: 637 size: 6 cleaned lines of code in 2 files: - native/core/src/parquet/mod.rs (280:285) - native/core/src/parquet/mod.rs (507:512) duplicated block id: 638 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 639 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 640 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 641 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) duplicated block id: 642 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 643 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (269:278) - native/core/src/execution/shuffle/map.rs (328:337) duplicated block id: 644 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/serde.rs (98:103) - native/core/src/execution/serde.rs (163:168) duplicated block id: 645 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2033:2038) - native/core/src/execution/shuffle/row.rs (2421:2426) duplicated block id: 646 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 647 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 648 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (116:122) - native/core/src/execution/shuffle/map.rs (156:162) duplicated block id: 649 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (159:164) - native/spark-expr/src/kernels/temporal.rs (187:192) duplicated block id: 650 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 651 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (159:164) - native/spark-expr/src/kernels/temporal.rs (176:181) duplicated block id: 652 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1065:1072) - native/core/src/execution/shuffle/row.rs (1158:1165) duplicated block id: 653 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2324:2329) - native/core/src/execution/shuffle/row.rs (2615:2620) duplicated block id: 654 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2518:2523) - native/core/src/execution/shuffle/row.rs (3006:3011) duplicated block id: 655 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2227:2232) - native/core/src/execution/shuffle/row.rs (2909:2914) duplicated block id: 656 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (985:992) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1005:1012) duplicated block id: 657 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/avg.rs (239:244) - native/spark-expr/src/agg_funcs/avg.rs (276:281) duplicated block id: 658 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/second.rs (87:94) - native/spark-expr/src/string_funcs/substring.rs (83:90) duplicated block id: 659 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) duplicated block id: 660 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/minute.rs (109:119) - native/spark-expr/src/string_funcs/substring.rs (97:107) duplicated block id: 661 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) duplicated block id: 662 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 663 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) duplicated block id: 664 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) duplicated block id: 665 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) duplicated block id: 666 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2421:2426) - native/core/src/execution/shuffle/row.rs (2715:2720) duplicated block id: 667 size: 6 cleaned lines of code in 2 files: - native/spark-expr/benches/aggregate.rs (28:33) - native/spark-expr/src/agg_funcs/sum_decimal.rs (473:478) duplicated block id: 668 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 669 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (985:992) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1080:1087) duplicated block id: 670 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 671 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (693:698) - native/spark-expr/src/conversion_funcs/cast.rs (756:761) duplicated block id: 672 size: 6 cleaned lines of code in 2 files: - native/hdfs/src/object_store/hdfs.rs (134:141) - native/hdfs/src/object_store/hdfs.rs (183:190) duplicated block id: 673 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (1754:1761) - native/spark-expr/src/math_funcs/internal/checkoverflow.rs (156:163) duplicated block id: 674 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2353:2359) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2791:2797) duplicated block id: 675 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) duplicated block id: 676 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (87:94) - native/spark-expr/src/string_funcs/substring.rs (83:90) duplicated block id: 677 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2227:2232) - native/core/src/execution/shuffle/row.rs (2324:2329) duplicated block id: 678 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/murmur3.rs (187:194) - native/spark-expr/src/hash_funcs/xxhash64.rs (133:140) duplicated block id: 679 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (83:92) - native/core/src/execution/shuffle/map.rs (235:244) duplicated block id: 680 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) duplicated block id: 681 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (176:181) - native/spark-expr/src/kernels/temporal.rs (187:192) duplicated block id: 682 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (676:682) - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (698:704) duplicated block id: 683 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1936:1941) - native/core/src/execution/shuffle/row.rs (2033:2038) duplicated block id: 684 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (676:682) - spark/src/main/scala/org/apache/comet/rules/CometExecRule.scala (689:695) duplicated block id: 685 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (157:166) - native/core/src/execution/shuffle/map.rs (361:370) duplicated block id: 686 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 687 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometBroadcastExchangeExec.scala (116:122) - spark/src/main/scala/org/apache/spark/sql/comet/CometColumnarToRowExec.scala (101:107) duplicated block id: 688 size: 6 cleaned lines of code in 2 files: - common/src/main/scala/org/apache/spark/sql/comet/execution/arrow/ArrowReaderIterator.scala (38:49) - spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/NativeBatchDecoderIterator.scala (67:76) duplicated block id: 689 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 690 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (138:148) - native/spark-expr/src/string_funcs/string_space.rs (94:104) duplicated block id: 691 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 692 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 693 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2033:2038) - native/core/src/execution/shuffle/row.rs (3006:3011) duplicated block id: 694 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (578:583) - native/spark-expr/src/conversion_funcs/cast.rs (641:646) duplicated block id: 695 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (767:775) - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (961:969) duplicated block id: 696 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2715:2720) - native/core/src/execution/shuffle/row.rs (2812:2817) duplicated block id: 697 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (926:932) - native/spark-expr/src/kernels/temporal.rs (944:950) duplicated block id: 698 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 699 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1936:1941) - native/core/src/execution/shuffle/row.rs (2130:2135) duplicated block id: 700 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (926:932) - native/spark-expr/src/kernels/temporal.rs (953:959) duplicated block id: 701 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 702 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (926:932) - native/spark-expr/src/kernels/temporal.rs (935:941) duplicated block id: 703 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) duplicated block id: 704 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2227:2232) - native/core/src/execution/shuffle/row.rs (2812:2817) duplicated block id: 705 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 706 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 707 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) duplicated block id: 708 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 709 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (100:110) - native/spark-expr/src/string_funcs/string_space.rs (94:104) duplicated block id: 710 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (129:134) - native/core/src/execution/shuffle/map.rs (208:213) duplicated block id: 711 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 712 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/avg.rs (331:338) - native/spark-expr/src/agg_funcs/avg_decimal.rs (483:490) duplicated block id: 713 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 714 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 715 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 716 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 717 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) duplicated block id: 718 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) duplicated block id: 719 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 720 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (935:941) - native/spark-expr/src/kernels/temporal.rs (953:959) duplicated block id: 721 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2227:2232) - native/core/src/execution/shuffle/row.rs (2715:2720) duplicated block id: 722 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 723 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/kernels/temporal.rs (935:941) - native/spark-expr/src/kernels/temporal.rs (944:950) duplicated block id: 724 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 725 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 726 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 727 size: 6 cleaned lines of code in 2 files: - native/core/benches/common.rs (36:41) - native/core/benches/common.rs (54:59) duplicated block id: 728 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 729 size: 6 cleaned lines of code in 2 files: - native/core/src/common/bit.rs (1603:1609) - native/core/src/common/bit.rs (1629:1635) duplicated block id: 730 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/expressions/subquery.rs (31:36) - native/spark-expr/src/string_funcs/string_space.rs (26:31) duplicated block id: 731 size: 6 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/BatchReader.java (245:255) - common/src/main/java/org/apache/comet/parquet/NativeBatchReader.java (244:254) duplicated block id: 732 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2033:2038) - native/core/src/execution/shuffle/row.rs (2518:2523) duplicated block id: 733 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2855:2861) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (2916:2922) duplicated block id: 734 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2518:2523) - native/core/src/execution/shuffle/row.rs (2615:2620) duplicated block id: 735 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2812:2817) - native/core/src/execution/shuffle/row.rs (3006:3011) duplicated block id: 736 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) duplicated block id: 737 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) duplicated block id: 738 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) duplicated block id: 739 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) duplicated block id: 740 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) duplicated block id: 741 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) duplicated block id: 742 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2715:2720) - native/core/src/execution/shuffle/row.rs (2909:2914) duplicated block id: 743 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 744 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2130:2135) - native/core/src/execution/shuffle/row.rs (2715:2720) duplicated block id: 745 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 746 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (1754:1761) - native/spark-expr/src/struct_funcs/get_struct_field.rs (106:113) duplicated block id: 747 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2033:2038) - native/core/src/execution/shuffle/row.rs (2130:2135) duplicated block id: 748 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 749 size: 6 cleaned lines of code in 2 files: - native/core/src/parquet/read/values.rs (554:559) - native/core/src/parquet/read/values.rs (583:588) duplicated block id: 750 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) duplicated block id: 751 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (710:715) duplicated block id: 752 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) duplicated block id: 753 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (125:132) - native/spark-expr/src/string_funcs/substring.rs (101:108) duplicated block id: 754 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 755 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) duplicated block id: 756 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2130:2135) - native/core/src/execution/shuffle/row.rs (2812:2817) duplicated block id: 757 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) duplicated block id: 758 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 759 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (71:76) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) duplicated block id: 760 size: 6 cleaned lines of code in 2 files: - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (257:262) - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (279:284) duplicated block id: 761 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (24:29) - native/spark-expr/src/math_funcs/internal/normalize_nan.rs (23:28) duplicated block id: 762 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) duplicated block id: 763 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 764 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2227:2232) - native/core/src/execution/shuffle/row.rs (2615:2620) duplicated block id: 765 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 766 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) duplicated block id: 767 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 768 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) duplicated block id: 769 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) duplicated block id: 770 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) duplicated block id: 771 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 772 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2324:2329) - native/core/src/execution/shuffle/row.rs (2421:2426) duplicated block id: 773 size: 6 cleaned lines of code in 2 files: - native/core/src/parquet/parquet_support.rs (211:217) - native/spark-expr/src/conversion_funcs/cast.rs (1100:1106) duplicated block id: 774 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 775 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) duplicated block id: 776 size: 6 cleaned lines of code in 2 files: - common/src/main/scala/org/apache/spark/sql/comet/execution/arrow/ArrowWriters.scala (281:289) - common/src/main/scala/org/apache/spark/sql/comet/execution/arrow/ArrowWriters.scala (296:304) duplicated block id: 777 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) duplicated block id: 778 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 779 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (579:584) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (594:599) duplicated block id: 780 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) duplicated block id: 781 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) duplicated block id: 782 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 783 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) duplicated block id: 784 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 785 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 786 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (1349:1354) - native/spark-expr/src/conversion_funcs/cast.rs (1413:1418) duplicated block id: 787 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2033:2038) - native/core/src/execution/shuffle/row.rs (2227:2232) duplicated block id: 788 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (88:97) - native/spark-expr/src/string_funcs/string_space.rs (63:72) duplicated block id: 789 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 790 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (796:801) - native/core/src/execution/planner.rs (814:819) duplicated block id: 791 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) duplicated block id: 792 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) duplicated block id: 793 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/array_insert.rs (156:161) - native/spark-expr/src/array_funcs/array_insert.rs (165:170) duplicated block id: 794 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 795 size: 6 cleaned lines of code in 2 files: - common/src/main/java/org/apache/comet/parquet/Utils.java (32:37) - common/src/main/java/org/apache/comet/parquet/Utils.java (44:49) duplicated block id: 796 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 797 size: 6 cleaned lines of code in 2 files: - native/hdfs/src/object_store/hdfs.rs (274:279) - native/hdfs/src/object_store/hdfs.rs (330:335) duplicated block id: 798 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 799 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 800 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) duplicated block id: 801 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2324:2329) - native/core/src/execution/shuffle/row.rs (2909:2914) duplicated block id: 802 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) duplicated block id: 803 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) duplicated block id: 804 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2130:2135) - native/core/src/execution/shuffle/row.rs (2227:2232) duplicated block id: 805 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/avg.rs (239:244) - native/spark-expr/src/agg_funcs/avg_decimal.rs (412:417) duplicated block id: 806 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2812:2817) - native/core/src/execution/shuffle/row.rs (2909:2914) duplicated block id: 807 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 808 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 809 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 810 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) duplicated block id: 811 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) duplicated block id: 812 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) duplicated block id: 813 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (100:110) - native/spark-expr/src/string_funcs/substring.rs (97:107) duplicated block id: 814 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) duplicated block id: 815 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 816 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) duplicated block id: 817 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 818 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) duplicated block id: 819 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 820 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 821 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) duplicated block id: 822 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 823 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/sum_decimal.rs (335:340) - native/spark-expr/src/agg_funcs/sum_decimal.rs (403:408) duplicated block id: 824 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 825 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) duplicated block id: 826 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2615:2620) - native/core/src/execution/shuffle/row.rs (2715:2720) duplicated block id: 827 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) duplicated block id: 828 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 829 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2715:2720) - native/core/src/execution/shuffle/row.rs (3006:3011) duplicated block id: 830 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) duplicated block id: 831 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 832 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2033:2038) - native/core/src/execution/shuffle/row.rs (2812:2817) duplicated block id: 833 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (87:94) - native/spark-expr/src/string_funcs/string_space.rs (80:87) duplicated block id: 834 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 835 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2227:2232) - native/core/src/execution/shuffle/row.rs (2518:2523) duplicated block id: 836 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2324:2329) - native/core/src/execution/shuffle/row.rs (2518:2523) duplicated block id: 837 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 838 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (109:119) - native/spark-expr/src/string_funcs/substring.rs (97:107) duplicated block id: 839 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/arrays.scala (98:103) - spark/src/main/scala/org/apache/comet/serde/arrays.scala (199:204) duplicated block id: 840 size: 6 cleaned lines of code in 2 files: - native/core/src/parquet/read/values.rs (155:160) - native/core/src/parquet/read/values.rs (180:185) duplicated block id: 841 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) duplicated block id: 842 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) duplicated block id: 843 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) duplicated block id: 844 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) duplicated block id: 845 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/bitwise_funcs/bitwise_not.rs (115:122) - native/spark-expr/src/math_funcs/negative.rs (203:210) duplicated block id: 846 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2033:2038) - native/core/src/execution/shuffle/row.rs (2715:2720) duplicated block id: 847 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 848 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (728:733) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) duplicated block id: 849 size: 6 cleaned lines of code in 2 files: - native/core/src/parquet/read/column.rs (127:132) - native/core/src/parquet/read/column.rs (271:276) duplicated block id: 850 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 851 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 852 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) duplicated block id: 853 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 854 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 855 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 856 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 857 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) duplicated block id: 858 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/minute.rs (87:94) - native/spark-expr/src/string_funcs/substring.rs (83:90) duplicated block id: 859 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 860 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (423:429) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (549:555) duplicated block id: 861 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2227:2232) - native/core/src/execution/shuffle/row.rs (3006:3011) duplicated block id: 862 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) duplicated block id: 863 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2033:2038) - native/core/src/execution/shuffle/row.rs (2324:2329) duplicated block id: 864 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 865 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) duplicated block id: 866 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2324:2329) - native/core/src/execution/shuffle/row.rs (3006:3011) duplicated block id: 867 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 868 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/hash_funcs/utils.rs (159:164) - native/spark-expr/src/hash_funcs/utils.rs (169:174) duplicated block id: 869 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) duplicated block id: 870 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 871 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2615:2620) - native/core/src/execution/shuffle/row.rs (2812:2817) duplicated block id: 872 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/minute.rs (87:94) - native/spark-expr/src/string_funcs/string_space.rs (80:87) duplicated block id: 873 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 874 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) duplicated block id: 875 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/array_insert.rs (29:34) - native/spark-expr/src/math_funcs/internal/normalize_nan.rs (23:28) duplicated block id: 876 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 877 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) duplicated block id: 878 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 879 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 880 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 881 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 882 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 883 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 884 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 885 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/operators/expand.rs (55:60) - native/core/src/execution/operators/scan.rs (120:127) duplicated block id: 886 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 887 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) duplicated block id: 888 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (671:676) - native/spark-expr/src/conversion_funcs/cast.rs (733:738) duplicated block id: 889 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) duplicated block id: 890 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 891 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1936:1941) - native/core/src/execution/shuffle/row.rs (2421:2426) duplicated block id: 892 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) duplicated block id: 893 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) duplicated block id: 894 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) duplicated block id: 895 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2130:2135) - native/core/src/execution/shuffle/row.rs (3006:3011) duplicated block id: 896 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) duplicated block id: 897 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2615:2620) - native/core/src/execution/shuffle/row.rs (2909:2914) duplicated block id: 898 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2421:2426) - native/core/src/execution/shuffle/row.rs (2615:2620) duplicated block id: 899 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) duplicated block id: 900 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) duplicated block id: 901 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) duplicated block id: 902 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 903 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) duplicated block id: 904 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 905 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) duplicated block id: 906 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) duplicated block id: 907 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/get_array_struct_fields.rs (125:132) - native/spark-expr/src/string_funcs/string_space.rs (98:105) duplicated block id: 908 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/hour.rs (109:119) - native/spark-expr/src/string_funcs/string_space.rs (94:104) duplicated block id: 909 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 910 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 911 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 912 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 913 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 914 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 915 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2130:2135) - native/core/src/execution/shuffle/row.rs (2421:2426) duplicated block id: 916 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/operators/copy.rs (79:84) - native/core/src/execution/operators/scan.rs (120:127) duplicated block id: 917 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) duplicated block id: 918 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 919 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1936:1941) - native/core/src/execution/shuffle/row.rs (3006:3011) duplicated block id: 920 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 921 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (423:429) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (491:497) duplicated block id: 922 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) duplicated block id: 923 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 924 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 925 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 926 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) duplicated block id: 927 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 928 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 929 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 930 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 931 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (660:665) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1199:1204) duplicated block id: 932 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/avg_decimal.rs (379:384) - native/spark-expr/src/agg_funcs/avg_decimal.rs (412:417) duplicated block id: 933 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) duplicated block id: 934 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 935 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) duplicated block id: 936 size: 6 cleaned lines of code in 2 files: - native/spark-expr/benches/cast_from_string.rs (19:25) - native/spark-expr/benches/cast_numeric.rs (19:25) duplicated block id: 937 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 938 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) duplicated block id: 939 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/math_funcs/internal/checkoverflow.rs (156:163) - native/spark-expr/src/string_funcs/string_space.rs (98:105) duplicated block id: 940 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (565:573) - spark/src/main/scala/org/apache/spark/sql/comet/operators.scala (596:604) duplicated block id: 941 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 942 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/expressions/subquery.rs (31:36) - native/spark-expr/src/struct_funcs/get_struct_field.rs (24:29) duplicated block id: 943 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 944 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 945 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) duplicated block id: 946 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (719:724) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 947 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 948 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1936:1941) - native/core/src/execution/shuffle/row.rs (2518:2523) duplicated block id: 949 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) duplicated block id: 950 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (208:213) - native/core/src/execution/shuffle/map.rs (339:344) duplicated block id: 951 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (35:40) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) duplicated block id: 952 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) duplicated block id: 953 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 954 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) duplicated block id: 955 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 956 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 957 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) duplicated block id: 958 size: 6 cleaned lines of code in 2 files: - spark/src/main/spark-3.x/org/apache/comet/shims/ShimCometShuffleExchangeExec.scala (35:40) - spark/src/main/spark-4.0/org/apache/comet/shims/ShimCometShuffleExchangeExec.scala (31:36) duplicated block id: 959 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) duplicated block id: 960 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/serde.rs (98:103) - native/core/src/execution/serde.rs (135:140) duplicated block id: 961 size: 6 cleaned lines of code in 2 files: - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (234:239) - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (257:262) duplicated block id: 962 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 963 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2130:2135) - native/core/src/execution/shuffle/row.rs (2909:2914) duplicated block id: 964 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (372:377) duplicated block id: 965 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) duplicated block id: 966 size: 6 cleaned lines of code in 2 files: - common/src/main/scala/org/apache/spark/sql/comet/execution/arrow/ArrowReaderIterator.scala (61:69) - spark/src/main/scala/org/apache/spark/sql/comet/execution/shuffle/NativeBatchDecoderIterator.scala (88:96) duplicated block id: 967 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 968 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 969 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 970 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2615:2620) - native/core/src/execution/shuffle/row.rs (3006:3011) duplicated block id: 971 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/timestamp_trunc.rs (138:148) - native/spark-expr/src/string_funcs/substring.rs (97:107) duplicated block id: 972 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/minute.rs (109:119) - native/spark-expr/src/string_funcs/string_space.rs (94:104) duplicated block id: 973 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 974 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 975 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (3259:3267) - native/core/src/execution/shuffle/row.rs (3278:3286) duplicated block id: 976 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 977 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/covariance.rs (139:146) - native/spark-expr/src/agg_funcs/variance.rs (132:139) duplicated block id: 978 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 979 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (106:111) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) duplicated block id: 980 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (737:742) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 981 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 982 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (129:134) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 983 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 984 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (564:569) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (579:584) duplicated block id: 985 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/second.rs (109:119) - native/spark-expr/src/string_funcs/string_space.rs (94:104) duplicated block id: 986 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (302:307) duplicated block id: 987 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (564:569) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (594:599) duplicated block id: 988 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 989 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 990 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 991 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2884:2889) - native/core/src/execution/planner.rs (3007:3012) duplicated block id: 992 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (574:579) duplicated block id: 993 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (337:342) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (593:598) duplicated block id: 994 size: 6 cleaned lines of code in 2 files: - native/core/src/errors.rs (139:144) - native/core/src/execution/operators/mod.rs (55:60) duplicated block id: 995 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/agg_funcs/avg.rs (276:281) - native/spark-expr/src/agg_funcs/avg_decimal.rs (379:384) duplicated block id: 996 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2421:2426) - native/core/src/execution/shuffle/row.rs (2518:2523) duplicated block id: 997 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (644:649) duplicated block id: 998 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/conversion_funcs/cast.rs (608:613) - native/spark-expr/src/conversion_funcs/cast.rs (659:664) duplicated block id: 999 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 1000 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1692:1697) duplicated block id: 1001 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (612:617) duplicated block id: 1002 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1701:1706) duplicated block id: 1003 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/map.rs (118:127) - native/core/src/execution/shuffle/map.rs (235:244) duplicated block id: 1004 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/serde.rs (98:103) - native/core/src/execution/serde.rs (117:122) duplicated block id: 1005 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) duplicated block id: 1006 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (509:514) duplicated block id: 1007 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1675:1680) duplicated block id: 1008 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2324:2329) - native/core/src/execution/shuffle/row.rs (2812:2817) duplicated block id: 1009 size: 6 cleaned lines of code in 2 files: - native/core/src/parquet/util/buffer.rs (61:68) - native/core/src/parquet/util/memory.rs (344:352) duplicated block id: 1010 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/datetime_funcs/date_trunc.rs (69:78) - native/spark-expr/src/math_funcs/internal/normalize_nan.rs (59:68) duplicated block id: 1011 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (521:526) duplicated block id: 1012 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) duplicated block id: 1013 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (964:969) duplicated block id: 1014 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) duplicated block id: 1015 size: 6 cleaned lines of code in 2 files: - spark/src/main/spark-3.5/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala (104:109) - spark/src/main/spark-3.5/org/apache/spark/sql/comet/shims/ShimCometScanExec.scala (119:124) duplicated block id: 1016 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2130:2135) - native/core/src/execution/shuffle/row.rs (2324:2329) duplicated block id: 1017 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1127:1134) - native/core/src/execution/shuffle/row.rs (1158:1165) duplicated block id: 1018 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/planner.rs (2867:2872) - native/core/src/execution/planner.rs (2877:2882) duplicated block id: 1019 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/parquet/ParquetFilters.scala (967:972) - spark/src/main/scala/org/apache/comet/parquet/ParquetFilters.scala (978:983) duplicated block id: 1020 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (955:960) duplicated block id: 1021 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/expressions/subquery.rs (31:36) - native/spark-expr/src/string_funcs/substring.rs (26:31) duplicated block id: 1022 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) duplicated block id: 1023 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (906:911) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) duplicated block id: 1024 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (937:942) duplicated block id: 1025 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (701:706) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (946:951) duplicated block id: 1026 size: 6 cleaned lines of code in 2 files: - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (279:284) - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (303:308) duplicated block id: 1027 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (2324:2329) - native/core/src/execution/shuffle/row.rs (2715:2720) duplicated block id: 1028 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) duplicated block id: 1029 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/expressions/subquery.rs (31:36) - native/spark-expr/src/string_funcs/prediction.rs (31:36) duplicated block id: 1030 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/array_funcs/list_extract.rs (24:29) - native/spark-expr/src/math_funcs/internal/normalize_nan.rs (23:28) duplicated block id: 1031 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (746:751) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (755:760) duplicated block id: 1032 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (440:445) duplicated block id: 1033 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (184:189) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (459:464) duplicated block id: 1034 size: 6 cleaned lines of code in 2 files: - native/core/src/parquet/parquet_support.rs (139:145) - native/spark-expr/src/conversion_funcs/cast.rs (890:896) duplicated block id: 1035 size: 6 cleaned lines of code in 2 files: - native/core/src/execution/shuffle/row.rs (1936:1941) - native/core/src/execution/shuffle/row.rs (2615:2620) duplicated block id: 1036 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/string_funcs/string_space.rs (80:87) - native/spark-expr/src/string_funcs/substring.rs (83:90) duplicated block id: 1037 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1165:1170) duplicated block id: 1038 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (228:233) - spark/src/main/scala/org/apache/comet/serde/aggregates.scala (265:270) duplicated block id: 1039 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/spark/sql/comet/CometNativeScanExec.scala (242:247) - spark/src/main/scala/org/apache/spark/sql/comet/CometScanExec.scala (492:497) duplicated block id: 1040 size: 6 cleaned lines of code in 2 files: - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (234:239) - common/src/main/java/org/apache/arrow/c/CometBufferImportTypeVisitor.java (303:308) duplicated block id: 1041 size: 6 cleaned lines of code in 2 files: - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (764:769) - spark/src/main/scala/org/apache/comet/serde/QueryPlanSerde.scala (1174:1179) duplicated block id: 1042 size: 6 cleaned lines of code in 2 files: - native/spark-expr/src/math_funcs/internal/checkoverflow.rs (156:163) - native/spark-expr/src/string_funcs/substring.rs (101:108)