duplicated block id: 1 size: 183 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala (94:278) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala (94:278) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala (94:278) duplicated block id: 2 size: 64 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchSerializer.scala (93:167) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchSerializer.scala (93:167) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchSerializer.scala (93:167) duplicated block id: 3 size: 57 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (944:1011) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (944:1011) duplicated block id: 4 size: 48 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala (35:88) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala (35:88) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala (35:88) duplicated block id: 5 size: 41 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (679:722) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (679:722) duplicated block id: 6 size: 40 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (270:312) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (270:312) duplicated block id: 7 size: 38 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (842:889) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (842:889) duplicated block id: 8 size: 37 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/ConfApi.java (141:191) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/ConfApi.java (141:191) duplicated block id: 9 size: 36 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (325:368) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (325:368) duplicated block id: 10 size: 36 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (226:267) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (226:267) duplicated block id: 11 size: 36 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/LoggerApi.java (73:122) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/LoggerApi.java (73:122) duplicated block id: 12 size: 35 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/LoggerApi.java (144:191) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/LoggerApi.java (144:191) duplicated block id: 13 size: 34 cleaned lines of code in 12 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/ApplicationApi.java (67:114) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/ConfApi.java (68:115) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/ShuffleApi.java (68:115) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/DefaultApi.java (68:115) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/WorkerApi.java (70:117) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/ApplicationApi.java (140:187) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/ConfApi.java (68:115) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/ShuffleApi.java (67:114) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/MasterApi.java (67:114) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/DefaultApi.java (68:115) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/WorkerApi.java (142:189) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/RatisApi.java (142:189) duplicated block id: 14 size: 33 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (86:122) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (86:122) duplicated block id: 15 size: 33 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (95:132) - client-spark/spark-4-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (95:132) - client-spark/spark-3.5-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (95:132) duplicated block id: 16 size: 32 cleaned lines of code in 2 files: - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (399:432) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (399:432) duplicated block id: 17 size: 32 cleaned lines of code in 6 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/LoggerApi.java (194:232) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/WorkerApi.java (256:294) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/ApplicationApi.java (326:364) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/LoggerApi.java (194:232) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/WorkerApi.java (464:502) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/RatisApi.java (736:774) duplicated block id: 18 size: 31 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (159:196) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (159:196) duplicated block id: 19 size: 31 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (168:200) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (170:202) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (170:202) duplicated block id: 20 size: 31 cleaned lines of code in 8 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/ApplicationApi.java (117:155) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/ConfApi.java (194:232) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/ShuffleApi.java (185:223) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/DefaultApi.java (185:223) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/ConfApi.java (194:232) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/ShuffleApi.java (117:155) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/MasterApi.java (117:155) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/DefaultApi.java (185:223) duplicated block id: 21 size: 30 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (135:166) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (137:168) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (137:168) duplicated block id: 22 size: 29 cleaned lines of code in 6 files: - client-flink/flink-1.16/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java (49:79) - client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java (49:79) - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java (50:80) - client-flink/flink-1.19/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java (49:79) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java (50:80) - client-flink/flink-1.18/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartitionFactory.java (49:79) duplicated block id: 23 size: 28 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (390:429) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (390:429) duplicated block id: 24 size: 28 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (735:769) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (735:769) duplicated block id: 25 size: 27 cleaned lines of code in 2 files: - client-tez/tez/src/main/java/org/apache/tez/runtime/library/output/CelebornUnorderedPartitionedKVOutput.java (117:145) - client-tez/tez/src/main/java/org/apache/tez/runtime/library/output/CelebornUnorderedKVOutput.java (127:155) duplicated block id: 26 size: 27 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (276:304) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (276:304) duplicated block id: 27 size: 27 cleaned lines of code in 2 files: - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (216:244) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (216:244) duplicated block id: 28 size: 27 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (779:811) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (779:811) duplicated block id: 29 size: 26 cleaned lines of code in 2 files: - client-tez/tez/src/main/java/org/apache/tez/runtime/library/output/CelebornUnorderedPartitionedKVOutput.java (157:188) - client-tez/tez/src/main/java/org/apache/tez/runtime/library/output/CelebornUnorderedKVOutput.java (167:198) duplicated block id: 30 size: 25 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (395:421) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (395:421) duplicated block id: 31 size: 25 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (493:519) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (493:519) duplicated block id: 32 size: 25 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java (64:90) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java (64:90) duplicated block id: 33 size: 25 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (517:555) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (517:555) duplicated block id: 34 size: 24 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (193:227) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (193:227) duplicated block id: 35 size: 24 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (122:147) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (122:147) duplicated block id: 36 size: 24 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (346:371) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (346:371) duplicated block id: 37 size: 24 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (466:491) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (466:491) duplicated block id: 38 size: 23 cleaned lines of code in 6 files: - client-flink/flink-1.16/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java (43:67) - client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java (43:67) - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java (43:67) - client-flink/flink-1.19/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java (43:67) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java (43:67) - client-flink/flink-1.18/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java (43:67) duplicated block id: 39 size: 23 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (148:178) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (148:178) duplicated block id: 40 size: 23 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (423:449) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (423:449) duplicated block id: 41 size: 23 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java (189:218) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java (189:218) duplicated block id: 42 size: 22 cleaned lines of code in 2 files: - client-tez/tez/src/main/java/org/apache/tez/runtime/library/sort/CelebornSortBasedPusher.java (204:232) - client-mr/mr/src/main/java/org/apache/hadoop/mapred/CelebornSortBasedPusher.java (217:245) duplicated block id: 43 size: 22 cleaned lines of code in 2 files: - client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java (162:185) - client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java (166:189) duplicated block id: 44 size: 21 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (60:82) - client-spark/spark-4-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (60:82) - client-spark/spark-3.5-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (60:82) duplicated block id: 45 size: 20 cleaned lines of code in 2 files: - client-tez/tez/src/main/java/org/apache/tez/runtime/library/sort/CelebornSortBasedPusher.java (245:266) - client-mr/mr/src/main/java/org/apache/hadoop/mapred/CelebornSortBasedPusher.java (258:279) duplicated block id: 46 size: 20 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (449:477) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (449:477) duplicated block id: 47 size: 20 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (199:223) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (199:223) duplicated block id: 48 size: 19 cleaned lines of code in 6 files: - client-flink/flink-1.16/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java (34:55) - client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java (34:55) - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java (34:55) - client-flink/flink-1.19/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java (34:55) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java (34:55) - client-flink/flink-1.18/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleServiceFactory.java (34:55) duplicated block id: 49 size: 19 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressibleColumnBuilder.scala (64:90) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressibleColumnBuilder.scala (64:90) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressibleColumnBuilder.scala (64:90) duplicated block id: 50 size: 18 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (228:247) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (228:247) duplicated block id: 51 size: 18 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (254:273) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (254:273) duplicated block id: 52 size: 18 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (521:543) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (521:543) duplicated block id: 53 size: 18 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (295:314) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (298:317) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (298:317) duplicated block id: 54 size: 18 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (465:484) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (465:484) duplicated block id: 55 size: 16 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (275:292) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (275:292) duplicated block id: 56 size: 16 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (294:311) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (294:311) duplicated block id: 57 size: 16 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java (84:102) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java (84:102) duplicated block id: 58 size: 16 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java (156:173) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java (156:173) duplicated block id: 59 size: 16 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchBuilder.scala (66:83) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchBuilder.scala (67:84) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchBuilder.scala (67:84) duplicated block id: 60 size: 16 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (639:656) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (645:662) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (641:658) duplicated block id: 61 size: 16 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (119:143) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (119:143) duplicated block id: 62 size: 16 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/auth/ApiKeyAuth.java (64:81) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/auth/ApiKeyAuth.java (64:81) duplicated block id: 63 size: 15 cleaned lines of code in 6 files: - client-flink/flink-1.16/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java (60:76) - client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java (60:76) - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java (61:77) - client-flink/flink-1.19/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java (61:77) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java (61:77) - client-flink/flink-1.18/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGate.java (60:76) duplicated block id: 64 size: 15 cleaned lines of code in 4 files: - client-flink/flink-1.16/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java (40:56) - client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java (41:57) - client-flink/flink-1.19/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java (41:57) - client-flink/flink-1.18/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java (41:57) duplicated block id: 65 size: 15 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (192:208) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (192:208) duplicated block id: 66 size: 15 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (230:246) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (230:246) duplicated block id: 67 size: 15 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (431:447) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (431:447) duplicated block id: 68 size: 15 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (322:338) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (322:338) duplicated block id: 69 size: 15 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java (42:58) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleInputGateFactory.java (42:58) duplicated block id: 70 size: 15 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchBuilder.scala (85:101) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchBuilder.scala (86:102) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchBuilder.scala (86:102) duplicated block id: 71 size: 15 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (107:124) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (108:125) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (108:125) duplicated block id: 72 size: 14 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (210:226) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (210:226) duplicated block id: 73 size: 14 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java (149:164) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java (149:164) duplicated block id: 74 size: 14 cleaned lines of code in 2 files: - client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java (134:149) - client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java (157:172) duplicated block id: 75 size: 14 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ServerConfiguration.java (49:67) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ServerConfiguration.java (49:67) duplicated block id: 76 size: 13 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (412:426) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (414:428) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (413:427) duplicated block id: 77 size: 13 cleaned lines of code in 2 files: - client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java (236:250) - client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java (180:194) duplicated block id: 78 size: 13 cleaned lines of code in 2 files: - client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java (451:465) - client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java (281:295) duplicated block id: 79 size: 13 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (906:922) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (906:922) duplicated block id: 80 size: 12 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (175:190) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (175:190) duplicated block id: 81 size: 12 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (480:494) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (480:494) duplicated block id: 82 size: 12 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java (105:118) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java (105:118) duplicated block id: 83 size: 12 cleaned lines of code in 2 files: - worker/src/main/java/org/apache/celeborn/service/deploy/worker/shuffledb/LevelDBIterator.java (42:55) - worker/src/main/java/org/apache/celeborn/service/deploy/worker/shuffledb/RocksDBIterator.java (48:61) duplicated block id: 84 size: 12 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnAccessor.scala (59:75) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnAccessor.scala (59:75) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnAccessor.scala (59:75) duplicated block id: 85 size: 12 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (316:332) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (319:335) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (319:335) duplicated block id: 86 size: 12 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnBuilder.scala (52:68) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnBuilder.scala (52:68) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnBuilder.scala (52:68) duplicated block id: 87 size: 12 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (143:157) - client-spark/spark-4-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (143:157) - client-spark/spark-3.5-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (143:157) duplicated block id: 88 size: 12 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (818:831) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (818:831) duplicated block id: 89 size: 11 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (376:388) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (376:388) duplicated block id: 90 size: 11 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (452:464) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (452:464) duplicated block id: 91 size: 11 cleaned lines of code in 3 files: - client/src/main/java/org/apache/celeborn/client/read/LocalPartitionReader.java (264:276) - client/src/main/java/org/apache/celeborn/client/read/DfsPartitionReader.java (330:342) - client/src/main/java/org/apache/celeborn/client/read/WorkerPartitionReader.java (224:236) duplicated block id: 92 size: 11 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (31:57) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (32:58) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (32:58) duplicated block id: 93 size: 11 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (318:332) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (319:333) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (319:333) duplicated block id: 94 size: 11 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (126:138) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (127:139) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (127:139) duplicated block id: 95 size: 11 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornColumnarShuffleReader.scala (49:61) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornColumnarShuffleReader.scala (49:61) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/shuffle/celeborn/CelebornColumnarShuffleReader.scala (49:61) duplicated block id: 96 size: 10 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (327:338) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (327:338) duplicated block id: 97 size: 10 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (307:320) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (307:320) duplicated block id: 98 size: 10 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (380:393) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (380:393) duplicated block id: 99 size: 10 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (285:296) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (286:297) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (286:297) duplicated block id: 100 size: 10 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnAccessor.scala (43:57) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnAccessor.scala (43:57) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnAccessor.scala (43:57) duplicated block id: 101 size: 10 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (89:100) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (91:102) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (90:101) duplicated block id: 102 size: 10 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (266:277) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (266:277) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (266:277) duplicated block id: 103 size: 10 cleaned lines of code in 2 files: - client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java (215:228) - client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java (159:172) duplicated block id: 104 size: 10 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/StringUtil.java (56:68) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/StringUtil.java (56:68) duplicated block id: 105 size: 9 cleaned lines of code in 2 files: - client-tez/tez/src/main/java/org/apache/tez/runtime/library/output/CelebornUnorderedPartitionedKVOutput.java (80:90) - client-tez/tez/src/main/java/org/apache/tez/runtime/library/output/CelebornUnorderedKVOutput.java (88:98) duplicated block id: 106 size: 9 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (124:134) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (124:134) duplicated block id: 107 size: 9 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (136:146) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferReader.java (136:146) duplicated block id: 108 size: 9 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (248:261) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (248:261) duplicated block id: 109 size: 9 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (545:555) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierConsumerAgent.java (545:555) duplicated block id: 110 size: 9 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java (176:187) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierMasterAgent.java (176:187) duplicated block id: 111 size: 9 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java (118:128) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java (118:128) duplicated block id: 112 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (146:156) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (147:157) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (147:157) duplicated block id: 113 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (161:171) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (162:172) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (162:172) duplicated block id: 114 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (176:186) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (177:187) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (177:187) duplicated block id: 115 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (191:201) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (192:202) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (192:202) duplicated block id: 116 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (206:216) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (207:217) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (207:217) duplicated block id: 117 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (221:231) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (222:232) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (222:232) duplicated block id: 118 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (236:246) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (237:247) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (237:247) duplicated block id: 119 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (251:261) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (252:262) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (252:262) duplicated block id: 120 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (268:278) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (269:279) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (269:279) duplicated block id: 121 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (303:313) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (304:314) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (304:314) duplicated block id: 122 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchSerializer.scala (39:50) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchSerializer.scala (39:50) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchSerializer.scala (39:50) duplicated block id: 123 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (202:212) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (204:214) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (204:214) duplicated block id: 124 size: 9 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (252:264) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (252:264) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (252:264) duplicated block id: 125 size: 9 cleaned lines of code in 2 files: - client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java (438:449) - client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkShuffleManager.java (268:279) duplicated block id: 126 size: 9 cleaned lines of code in 2 files: - client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java (318:331) - client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java (198:211) duplicated block id: 127 size: 9 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (581:591) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (581:591) duplicated block id: 128 size: 9 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (602:612) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (602:612) duplicated block id: 129 size: 9 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/StringUtil.java (33:43) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/StringUtil.java (33:43) duplicated block id: 130 size: 9 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/StringUtil.java (77:87) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/StringUtil.java (77:87) duplicated block id: 131 size: 8 cleaned lines of code in 2 files: - client-tez/tez/src/main/java/org/apache/tez/runtime/library/sort/CelebornSortBasedPusher.java (234:243) - client-mr/mr/src/main/java/org/apache/hadoop/mapred/CelebornSortBasedPusher.java (247:256) duplicated block id: 132 size: 8 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/TierShuffleDescriptorImpl.java (34:43) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/TierShuffleDescriptorImpl.java (34:43) duplicated block id: 133 size: 8 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (314:323) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornTierProducerAgent.java (314:323) duplicated block id: 134 size: 8 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnBuilder.scala (29:39) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnBuilder.scala (29:39) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnBuilder.scala (29:39) duplicated block id: 135 size: 8 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnBuilder.scala (41:50) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnBuilder.scala (41:50) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnBuilder.scala (41:50) duplicated block id: 136 size: 8 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (29:43) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (30:44) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (30:44) duplicated block id: 137 size: 7 cleaned lines of code in 2 files: - client-tez/tez/src/main/java/org/apache/tez/runtime/library/sort/CelebornSortBasedPusher.java (275:283) - client-mr/mr/src/main/java/org/apache/hadoop/mapred/CelebornSortBasedPusher.java (288:296) duplicated block id: 138 size: 7 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (79:88) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (80:89) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (80:89) duplicated block id: 139 size: 7 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchSerializer.scala (57:65) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchSerializer.scala (57:65) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchSerializer.scala (57:65) duplicated block id: 140 size: 7 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala (280:288) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala (280:288) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchCodeGenBuild.scala (280:288) duplicated block id: 141 size: 7 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (69:77) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (71:79) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornCompressionSchemes.scala (71:79) duplicated block id: 142 size: 7 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (229:237) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (229:237) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (229:237) duplicated block id: 143 size: 7 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (140:148) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (141:149) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnAccessor.scala (141:149) duplicated block id: 144 size: 7 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (85:93) - client-spark/spark-4-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (85:93) - client-spark/spark-3.5-columnar-shuffle/src/main/java/org/apache/spark/shuffle/celeborn/ColumnarHashBasedShuffleWriter.java (85:93) duplicated block id: 145 size: 7 cleaned lines of code in 2 files: - client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java (113:121) - client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/SparkUtils.java (135:143) duplicated block id: 146 size: 7 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (306:314) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (306:314) duplicated block id: 147 size: 7 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (321:329) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (321:329) duplicated block id: 148 size: 6 cleaned lines of code in 5 files: - client-flink/flink-1.17/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java (69:76) - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java (69:76) - client-flink/flink-1.19/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java (69:76) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java (69:76) - client-flink/flink-1.18/src/main/java/org/apache/celeborn/plugin/flink/RemoteShuffleResultPartition.java (69:76) duplicated block id: 149 size: 6 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java (130:137) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java (130:137) duplicated block id: 150 size: 6 cleaned lines of code in 2 files: - client-flink/flink-2.0/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java (139:146) - client-flink/flink-1.20/src/main/java/org/apache/celeborn/plugin/flink/tiered/CelebornChannelBufferManager.java (139:146) duplicated block id: 151 size: 6 cleaned lines of code in 2 files: - service/src/main/scala/org/apache/celeborn/server/common/http/authentication/BearerAuthenticationHandler.scala (61:68) - service/src/main/scala/org/apache/celeborn/server/common/http/authentication/BasicAuthenticationHandler.scala (62:69) duplicated block id: 152 size: 6 cleaned lines of code in 2 files: - worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/MapPartitionDataReader.java (532:539) - worker/src/main/java/org/apache/celeborn/service/deploy/worker/storage/segment/SegmentMapPartitionDataReader.java (213:220) duplicated block id: 153 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (63:72) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (64:73) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnBuilder.scala (64:73) duplicated block id: 154 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchBuilder.scala (103:110) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchBuilder.scala (104:111) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnarBatchBuilder.scala (104:111) duplicated block id: 155 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnAccessor.scala (33:41) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnAccessor.scala (33:41) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornNullableColumnAccessor.scala (33:41) duplicated block id: 156 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (204:212) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (206:214) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (205:213) duplicated block id: 157 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (236:244) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (238:246) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (237:245) duplicated block id: 158 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (268:276) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (270:278) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (269:277) duplicated block id: 159 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (300:308) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (302:310) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (301:309) duplicated block id: 160 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (330:338) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (332:340) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (331:339) duplicated block id: 161 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (362:370) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (364:372) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (363:371) duplicated block id: 162 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (394:402) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (396:404) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (395:403) duplicated block id: 163 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (429:436) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (431:438) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (430:437) duplicated block id: 164 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (458:465) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (463:470) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (460:467) duplicated block id: 165 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (61:68) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (61:68) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (61:68) duplicated block id: 166 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (85:92) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (85:92) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (85:92) duplicated block id: 167 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (109:116) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (109:116) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (109:116) duplicated block id: 168 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (133:140) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (133:140) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (133:140) duplicated block id: 169 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (157:164) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (157:164) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (157:164) duplicated block id: 170 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (181:188) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (181:188) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (181:188) duplicated block id: 171 size: 6 cleaned lines of code in 3 files: - client-spark/spark-3-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (205:212) - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (205:212) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnStats.scala (205:212) duplicated block id: 172 size: 6 cleaned lines of code in 2 files: - client-spark/spark-4-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (175:185) - client-spark/spark-3.5-columnar-shuffle/src/main/scala/org/apache/spark/sql/execution/columnar/CelebornColumnType.scala (174:184) duplicated block id: 173 size: 6 cleaned lines of code in 2 files: - client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/SortBasedShuffleWriter.java (244:252) - client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java (188:196) duplicated block id: 174 size: 6 cleaned lines of code in 2 files: - client-spark/spark-3/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java (360:367) - client-spark/spark-2/src/main/java/org/apache/spark/shuffle/celeborn/HashBasedShuffleWriter.java (325:332) duplicated block id: 175 size: 6 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model/RatisPeer.java (118:125) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/model/MasterLeader.java (118:125) duplicated block id: 176 size: 6 cleaned lines of code in 2 files: - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/worker/invoker/ApiClient.java (495:505) - openapi/openapi-client/src/main/java/org/apache/celeborn/rest/v1/master/invoker/ApiClient.java (495:505)