duplicated block id: 1 size: 64 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/reader/DataSourceReader.scala (182:267) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/reader/OdpsScan.scala (159:244) duplicated block id: 2 size: 41 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/ArrowUtils.java (86:128) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/ArrowUtils.java (86:128) duplicated block id: 3 size: 37 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/mapreduce/odps/HdfsOdpsImportJob.java (702:749) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/ExportJobBase.java (128:175) duplicated block id: 4 size: 36 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (63:101) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (62:100) duplicated block id: 5 size: 35 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/mapreduce/SQLServerExportOutputFormat.java (61:109) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/OracleExportOutputFormat.java (61:109) duplicated block id: 6 size: 28 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/mapreduce/odps/HdfsOdpsImportJob.java (755:789) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/ExportJobBase.java (181:215) duplicated block id: 7 size: 22 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/mapreduce/GenericRecordExportMapper.java (50:79) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/odps/ParquetExportMapper.java (53:82) duplicated block id: 8 size: 19 cleaned lines of code in 3 files: - spark-connector/common/src/main/scala/org/apache/spark/sql/odps/OdpsUtils.scala (224:244) - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (41:61) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (40:60) duplicated block id: 9 size: 19 cleaned lines of code in 2 files: - spark-connector/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala (970:990) - spark-connector/datasource/src/main/scala/org/apache/spark/sql/execution/datasources/v2/odps/OdpsTableCatalog.scala (678:698) duplicated block id: 10 size: 18 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeSplitManager.java (109:130) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeSplitManager.java (109:130) duplicated block id: 11 size: 17 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeMetadata.java (163:181) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeMetadata.java (164:182) duplicated block id: 12 size: 17 cleaned lines of code in 2 files: - spark-connector/hive/src/main/scala/org/apache/spark/sql/hive/execution/OdpsTableWriter.scala (221:241) - spark-connector/datasource/src/main/scala/org/apache/spark/sql/execution/datasources/v2/odps/OdpsBatchWrite.scala (107:127) duplicated block id: 13 size: 17 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/mapreduce/AutoProgressReducer.java (41:64) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/AutoProgressMapper.java (56:79) duplicated block id: 14 size: 16 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/mapreduce/odps/HdfsOdpsImportJob.java (199:221) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/ExportJobBase.java (303:325) duplicated block id: 15 size: 15 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/writer/DynamicPartitionWriter.scala (81:100) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/writer/DynamicPartitionWriter.scala (87:106) duplicated block id: 16 size: 14 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeTableHandle.java (105:120) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeTableHandle.java (105:120) duplicated block id: 17 size: 13 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/MaxComputeUtils.java (69:83) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/MaxComputeUtils.java (71:85) duplicated block id: 18 size: 13 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/ArrowUtils.java (195:209) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/ArrowUtils.java (195:209) duplicated block id: 19 size: 13 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeTableHandle.java (47:61) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeTableHandle.java (47:61) duplicated block id: 20 size: 13 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/mapreduce/SQLServerResilientUpdateOutputFormat.java (52:68) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/UpdateOutputFormat.java (56:72) duplicated block id: 21 size: 12 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/ArrowToPageConverter.java (56:70) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/ArrowToPageConverter.java (53:67) duplicated block id: 22 size: 12 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeInputSplit.java (45:58) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeInputSplit.java (45:58) duplicated block id: 23 size: 12 cleaned lines of code in 3 files: - odps-sqoop/src/java/org/apache/sqoop/mapreduce/ExportOutputFormat.java (55:70) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/ExportCallOutputFormat.java (56:71) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/SQLServerResilientExportOutputFormat.java (64:79) duplicated block id: 24 size: 12 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/writer/SinglePartitionWriter.scala (82:97) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/writer/SinglePartitionWriter.scala (87:102) duplicated block id: 25 size: 12 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (103:116) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (102:115) duplicated block id: 26 size: 12 cleaned lines of code in 2 files: - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/writer/SinglePartitionWriter.scala (72:85) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/writer/DynamicPartitionWriter.scala (72:85) duplicated block id: 27 size: 11 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/MaxComputeMetaCache.java (32:46) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/MaxComputeMetaCache.java (32:46) duplicated block id: 28 size: 11 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/writer/SinglePartitionWriter.scala (68:80) - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/writer/DynamicPartitionWriter.scala (67:79) duplicated block id: 29 size: 11 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (118:130) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (117:129) duplicated block id: 30 size: 11 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (132:144) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (131:143) duplicated block id: 31 size: 11 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (146:158) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (145:157) duplicated block id: 32 size: 11 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (160:172) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (159:171) duplicated block id: 33 size: 10 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeMetadata.java (69:81) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeMetadata.java (67:79) duplicated block id: 34 size: 10 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/SimpleDataAccessor.java (38:49) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/SimpleDataAccessor.java (38:49) duplicated block id: 35 size: 10 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/ArrowUtils.java (276:287) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/ArrowUtils.java (276:287) duplicated block id: 36 size: 10 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeColumnHandle.java (75:87) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeColumnHandle.java (75:87) duplicated block id: 37 size: 10 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeInputSplit.java (60:71) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeInputSplit.java (60:71) duplicated block id: 38 size: 10 cleaned lines of code in 2 files: - flink-connector-odps/src/main/java/org/apache/flink/odps/input/reader/RecordIterator.java (98:110) - flink-connector-odps/src/main/java/org/apache/flink/odps/input/reader/CupidBatchIterator.java (102:114) duplicated block id: 39 size: 10 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/manager/InformationSchemaManager.java (59:70) - odps-sqoop/src/java/org/apache/sqoop/manager/SQLServerManager.java (279:290) duplicated block id: 40 size: 9 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeMetadata.java (89:100) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeMetadata.java (87:98) duplicated block id: 41 size: 9 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/ArrowUtils.java (245:255) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/ArrowUtils.java (245:255) duplicated block id: 42 size: 9 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeConnector.java (41:51) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeConnector.java (42:52) duplicated block id: 43 size: 9 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeTableHandle.java (129:139) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeTableHandle.java (129:139) duplicated block id: 44 size: 9 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputePageSource.java (145:155) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputePageSource.java (146:156) duplicated block id: 45 size: 9 cleaned lines of code in 2 files: - ogg-plugin/src/main/java/com/aliyun/odps/ogg/handler/datahub/RecordWriter.java (98:109) - ogg-plugin/src/main/java/com/aliyun/odps/ogg/handler/datahub/RecordBuilder.java (206:217) duplicated block id: 46 size: 8 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeInputSplit.java (34:43) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeInputSplit.java (34:43) duplicated block id: 47 size: 8 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/tool/JobTool.java (385:396) - odps-sqoop/src/java/org/apache/sqoop/tool/SqoopTool.java (343:354) duplicated block id: 48 size: 8 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/mapreduce/SQLServerAsyncDBExecThread.java (343:354) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/AsyncSqlOutputFormat.java (308:319) duplicated block id: 49 size: 7 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/MaxComputeMetaCache.java (48:56) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/MaxComputeMetaCache.java (48:56) duplicated block id: 50 size: 7 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/MaxComputeMetaCache.java (58:66) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/MaxComputeMetaCache.java (58:66) duplicated block id: 51 size: 7 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/SimpleDataAccessor.java (51:59) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/SimpleDataAccessor.java (51:59) duplicated block id: 52 size: 7 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/ArrowUtils.java (258:266) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/ArrowUtils.java (258:266) duplicated block id: 53 size: 7 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeConnector.java (78:86) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeConnector.java (79:87) duplicated block id: 54 size: 7 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/MaxComputeSplit.java (41:49) - trino-connector/src/main/java/io/trino/plugin/maxcompute/MaxComputeSplit.java (34:42) duplicated block id: 55 size: 7 cleaned lines of code in 2 files: - hive_data_transfer_udtf/src/main/java/odps/data/dump/MaxComputeDataTransferUDTF.java (60:69) - hive_data_transfer_udtf/src/main/java/odps/data/dump/MaxComputeDataTransferUDTFMultiPart.java (62:71) duplicated block id: 56 size: 7 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/tool/ImportTool.java (104:117) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/JobBase.java (246:259) duplicated block id: 57 size: 7 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportJob.java (99:107) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/postgresql/PostgreSQLCopyExportJob.java (101:109) duplicated block id: 58 size: 7 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/writer/SinglePartitionWriter.scala (99:109) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/writer/SinglePartitionWriter.scala (104:114) duplicated block id: 59 size: 6 cleaned lines of code in 2 files: - cupid-table-api/src/main/java/com/aliyun/odps/cupid/table/v1/reader/TableReadSessionBuilder.java (57:64) - cupid-table-api/src/main/java/com/aliyun/odps/cupid/table/v1/writer/TableWriteSessionBuilder.java (41:48) duplicated block id: 60 size: 6 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/MaxComputeMetaCache.java (68:76) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/MaxComputeMetaCache.java (68:76) duplicated block id: 61 size: 6 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/ArrowUtils.java (227:234) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/ArrowUtils.java (227:234) duplicated block id: 62 size: 6 cleaned lines of code in 2 files: - presto-connector/src/main/java/com/facebook/presto/maxcompute/utils/ArrowUtils.java (290:297) - trino-connector/src/main/java/io/trino/plugin/maxcompute/utils/ArrowUtils.java (290:297) duplicated block id: 63 size: 6 cleaned lines of code in 2 files: - spark-connector/common/src/main/java/org/apache/spark/sql/odps/table/tunnel/read/TunnelSplitRecordReader.java (100:107) - spark-connector/common/src/main/java/org/apache/spark/sql/odps/table/tunnel/read/TunnelArrowSplitReader.java (138:145) duplicated block id: 64 size: 6 cleaned lines of code in 2 files: - odps-sqoop/src/java/org/apache/sqoop/mapreduce/SQLServerExportOutputFormat.java (36:43) - odps-sqoop/src/java/org/apache/sqoop/mapreduce/SQLServerResilientExportOutputFormat.java (83:90) duplicated block id: 65 size: 6 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/writer/DynamicPartitionWriter.scala (51:59) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/writer/DynamicPartitionWriter.scala (50:58) duplicated block id: 66 size: 6 cleaned lines of code in 2 files: - spark-datasource-v2.3/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (320:329) - spark-datasource-v3.1/src/main/scala/org/apache/spark/sql/odps/converter/TypesConverter.scala (319:328) duplicated block id: 67 size: 6 cleaned lines of code in 2 files: - ogg-plugin/src/main/java/com/aliyun/odps/ogg/handler/datahub/TableRecordBuilder.java (86:98) - ogg-plugin/src/main/java/com/aliyun/odps/ogg/handler/datahub/ShardWriter.java (97:109) duplicated block id: 68 size: 6 cleaned lines of code in 2 files: - odps-data-carrier/meta-processor/src/main/java/com/aliyun/odps/datacarrier/metaprocessor/report/HiveDatabaseDivision.java (86:93) - odps-data-carrier/meta-processor/src/main/java/com/aliyun/odps/datacarrier/metaprocessor/report/SummaryDivision.java (73:80)