duplicated block id: 1 size: 63 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (1:66) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (1:66) duplicated block id: 2 size: 37 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (107:165) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (168:226) duplicated block id: 3 size: 37 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (107:165) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (168:226) duplicated block id: 4 size: 27 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (91:122) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (91:122) duplicated block id: 5 size: 25 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withoutConnection/JDBCSalesforce.java (5:30) - GlueCustomConnectors/gluescripts/withoutConnection/JDBCSalesforce.scala (5:30) duplicated block id: 6 size: 22 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (150:183) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (150:183) duplicated block id: 7 size: 22 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withoutConnection/SparkSnowflake.java (5:27) - GlueCustomConnectors/gluescripts/withoutConnection/SparkSnowflake.scala (5:27) duplicated block id: 8 size: 22 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/JDBCSalesforce.java (5:27) - GlueCustomConnectors/gluescripts/withConnection/JDBCSalesforce.scala (5:27) duplicated block id: 9 size: 21 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/SparkSnowflake.java (5:26) - GlueCustomConnectors/gluescripts/withConnection/SparkSnowflake.scala (5:26) duplicated block id: 10 size: 19 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withoutConnection/AthenaCloudwatch.java (5:24) - GlueCustomConnectors/gluescripts/withoutConnection/AthenaCloudwatch.scala (5:24) duplicated block id: 11 size: 19 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (36:59) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (65:89) duplicated block id: 12 size: 19 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/AthenaCloudwatch.java (5:24) - GlueCustomConnectors/gluescripts/withConnection/AthenaCloudwatch.scala (5:24) duplicated block id: 13 size: 16 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (45:66) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (47:67) duplicated block id: 14 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (71:89) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (136:154) duplicated block id: 15 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (57:75) - GlueCustomConnectors/localValidation/DataSourceTest.scala (47:66) duplicated block id: 16 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (47:66) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (48:66) duplicated block id: 17 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (71:89) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (49:67) duplicated block id: 18 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (48:66) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (49:67) duplicated block id: 19 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (48:66) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (48:66) duplicated block id: 20 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (71:89) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (48:66) duplicated block id: 21 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (57:75) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (136:154) duplicated block id: 22 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (57:75) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (48:66) duplicated block id: 23 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (47:66) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (136:154) duplicated block id: 24 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (48:66) - GlueCustomConnectors/localValidation/DataSourceTest.scala (47:66) duplicated block id: 25 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (41:59) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (48:66) duplicated block id: 26 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (136:154) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (49:67) duplicated block id: 27 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (102:120) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (46:64) duplicated block id: 28 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (41:59) - GlueCustomConnectors/localValidation/DataSourceTest.scala (47:66) duplicated block id: 29 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (41:59) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (49:67) duplicated block id: 30 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (49:67) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (48:66) duplicated block id: 31 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (47:66) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (71:89) duplicated block id: 32 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (57:75) - GlueCustomConnectors/localValidation/DataSchemaTest.scala (41:59) duplicated block id: 33 size: 14 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (186:205) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (186:205) duplicated block id: 34 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (57:75) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (71:89) duplicated block id: 35 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (57:75) - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (48:66) duplicated block id: 36 size: 14 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (125:144) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (125:144) duplicated block id: 37 size: 14 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (125:144) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (186:205) duplicated block id: 38 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (48:66) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (71:89) duplicated block id: 39 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (41:59) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (136:154) duplicated block id: 40 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (136:154) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (48:66) duplicated block id: 41 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (57:75) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (49:67) duplicated block id: 42 size: 14 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (186:205) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (125:144) duplicated block id: 43 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (48:66) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (136:154) duplicated block id: 44 size: 14 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (48:66) - GlueCustomConnectors/localValidation/DataSchemaTest.scala (41:59) duplicated block id: 45 size: 13 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/JDBCSalesforce.java (5:18) - GlueCustomConnectors/gluescripts/withoutConnection/JDBCSalesforce.scala (5:18) duplicated block id: 46 size: 13 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/JDBCSalesforce.java (5:18) - GlueCustomConnectors/gluescripts/withoutConnection/JDBCSalesforce.java (5:18) duplicated block id: 47 size: 13 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/JDBCSalesforce.scala (5:18) - GlueCustomConnectors/gluescripts/withoutConnection/JDBCSalesforce.java (5:18) duplicated block id: 48 size: 13 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/JDBCSalesforce.scala (5:18) - GlueCustomConnectors/gluescripts/withoutConnection/JDBCSalesforce.scala (5:18) duplicated block id: 49 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/SparkSnowflake.java (5:17) - GlueCustomConnectors/gluescripts/withoutConnection/SparkSnowflake.scala (5:17) duplicated block id: 50 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/SparkSnowflake.scala (19:31) - GlueCustomConnectors/gluescripts/withoutConnection/SparkSnowflake.scala (20:32) duplicated block id: 51 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (71:87) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (102:118) duplicated block id: 52 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (47:63) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (46:61) duplicated block id: 53 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (136:152) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (46:61) duplicated block id: 54 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (57:72) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (102:118) duplicated block id: 55 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (46:61) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (49:64) duplicated block id: 56 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (102:118) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (49:64) duplicated block id: 57 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (41:56) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (46:61) duplicated block id: 58 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (46:61) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (48:63) duplicated block id: 59 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/SparkSnowflake.scala (5:17) - GlueCustomConnectors/gluescripts/withoutConnection/SparkSnowflake.java (5:17) duplicated block id: 60 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (47:63) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (102:118) duplicated block id: 61 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (57:72) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (46:61) duplicated block id: 62 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/SparkSnowflake.java (5:17) - GlueCustomConnectors/gluescripts/withoutConnection/SparkSnowflake.java (5:17) duplicated block id: 63 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/SparkSnowflake.scala (5:17) - GlueCustomConnectors/gluescripts/withoutConnection/SparkSnowflake.scala (5:17) duplicated block id: 64 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (71:87) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (46:61) duplicated block id: 65 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (102:118) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (48:63) duplicated block id: 66 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (41:56) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (102:118) duplicated block id: 67 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (48:63) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (46:61) duplicated block id: 68 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (102:118) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (136:152) duplicated block id: 69 size: 12 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (48:63) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (102:118) duplicated block id: 70 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSinkTest.scala (16:30) - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (16:30) duplicated block id: 71 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (16:30) - GlueCustomConnectors/localValidation/DataSinkTest.scala (16:30) duplicated block id: 72 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (16:30) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (16:30) duplicated block id: 73 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSinkTest.scala (16:30) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (16:30) duplicated block id: 74 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (16:30) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (16:30) duplicated block id: 75 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (16:30) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (16:30) duplicated block id: 76 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (16:30) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (16:30) duplicated block id: 77 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (16:30) - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (16:30) duplicated block id: 78 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (16:30) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (16:30) duplicated block id: 79 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (16:30) - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (16:30) duplicated block id: 80 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSinkTest.scala (16:30) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (16:30) duplicated block id: 81 size: 11 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (107:122) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (168:183) duplicated block id: 82 size: 11 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (168:183) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (107:122) duplicated block id: 83 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (16:30) - GlueCustomConnectors/localValidation/DataSchemaTest.scala (16:30) duplicated block id: 84 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (16:30) - GlueCustomConnectors/localValidation/DataSinkTest.scala (16:30) duplicated block id: 85 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (16:30) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (16:30) duplicated block id: 86 size: 11 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (16:30) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (16:30) duplicated block id: 87 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSinkTest.scala (17:30) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (17:30) duplicated block id: 88 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (17:30) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (17:30) duplicated block id: 89 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/spark-script-example.py (18:30) - GlueCustomConnectors/gluescripts/withoutConnection/spark-script-example.py (20:32) duplicated block id: 90 size: 10 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (150:165) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (211:226) duplicated block id: 91 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/AthenaCloudwatch.scala (5:15) - GlueCustomConnectors/gluescripts/withoutConnection/AthenaCloudwatch.scala (5:15) duplicated block id: 92 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (17:30) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (17:30) duplicated block id: 93 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/AthenaCloudwatch.java (5:15) - GlueCustomConnectors/gluescripts/withoutConnection/AthenaCloudwatch.scala (5:15) duplicated block id: 94 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (36:47) - GlueCustomConnectors/localValidation/ReadWriteTest.scala (38:49) duplicated block id: 95 size: 10 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (211:226) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (150:165) duplicated block id: 96 size: 10 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (211:226) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (211:226) duplicated block id: 97 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/AthenaCloudwatch.java (5:15) - GlueCustomConnectors/gluescripts/withoutConnection/AthenaCloudwatch.java (5:15) duplicated block id: 98 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/JDBCSalesforce.scala (20:30) - GlueCustomConnectors/gluescripts/withoutConnection/JDBCSalesforce.scala (23:33) duplicated block id: 99 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (17:30) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (17:30) duplicated block id: 100 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/AthenaCloudwatch.scala (5:15) - GlueCustomConnectors/gluescripts/withoutConnection/AthenaCloudwatch.java (5:15) duplicated block id: 101 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (17:30) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (17:30) duplicated block id: 102 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (17:30) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (17:30) duplicated block id: 103 size: 10 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (65:77) - GlueCustomConnectors/localValidation/ReadWriteTest.scala (38:49) duplicated block id: 104 size: 9 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (16:28) - GlueCustomConnectors/localValidation/ReadWriteTest.scala (16:28) duplicated block id: 105 size: 9 cleaned lines of code in 2 files: - GlueCustomConnectors/development/Spark/glue-3.0/tpcds-custom-connector-for-glue3.0/jobvalidation/scala/GlueJobValidationDataSchemaTest.scala (25:35) - GlueCustomConnectors/development/Spark/glue-3.0/tpcds-custom-connector-for-glue3.0/jobvalidation/scala/GlueJobValidationDataSourceTest.scala (21:31) duplicated block id: 106 size: 9 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/jdbc-script-example.py (20:30) - GlueCustomConnectors/gluescripts/withoutConnection/jdbc-script-example.py (22:32) duplicated block id: 107 size: 9 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (15:26) - GlueCustomConnectors/localValidation/ReadWriteTest.scala (16:28) duplicated block id: 108 size: 9 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/jdbc-script-example.py (9:18) - GlueCustomConnectors/gluescripts/withoutConnection/jdbc-script-example.py (9:18) duplicated block id: 109 size: 9 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (16:28) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (16:28) duplicated block id: 110 size: 9 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (15:26) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (16:28) duplicated block id: 111 size: 9 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (15:26) - GlueCustomConnectors/localValidation/DataSourceTest.scala (16:28) duplicated block id: 112 size: 9 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (16:28) - GlueCustomConnectors/localValidation/ReadWriteTest.scala (16:28) duplicated block id: 113 size: 8 cleaned lines of code in 2 files: - utilities/use_only_IAM_access_controls/update_permission.py (61:68) - utilities/use_only_IAM_access_controls/update_permission.py (73:80) duplicated block id: 114 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/JDBCSalesforce.java (20:27) - GlueCustomConnectors/gluescripts/withoutConnection/JDBCSalesforce.scala (23:30) duplicated block id: 115 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/SparkSnowflake.scala (19:26) - GlueCustomConnectors/gluescripts/withoutConnection/SparkSnowflake.java (20:27) duplicated block id: 116 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/AthenaCloudwatch.java (17:24) - GlueCustomConnectors/gluescripts/withoutConnection/AthenaCloudwatch.scala (17:24) duplicated block id: 117 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/development/Spark/MinimalSparkConnectorTest.scala (10:20) - GlueCustomConnectors/development/Spark/MinimalSparkConnectorTestWithConnection.scala (10:20) duplicated block id: 118 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/AthenaCloudwatch.scala (17:24) - GlueCustomConnectors/gluescripts/withoutConnection/AthenaCloudwatch.java (17:24) duplicated block id: 119 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/JDBCSalesforce.scala (20:27) - GlueCustomConnectors/gluescripts/withoutConnection/JDBCSalesforce.java (23:30) duplicated block id: 120 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/development/Spark/MinimalSparkConnectorTest.scala (23:30) - GlueCustomConnectors/development/Spark/MinimalSparkConnectorTestWithConnection.scala (22:29) duplicated block id: 121 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/SparkSnowflake.java (19:26) - GlueCustomConnectors/gluescripts/withoutConnection/SparkSnowflake.scala (20:27) duplicated block id: 122 size: 8 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (73:80) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (73:80) duplicated block id: 123 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/spark-script-example.py (8:16) - GlueCustomConnectors/gluescripts/withoutConnection/spark-script-example.py (8:17) duplicated block id: 124 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/SparkSnowflake.java (19:26) - GlueCustomConnectors/gluescripts/withoutConnection/SparkSnowflake.java (20:27) duplicated block id: 125 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/development/Spark/MinimalSparkConnector.java (25:37) - GlueCustomConnectors/development/Spark/SparkConnectorCSV.java (39:52) duplicated block id: 126 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/AthenaCloudwatch.java (17:24) - GlueCustomConnectors/gluescripts/withoutConnection/AthenaCloudwatch.java (17:24) duplicated block id: 127 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/JDBCSalesforce.java (20:27) - GlueCustomConnectors/gluescripts/withoutConnection/JDBCSalesforce.java (23:30) duplicated block id: 128 size: 8 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/AthenaCloudwatch.scala (17:24) - GlueCustomConnectors/gluescripts/withoutConnection/AthenaCloudwatch.scala (17:24) duplicated block id: 129 size: 7 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/athena-script-example.py (16:22) - GlueCustomConnectors/gluescripts/withoutConnection/athena-script-example.py (16:22) duplicated block id: 130 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (23:30) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (21:28) duplicated block id: 131 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (58:63) - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (50:55) duplicated block id: 132 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (19:26) - GlueCustomConnectors/localValidation/DataSchemaTest.scala (23:30) duplicated block id: 133 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (50:55) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (146:152) duplicated block id: 134 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (19:26) - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (23:30) duplicated block id: 135 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (23:30) - GlueCustomConnectors/localValidation/ReadWriteTest.scala (21:28) duplicated block id: 136 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (50:55) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (81:87) duplicated block id: 137 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ReadWriteTest.scala (21:28) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (23:30) duplicated block id: 138 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (19:26) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (23:30) duplicated block id: 139 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (21:28) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (23:30) duplicated block id: 140 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (50:55) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (59:64) duplicated block id: 141 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (50:55) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (112:118) duplicated block id: 142 size: 6 cleaned lines of code in 2 files: - utilities/Hive_metastore_migration/src/export_from_datacatalog.py (97:105) - utilities/Hive_metastore_migration/src/import_into_datacatalog.py (95:103) duplicated block id: 143 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSinkTest.scala (23:30) - GlueCustomConnectors/localValidation/ReadWriteTest.scala (21:28) duplicated block id: 144 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (21:28) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (23:30) duplicated block id: 145 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (23:30) - GlueCustomConnectors/localValidation/DataSourceTest.scala (21:28) duplicated block id: 146 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (50:55) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (56:61) duplicated block id: 147 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/development/Spark/SparkConnectorMySQL.scala (102:107) - GlueCustomConnectors/development/Spark/SparkConnectorMySQL.scala (117:122) duplicated block id: 148 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (23:30) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (21:28) duplicated block id: 149 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (23:30) - GlueCustomConnectors/localValidation/DataSourceTest.scala (21:28) duplicated block id: 150 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (23:30) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (21:28) duplicated block id: 151 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (23:30) - GlueCustomConnectors/localValidation/ReadWriteTest.scala (21:28) duplicated block id: 152 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (51:56) - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (50:55) duplicated block id: 153 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSinkTest.scala (23:30) - GlueCustomConnectors/localValidation/DataSourceTest.scala (21:28) duplicated block id: 154 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (19:26) - GlueCustomConnectors/localValidation/DataSinkTest.scala (23:30) duplicated block id: 155 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (21:28) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (23:30) duplicated block id: 156 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSchemaTest.scala (23:30) - GlueCustomConnectors/localValidation/ReadWriteTest.scala (21:28) duplicated block id: 157 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (23:30) - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (19:26) duplicated block id: 158 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (67:72) - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (50:55) duplicated block id: 159 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/CatalogConnectionTest.scala (23:30) - GlueCustomConnectors/localValidation/ReadWriteTest.scala (21:28) duplicated block id: 160 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (19:26) - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (23:30) duplicated block id: 161 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (21:28) - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (23:30) duplicated block id: 162 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSourceTest.scala (21:28) - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (23:30) duplicated block id: 163 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (50:55) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (58:63) duplicated block id: 164 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (58:63) - GlueCustomConnectors/localValidation/DataTypeMappingTest.scala (50:55) duplicated block id: 165 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/FilterPredicateTest.scala (23:30) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (21:28) duplicated block id: 166 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/ColumnPartitioningTest.scala (19:26) - GlueCustomConnectors/localValidation/SecretsManagerTest.scala (23:30) duplicated block id: 167 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/development/Spark/MinimalSparkConnector.java (47:54) - GlueCustomConnectors/development/Spark/SparkConnectorCSV.java (65:73) duplicated block id: 168 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (23:30) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (21:28) duplicated block id: 169 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/gluescripts/withConnection/athena-script-example.py (8:14) - GlueCustomConnectors/gluescripts/withoutConnection/athena-script-example.py (8:14) duplicated block id: 170 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DataSinkTest.scala (23:30) - GlueCustomConnectors/localValidation/JDBCUrlTest.scala (21:28) duplicated block id: 171 size: 6 cleaned lines of code in 2 files: - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook.yaml (83:88) - utilities/sagemaker_notebook_automation/glue_sagemaker_notebook_cn.yaml (83:88) duplicated block id: 172 size: 6 cleaned lines of code in 2 files: - GlueCustomConnectors/localValidation/DbtableQueryTest.scala (23:30) - GlueCustomConnectors/localValidation/ReadWriteTest.scala (21:28)