duplicated block id: 1 size: 27 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/RetentionRuleResponse.java (28:77) - src/main/java/com/google/gcs/sdrs/controller/pojo/RetentionRuleUpdateResponse.java (27:76) duplicated block id: 2 size: 20 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (167:186) - scripts/deployment/openapi/openapi.yaml (201:220) duplicated block id: 3 size: 16 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/PooledJobCreateRequest.java (60:89) - src/main/java/com/google/gcs/sdrs/controller/pojo/PooledJobResponse.java (77:106) duplicated block id: 4 size: 16 cleaned lines of code in 2 files: - scripts/sql/mods/v0.2.0/mod_1_new_job_pool_table.sql (1:16) - scripts/sql/retention_schema.sql (90:105) duplicated block id: 5 size: 16 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/RetentionRuleCreateRequest.java (38:67) - src/main/java/com/google/gcs/sdrs/controller/pojo/RetentionRuleUpdateResponse.java (39:68) duplicated block id: 6 size: 16 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/RetentionRuleCreateRequest.java (38:67) - src/main/java/com/google/gcs/sdrs/controller/pojo/RetentionRuleResponse.java (40:69) duplicated block id: 7 size: 15 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (41:55) - scripts/deployment/openapi/openapi.yaml (78:92) duplicated block id: 8 size: 15 cleaned lines of code in 2 files: - src/main/avro/InactiveDatasetNotificationEvent.avsc (6:25) - src/main/avro/SuccessDeleteNotificationEvent.avsc (6:25) duplicated block id: 9 size: 14 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/RetentionRulesController.java (81:99) - src/main/java/com/google/gcs/sdrs/controller/RetentionRulesController.java (142:160) duplicated block id: 10 size: 13 cleaned lines of code in 2 files: - sample-client/deployment/cloudfunctions/cf.jinja (1:13) - scripts/deployment/pub-sub/pubsub.jinja (1:13) duplicated block id: 11 size: 12 cleaned lines of code in 2 files: - scripts/deployment/cloud-sql/mysql.jinja (1:15) - scripts/deployment/mig/instance-template.jinja (1:15) duplicated block id: 12 size: 12 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/RetentionRuleUpdateResponse.java (55:76) - src/main/java/com/google/gcs/sdrs/dao/model/RetentionRule.java (99:120) duplicated block id: 13 size: 12 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/PooledJobCreateRequest.java (36:57) - src/main/java/com/google/gcs/sdrs/controller/pojo/PooledJobResponse.java (45:66) duplicated block id: 14 size: 12 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/RetentionRuleResponse.java (56:77) - src/main/java/com/google/gcs/sdrs/dao/model/RetentionRule.java (99:120) duplicated block id: 15 size: 12 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (419:430) - scripts/deployment/openapi/openapi.yaml (462:473) duplicated block id: 16 size: 12 cleaned lines of code in 2 files: - scripts/deployment/cloud-sql/mysql.jinja (1:15) - scripts/deployment/mig/igm.jinja (1:15) duplicated block id: 17 size: 12 cleaned lines of code in 2 files: - scripts/deployment/mig/igm.jinja (1:15) - scripts/deployment/mig/instance-template.jinja (1:15) duplicated block id: 18 size: 12 cleaned lines of code in 2 files: - scripts/sql/mods/v0.3.0/mod_1_new_dm_queue_table.sql (1:12) - scripts/sql/retention_schema.sql (109:120) duplicated block id: 19 size: 10 cleaned lines of code in 2 files: - sample-client/deployment/cloudfunctions/cf.jinja (39:48) - sample-client/deployment/cloudfunctions/cf.jinja (60:69) duplicated block id: 20 size: 10 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (282:291) - scripts/deployment/openapi/openapi.yaml (330:339) duplicated block id: 21 size: 10 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (188:197) - scripts/deployment/openapi/openapi.yaml (222:231) duplicated block id: 22 size: 10 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (282:291) - scripts/deployment/openapi/openapi.yaml (309:318) duplicated block id: 23 size: 10 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (309:318) - scripts/deployment/openapi/openapi.yaml (330:339) duplicated block id: 24 size: 10 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/service/mq/pojo/DeleteNotificationMessage.java (58:75) - src/main/java/com/google/gcs/sdrs/service/mq/pojo/InactiveDatasetMessage.java (58:75) duplicated block id: 25 size: 10 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (364:373) - scripts/deployment/openapi/openapi.yaml (402:411) duplicated block id: 26 size: 9 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/service/mq/events/context/groupRecord.java (203:213) - src/main/java/com/google/gcs/sdrs/service/mq/events/context/groupRecord.java (223:233) duplicated block id: 27 size: 9 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/service/mq/pojo/DeleteNotificationMessage.java (34:47) - src/main/java/com/google/gcs/sdrs/service/mq/pojo/InactiveDatasetMessage.java (34:47) duplicated block id: 28 size: 9 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/service/mq/PubSubMessageQueueManagerImpl.java (101:110) - src/main/java/com/google/gcs/sdrs/service/mq/PubSubMessageQueueManagerImpl.java (133:142) duplicated block id: 29 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (98:105) - scripts/deployment/openapi/openapi.yaml (284:291) duplicated block id: 30 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (98:105) - scripts/deployment/openapi/openapi.yaml (156:163) duplicated block id: 31 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (224:231) - scripts/deployment/openapi/openapi.yaml (284:291) duplicated block id: 32 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (129:136) - scripts/deployment/openapi/openapi.yaml (190:197) duplicated block id: 33 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (129:136) - scripts/deployment/openapi/openapi.yaml (311:318) duplicated block id: 34 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (129:136) - scripts/deployment/openapi/openapi.yaml (156:163) duplicated block id: 35 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (98:105) - scripts/deployment/openapi/openapi.yaml (257:264) duplicated block id: 36 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (224:231) - scripts/deployment/openapi/openapi.yaml (257:264) duplicated block id: 37 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (129:136) - scripts/deployment/openapi/openapi.yaml (284:291) duplicated block id: 38 size: 8 cleaned lines of code in 2 files: - scripts/deployment/cloud-sql/mysql.jinja (61:68) - scripts/deployment/cloud-sql/mysql.jinja (80:87) duplicated block id: 39 size: 8 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/RetentionRuleCreateRequest.java (54:67) - src/main/java/com/google/gcs/sdrs/dao/model/RetentionRule.java (99:112) duplicated block id: 40 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (140:147) - scripts/deployment/openapi/openapi.yaml (268:275) duplicated block id: 41 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (98:105) - scripts/deployment/openapi/openapi.yaml (129:136) duplicated block id: 42 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (98:105) - scripts/deployment/openapi/openapi.yaml (224:231) duplicated block id: 43 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (190:197) - scripts/deployment/openapi/openapi.yaml (332:339) duplicated block id: 44 size: 8 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/DmQueueDaoImpl.java (71:82) - src/main/java/com/google/gcs/sdrs/dao/impl/DmQueueDaoImpl.java (148:159) duplicated block id: 45 size: 8 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/PooledJobCreateRequest.java (84:97) - src/main/java/com/google/gcs/sdrs/dao/model/PooledStsJob.java (137:150) duplicated block id: 46 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (268:275) - scripts/deployment/openapi/openapi.yaml (295:302) duplicated block id: 47 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (129:136) - scripts/deployment/openapi/openapi.yaml (332:339) duplicated block id: 48 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (98:105) - scripts/deployment/openapi/openapi.yaml (332:339) duplicated block id: 49 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (129:136) - scripts/deployment/openapi/openapi.yaml (224:231) duplicated block id: 50 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (257:264) - scripts/deployment/openapi/openapi.yaml (332:339) duplicated block id: 51 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (140:147) - scripts/deployment/openapi/openapi.yaml (295:302) duplicated block id: 52 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (129:136) - scripts/deployment/openapi/openapi.yaml (257:264) duplicated block id: 53 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (224:231) - scripts/deployment/openapi/openapi.yaml (311:318) duplicated block id: 54 size: 8 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/model/RetentionJob.java (162:175) - src/main/java/com/google/gcs/sdrs/dao/model/RetentionRule.java (163:176) duplicated block id: 55 size: 8 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/PooledJobCreateRequest.java (26:33) - src/main/java/com/google/gcs/sdrs/controller/pojo/PooledJobResponse.java (25:32) duplicated block id: 56 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (257:264) - scripts/deployment/openapi/openapi.yaml (284:291) duplicated block id: 57 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (156:163) - scripts/deployment/openapi/openapi.yaml (190:197) duplicated block id: 58 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (156:163) - scripts/deployment/openapi/openapi.yaml (311:318) duplicated block id: 59 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (67:74) - scripts/deployment/openapi/openapi.yaml (190:197) duplicated block id: 60 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (67:74) - scripts/deployment/openapi/openapi.yaml (311:318) duplicated block id: 61 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (257:264) - scripts/deployment/openapi/openapi.yaml (311:318) duplicated block id: 62 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (156:163) - scripts/deployment/openapi/openapi.yaml (284:291) duplicated block id: 63 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (67:74) - scripts/deployment/openapi/openapi.yaml (284:291) duplicated block id: 64 size: 8 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/PooledJobResponse.java (37:50) - src/main/java/com/google/gcs/sdrs/dao/model/RetentionJob.java (86:99) duplicated block id: 65 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (67:74) - scripts/deployment/openapi/openapi.yaml (156:163) duplicated block id: 66 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (67:74) - scripts/deployment/openapi/openapi.yaml (257:264) duplicated block id: 67 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (67:74) - scripts/deployment/openapi/openapi.yaml (129:136) duplicated block id: 68 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (190:197) - scripts/deployment/openapi/openapi.yaml (311:318) duplicated block id: 69 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (224:231) - scripts/deployment/openapi/openapi.yaml (332:339) duplicated block id: 70 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (156:163) - scripts/deployment/openapi/openapi.yaml (224:231) duplicated block id: 71 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (67:74) - scripts/deployment/openapi/openapi.yaml (98:105) duplicated block id: 72 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (67:74) - scripts/deployment/openapi/openapi.yaml (224:231) duplicated block id: 73 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (67:74) - scripts/deployment/openapi/openapi.yaml (332:339) duplicated block id: 74 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (156:163) - scripts/deployment/openapi/openapi.yaml (332:339) duplicated block id: 75 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (156:163) - scripts/deployment/openapi/openapi.yaml (257:264) duplicated block id: 76 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (190:197) - scripts/deployment/openapi/openapi.yaml (257:264) duplicated block id: 77 size: 8 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionRuleDaoImpl.java (188:196) - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionRuleDaoImpl.java (243:251) duplicated block id: 78 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (190:197) - scripts/deployment/openapi/openapi.yaml (284:291) duplicated block id: 79 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (98:105) - scripts/deployment/openapi/openapi.yaml (190:197) duplicated block id: 80 size: 8 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (98:105) - scripts/deployment/openapi/openapi.yaml (311:318) duplicated block id: 81 size: 7 cleaned lines of code in 2 files: - scripts/sql/mods/v0.3.0/mod_2_new_distributed_lock_table.sql (1:7) - scripts/sql/retention_schema.sql (122:128) duplicated block id: 82 size: 7 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/service/worker/impl/ExecuteRetentionWorker.java (167:177) - src/main/java/com/google/gcs/sdrs/service/worker/impl/ExecuteRetentionWorker.java (188:198) duplicated block id: 83 size: 7 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/service/mq/PubSubMessageQueueManagerImpl.java (90:99) - src/main/java/com/google/gcs/sdrs/service/mq/PubSubMessageQueueManagerImpl.java (122:131) duplicated block id: 84 size: 7 cleaned lines of code in 2 files: - sample-client/cloudfunctions/gcs_create/main.py (61:72) - sample-client/cloudfunctions/gcs_delete/main.py (66:76) duplicated block id: 85 size: 7 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/DmQueueDaoImpl.java (48:55) - src/main/java/com/google/gcs/sdrs/dao/impl/DmQueueDaoImpl.java (87:93) duplicated block id: 86 size: 7 cleaned lines of code in 2 files: - scripts/provisioning/command_line.py (135:141) - scripts/provisioning/command_line.py (155:161) duplicated block id: 87 size: 7 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/RetentionRulesController.java (230:236) - src/main/java/com/google/gcs/sdrs/controller/RetentionRulesController.java (248:254) duplicated block id: 88 size: 7 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/DmQueueDaoImpl.java (48:55) - src/main/java/com/google/gcs/sdrs/dao/impl/DmQueueDaoImpl.java (138:145) duplicated block id: 89 size: 7 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/common/RetentionRuleType.java (50:62) - src/main/java/com/google/gcs/sdrs/common/RetentionUnitType.java (49:61) duplicated block id: 90 size: 7 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionJobDaoImpl.java (54:61) - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionJobDaoImpl.java (74:80) duplicated block id: 91 size: 7 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionRuleDaoImpl.java (118:125) - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionRuleDaoImpl.java (189:196) duplicated block id: 92 size: 7 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/DmQueueDaoImpl.java (87:93) - src/main/java/com/google/gcs/sdrs/dao/impl/DmQueueDaoImpl.java (138:145) duplicated block id: 93 size: 7 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/NotFoundException.java (33:45) - src/main/java/com/google/gcs/sdrs/controller/ResourceNotFoundException.java (30:41) duplicated block id: 94 size: 7 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionRuleDaoImpl.java (118:125) - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionRuleDaoImpl.java (244:251) duplicated block id: 95 size: 6 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/util/StsUtil.java (122:129) - src/main/java/com/google/gcs/sdrs/util/StsUtil.java (166:172) duplicated block id: 96 size: 6 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (40:45) - scripts/deployment/openapi/openapi.yaml (295:300) duplicated block id: 97 size: 6 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionRuleDaoImpl.java (77:83) - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionRuleDaoImpl.java (221:227) duplicated block id: 98 size: 6 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (40:45) - scripts/deployment/openapi/openapi.yaml (268:273) duplicated block id: 99 size: 6 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (40:45) - scripts/deployment/openapi/openapi.yaml (140:145) duplicated block id: 100 size: 6 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/model/PooledStsJob.java (33:39) - src/main/java/com/google/gcs/sdrs/dao/model/RetentionJob.java (39:45) duplicated block id: 101 size: 6 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (89:94) - scripts/deployment/openapi/openapi.yaml (118:123) duplicated block id: 102 size: 6 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/PersistenceException.java (38:46) - src/main/java/com/google/gcs/sdrs/controller/ServiceLayerException.java (40:48) duplicated block id: 103 size: 6 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/GenericDao.java (67:78) - src/main/java/com/google/gcs/sdrs/dao/impl/GenericDao.java (108:119) duplicated block id: 104 size: 6 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionRuleDaoImpl.java (85:92) - src/main/java/com/google/gcs/sdrs/dao/impl/RetentionRuleDaoImpl.java (229:235) duplicated block id: 105 size: 6 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/controller/pojo/PooledJobResponse.java (109:118) - src/main/java/com/google/gcs/sdrs/dao/model/RetentionJob.java (134:143) duplicated block id: 106 size: 6 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/impl/DmQueueDaoImpl.java (176:183) - src/main/java/com/google/gcs/sdrs/dao/impl/GenericDao.java (61:69) duplicated block id: 107 size: 6 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (349:354) - scripts/deployment/openapi/openapi.yaml (356:361) duplicated block id: 108 size: 6 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/service/mq/pojo/DeleteNotificationMessage.java (94:100) - src/main/java/com/google/gcs/sdrs/service/mq/pojo/InactiveDatasetMessage.java (94:100) duplicated block id: 109 size: 6 cleaned lines of code in 2 files: - src/main/java/com/google/gcs/sdrs/dao/model/RetentionJob.java (63:70) - src/main/java/com/google/gcs/sdrs/dao/model/RetentionJobValidation.java (52:59) duplicated block id: 110 size: 6 cleaned lines of code in 2 files: - scripts/deployment/openapi/openapi.yaml (91:96) - scripts/deployment/openapi/openapi.yaml (217:222)