duplicated block id: 1 size: 81 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (25:107) - pytorch_translate/transformer.py (49:131) duplicated block id: 2 size: 67 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (50:119) - pytorch_translate/char_source_transformer_model.py (37:106) duplicated block id: 3 size: 60 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (262:356) - pytorch_translate/char_source_transformer_model.py (264:357) duplicated block id: 4 size: 60 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (285:387) - pytorch_translate/research/multisource/multisource_decode.py (212:314) duplicated block id: 5 size: 55 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (195:260) - pytorch_translate/char_source_transformer_model.py (197:262) duplicated block id: 6 size: 53 cleaned lines of code in 2 files: - pytorch_translate/char_encoder.py (34:86) - pytorch_translate/char_source_transformer_model.py (43:95) duplicated block id: 7 size: 53 cleaned lines of code in 2 files: - pytorch_translate/char_encoder.py (34:86) - pytorch_translate/char_source_hybrid.py (56:108) duplicated block id: 8 size: 49 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (43:98) - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (43:98) duplicated block id: 9 size: 49 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (554:608) - pytorch_translate/ensemble_export.py (1525:1579) duplicated block id: 10 size: 43 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (511:563) - pytorch_translate/research/multisource/multisource_decode.py (433:485) duplicated block id: 11 size: 39 cleaned lines of code in 2 files: - pytorch_translate/research/rescore/cloze_transformer_model.py (23:62) - pytorch_translate/transformer.py (225:264) duplicated block id: 12 size: 35 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (217:257) - pytorch_translate/ensemble_export.py (1398:1440) duplicated block id: 13 size: 33 cleaned lines of code in 2 files: - pytorch_translate/benchmark.py (12:49) - pytorch_translate/generate.py (553:589) duplicated block id: 14 size: 31 cleaned lines of code in 2 files: - pytorch_translate/multilingual_model.py (26:58) - pytorch_translate/semi_supervised.py (34:66) duplicated block id: 15 size: 27 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (433:461) - pytorch_translate/ensemble_export.py (1477:1505) duplicated block id: 16 size: 27 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (567:601) - pytorch_translate/research/multisource/multisource_decode.py (486:520) duplicated block id: 17 size: 23 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (45:71) - pytorch_translate/ensemble_export.py (303:329) duplicated block id: 18 size: 22 cleaned lines of code in 2 files: - pytorch_translate/research/tune_ensemble_weights/tune_model_weights.py (12:33) - pytorch_translate/research/tune_ensemble_weights/tune_model_weights_with_ax.py (10:31) duplicated block id: 19 size: 22 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (481:509) - pytorch_translate/research/multisource/multisource_decode.py (404:432) duplicated block id: 20 size: 21 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (25:47) - pytorch_translate/transformer_aan.py (37:59) duplicated block id: 21 size: 21 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (566:590) - pytorch_translate/ensemble_export.py (619:643) duplicated block id: 22 size: 21 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (49:71) - pytorch_translate/transformer_aan.py (37:59) duplicated block id: 23 size: 21 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (122:152) - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (119:149) duplicated block id: 24 size: 20 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (106:125) - pytorch_translate/transformer.py (136:155) duplicated block id: 25 size: 19 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (36:86) - pytorch_translate/research/multisource/multisource_decode.py (31:71) duplicated block id: 26 size: 19 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (421:441) - pytorch_translate/transformer_aan.py (494:514) duplicated block id: 27 size: 19 cleaned lines of code in 2 files: - pytorch_translate/tasks/cross_lingual_lm.py (40:61) - pytorch_translate/tasks/translation_from_pretrained_xlm.py (32:70) duplicated block id: 28 size: 19 cleaned lines of code in 2 files: - pytorch_translate/benchmark.py (53:71) - pytorch_translate/generate.py (639:657) duplicated block id: 29 size: 18 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (681:698) - pytorch_translate/transformer_aan.py (847:864) duplicated block id: 30 size: 18 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (373:391) - pytorch_translate/multi_model.py (411:429) duplicated block id: 31 size: 18 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (221:245) - pytorch_translate/char_source_model.py (399:422) duplicated block id: 32 size: 17 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (107:133) - pytorch_translate/research/multisource/multisource_decode.py (80:106) duplicated block id: 33 size: 17 cleaned lines of code in 2 files: - pytorch_translate/multilingual_model.py (62:84) - pytorch_translate/semi_supervised.py (81:103) duplicated block id: 34 size: 17 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (49:65) - pytorch_translate/transformer_aan.py (61:77) duplicated block id: 35 size: 17 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (680:700) - pytorch_translate/transformer_aan.py (561:582) duplicated block id: 36 size: 17 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (121:137) - pytorch_translate/transformer_aan.py (98:114) duplicated block id: 37 size: 17 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (427:445) - pytorch_translate/transformer.py (585:602) duplicated block id: 38 size: 17 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (73:89) - pytorch_translate/transformer_aan.py (61:77) duplicated block id: 39 size: 16 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (326:341) - pytorch_translate/ensemble_export.py (1448:1463) duplicated block id: 40 size: 16 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (552:568) - pytorch_translate/transformer_aan.py (447:463) duplicated block id: 41 size: 16 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (14:29) - pytorch_translate/research/multisource/multisource_decode.py (14:29) duplicated block id: 42 size: 15 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (585:599) - pytorch_translate/transformer_aan.py (500:514) duplicated block id: 43 size: 15 cleaned lines of code in 2 files: - pytorch_translate/generate.py (612:626) - pytorch_translate/research/knowledge_distillation/collect_top_k_probs.py (163:177) duplicated block id: 44 size: 15 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (976:994) - pytorch_translate/beam_search_and_decode_v2.py (264:282) duplicated block id: 45 size: 15 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (159:174) - pytorch_translate/multi_model.py (537:552) duplicated block id: 46 size: 15 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (190:211) - pytorch_translate/ensemble_export.py (1371:1392) duplicated block id: 47 size: 15 cleaned lines of code in 2 files: - pytorch_translate/char_source_transformer_model.py (110:124) - pytorch_translate/transformer.py (229:243) duplicated block id: 48 size: 15 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (113:127) - pytorch_translate/word_prediction/word_prediction_model.py (98:112) duplicated block id: 49 size: 15 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (166:180) - pytorch_translate/char_source_transformer_model.py (162:176) duplicated block id: 50 size: 15 cleaned lines of code in 2 files: - pytorch_translate/char_source_transformer_model.py (110:124) - pytorch_translate/research/rescore/cloze_transformer_model.py (27:41) duplicated block id: 51 size: 14 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_models.py (132:145) - pytorch_translate/dual_learning/dual_learning_models.py (177:190) duplicated block id: 52 size: 14 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (115:128) - pytorch_translate/dual_learning/dual_learning_models.py (177:190) duplicated block id: 53 size: 14 cleaned lines of code in 2 files: - pytorch_translate/multilingual_model.py (116:129) - pytorch_translate/semi_supervised.py (158:172) duplicated block id: 54 size: 14 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (149:162) - pytorch_translate/transformer_aan.py (238:251) duplicated block id: 55 size: 14 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (115:128) - pytorch_translate/dual_learning/dual_learning_models.py (132:145) duplicated block id: 56 size: 13 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (846:863) - pytorch_translate/rnn.py (1017:1034) duplicated block id: 57 size: 13 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (280:292) - pytorch_translate/char_source_transformer_model.py (220:232) duplicated block id: 58 size: 13 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_models.py (132:144) - pytorch_translate/word_prediction/word_prediction_model.py (100:112) duplicated block id: 59 size: 13 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (221:233) - pytorch_translate/dual_learning/dual_learning_task.py (279:291) duplicated block id: 60 size: 13 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (567:579) - pytorch_translate/ensemble_export.py (1111:1123) duplicated block id: 61 size: 13 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (217:229) - pytorch_translate/tasks/pytorch_translate_task.py (527:539) duplicated block id: 62 size: 13 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1111:1123) - pytorch_translate/ensemble_export.py (1538:1550) duplicated block id: 63 size: 13 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (218:230) - pytorch_translate/char_source_model.py (280:292) duplicated block id: 64 size: 13 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_models.py (177:189) - pytorch_translate/word_prediction/word_prediction_model.py (100:112) duplicated block id: 65 size: 12 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (482:494) - pytorch_translate/transformer_aan.py (569:582) duplicated block id: 66 size: 12 cleaned lines of code in 2 files: - pytorch_translate/multilingual_model.py (90:101) - pytorch_translate/semi_supervised.py (121:132) duplicated block id: 67 size: 12 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (403:416) - pytorch_translate/rnn.py (844:857) duplicated block id: 68 size: 12 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (97:108) - pytorch_translate/transformer_aan.py (76:87) duplicated block id: 69 size: 12 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (257:269) - pytorch_translate/multi_model.py (345:357) duplicated block id: 70 size: 12 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (465:477) - pytorch_translate/ensemble_export.py (1230:1244) duplicated block id: 71 size: 12 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (482:494) - pytorch_translate/transformer.py (688:700) duplicated block id: 72 size: 12 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (73:84) - pytorch_translate/transformer_aan.py (76:87) duplicated block id: 73 size: 12 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (226:239) - pytorch_translate/rnn.py (844:857) duplicated block id: 74 size: 12 cleaned lines of code in 2 files: - pytorch_translate/sequence_criterions.py (178:189) - pytorch_translate/sequence_criterions.py (209:220) duplicated block id: 75 size: 12 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (145:156) - pytorch_translate/transformer_aan.py (113:124) duplicated block id: 76 size: 11 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1152:1165) - pytorch_translate/ensemble_export.py (1566:1579) duplicated block id: 77 size: 11 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (844:854) - pytorch_translate/ensemble_export.py (1104:1114) duplicated block id: 78 size: 11 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (207:218) - pytorch_translate/dual_learning/dual_learning_task.py (266:276) duplicated block id: 79 size: 11 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (163:174) - pytorch_translate/multi_model.py (192:203) duplicated block id: 80 size: 11 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (502:512) - pytorch_translate/beam_search_and_decode_v2.py (524:534) duplicated block id: 81 size: 11 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (125:138) - pytorch_translate/transformer_aan.py (212:225) duplicated block id: 82 size: 11 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (593:606) - pytorch_translate/ensemble_export.py (646:659) duplicated block id: 83 size: 11 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (924:937) - pytorch_translate/beam_search_and_decode_v2.py (235:245) duplicated block id: 84 size: 11 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (593:606) - pytorch_translate/ensemble_export.py (691:704) duplicated block id: 85 size: 11 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (192:203) - pytorch_translate/multi_model.py (541:552) duplicated block id: 86 size: 11 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (112:122) - pytorch_translate/transformer.py (88:98) duplicated block id: 87 size: 11 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (115:125) - pytorch_translate/transformer_aan.py (113:123) duplicated block id: 88 size: 11 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (595:608) - pytorch_translate/ensemble_export.py (1152:1165) duplicated block id: 89 size: 11 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (646:659) - pytorch_translate/ensemble_export.py (691:704) duplicated block id: 90 size: 11 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (97:107) - pytorch_translate/transformer_aan.py (98:108) duplicated block id: 91 size: 11 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (470:483) - pytorch_translate/transformer_aan.py (364:376) duplicated block id: 92 size: 11 cleaned lines of code in 2 files: - pytorch_translate/preprocess.py (442:452) - pytorch_translate/preprocess.py (475:485) duplicated block id: 93 size: 11 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (434:445) - pytorch_translate/ensemble_export.py (1008:1019) duplicated block id: 94 size: 11 cleaned lines of code in 2 files: - pytorch_translate/common_layers.py (370:383) - pytorch_translate/common_layers.py (477:490) duplicated block id: 95 size: 11 cleaned lines of code in 2 files: - pytorch_translate/tasks/cross_lingual_lm.py (30:40) - pytorch_translate/tasks/pytorch_translate_task.py (32:42) duplicated block id: 96 size: 11 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (347:358) - pytorch_translate/multi_model.py (413:424) duplicated block id: 97 size: 11 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (467:477) - pytorch_translate/research/multisource/multisource_decode.py (391:401) duplicated block id: 98 size: 11 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (64:74) - pytorch_translate/rnn.py (112:122) duplicated block id: 99 size: 11 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (347:358) - pytorch_translate/multi_model.py (375:386) duplicated block id: 100 size: 11 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1008:1019) - pytorch_translate/ensemble_export.py (1478:1489) duplicated block id: 101 size: 11 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1024:1035) - pytorch_translate/ensemble_export.py (1495:1506) duplicated block id: 102 size: 11 cleaned lines of code in 2 files: - pytorch_translate/data/char_data.py (176:186) - pytorch_translate/data/data.py (202:212) duplicated block id: 103 size: 10 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (597:608) - pytorch_translate/ensemble_export.py (1661:1672) duplicated block id: 104 size: 10 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (228:239) - pytorch_translate/rnn.py (1017:1028) duplicated block id: 105 size: 10 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_models.py (119:128) - pytorch_translate/dual_learning/dual_learning_models.py (164:173) duplicated block id: 106 size: 10 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (150:164) - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (82:96) duplicated block id: 107 size: 10 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (501:515) - pytorch_translate/transformer.py (718:733) duplicated block id: 108 size: 10 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (443:452) - pytorch_translate/research/multisource/multisource_decode.py (362:371) duplicated block id: 109 size: 10 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (701:710) - pytorch_translate/transformer_aan.py (866:875) duplicated block id: 110 size: 10 cleaned lines of code in 2 files: - pytorch_translate/research/rescore/cloze_transformer_model.py (86:101) - pytorch_translate/transformer_aan.py (500:509) duplicated block id: 111 size: 10 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (427:436) - pytorch_translate/research/rescore/cloze_transformer_model.py (86:101) duplicated block id: 112 size: 10 cleaned lines of code in 2 files: - pytorch_translate/tasks/knowledge_distillation_task.py (91:103) - pytorch_translate/tasks/pytorch_translate_task.py (177:186) duplicated block id: 113 size: 10 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (451:461) - pytorch_translate/ensemble_export.py (1024:1034) duplicated block id: 114 size: 10 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1154:1165) - pytorch_translate/ensemble_export.py (1661:1672) duplicated block id: 115 size: 10 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (259:269) - pytorch_translate/multi_model.py (375:385) duplicated block id: 116 size: 10 cleaned lines of code in 2 files: - pytorch_translate/research/rescore/cloze_transformer_model.py (86:101) - pytorch_translate/transformer.py (585:594) duplicated block id: 117 size: 10 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (259:269) - pytorch_translate/multi_model.py (413:423) duplicated block id: 118 size: 10 cleaned lines of code in 2 files: - pytorch_translate/generate.py (544:553) - pytorch_translate/options.py (697:706) duplicated block id: 119 size: 10 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (150:164) - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (82:96) duplicated block id: 120 size: 10 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (489:503) - pytorch_translate/ensemble_export.py (1247:1261) duplicated block id: 121 size: 10 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (574:584) - pytorch_translate/ensemble_export.py (676:686) duplicated block id: 122 size: 10 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1568:1579) - pytorch_translate/ensemble_export.py (1661:1672) duplicated block id: 123 size: 10 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (263:280) - pytorch_translate/research/multisource/multisource_decode.py (193:210) duplicated block id: 124 size: 10 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (390:399) - pytorch_translate/ensemble_export.py (979:988) duplicated block id: 125 size: 10 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (405:416) - pytorch_translate/rnn.py (1017:1028) duplicated block id: 126 size: 10 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (542:554) - pytorch_translate/transformer.py (753:765) duplicated block id: 127 size: 10 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (627:637) - pytorch_translate/ensemble_export.py (676:686) duplicated block id: 128 size: 9 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (366:374) - pytorch_translate/ensemble_export.py (953:961) duplicated block id: 129 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (317:325) - pytorch_translate/multi_model.py (415:423) duplicated block id: 130 size: 9 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (655:663) - pytorch_translate/transformer.py (848:857) duplicated block id: 131 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (165:174) - pytorch_translate/multi_model.py (347:356) duplicated block id: 132 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (165:174) - pytorch_translate/multi_model.py (375:384) duplicated block id: 133 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (194:203) - pytorch_translate/multi_model.py (413:422) duplicated block id: 134 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (165:174) - pytorch_translate/multi_model.py (413:422) duplicated block id: 135 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (317:325) - pytorch_translate/multi_model.py (377:385) duplicated block id: 136 size: 9 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (438:447) - pytorch_translate/transformer_aan.py (346:355) duplicated block id: 137 size: 9 cleaned lines of code in 2 files: - pytorch_translate/tasks/denoising_autoencoder_task.py (222:234) - pytorch_translate/tasks/semi_supervised_task.py (322:334) duplicated block id: 138 size: 9 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (245:255) - pytorch_translate/transformer_aan.py (292:302) duplicated block id: 139 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (136:144) - pytorch_translate/multi_model.py (516:524) duplicated block id: 140 size: 9 cleaned lines of code in 2 files: - pytorch_translate/data/char_data.py (267:275) - pytorch_translate/data/weighted_data.py (46:54) duplicated block id: 141 size: 9 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (667:677) - pytorch_translate/transformer_aan.py (758:768) duplicated block id: 142 size: 9 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (597:606) - pytorch_translate/ensemble_export.py (754:763) duplicated block id: 143 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (375:384) - pytorch_translate/multi_model.py (543:552) duplicated block id: 144 size: 9 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (198:206) - pytorch_translate/transformer_aan.py (187:195) duplicated block id: 145 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (317:325) - pytorch_translate/multi_model.py (349:357) duplicated block id: 146 size: 9 cleaned lines of code in 2 files: - pytorch_translate/evals.py (19:27) - pytorch_translate/evals.py (170:178) duplicated block id: 147 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (194:203) - pytorch_translate/multi_model.py (259:268) duplicated block id: 148 size: 9 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_loss.py (94:102) - pytorch_translate/weighted_criterions.py (35:43) duplicated block id: 149 size: 9 cleaned lines of code in 2 files: - pytorch_translate/char_aware_hybrid.py (235:243) - pytorch_translate/hybrid_transformer_rnn.py (323:331) duplicated block id: 150 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (413:422) - pytorch_translate/multi_model.py (543:552) duplicated block id: 151 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (347:356) - pytorch_translate/multi_model.py (543:552) duplicated block id: 152 size: 9 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (650:659) - pytorch_translate/ensemble_export.py (754:763) duplicated block id: 153 size: 9 cleaned lines of code in 2 files: - pytorch_translate/data/char_data.py (398:406) - pytorch_translate/data/char_data.py (499:507) duplicated block id: 154 size: 9 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (180:189) - pytorch_translate/transformer.py (274:283) duplicated block id: 155 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (261:269) - pytorch_translate/multi_model.py (317:325) duplicated block id: 156 size: 9 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (158:166) - pytorch_translate/research/multisource/multisource_decode.py (125:133) duplicated block id: 157 size: 9 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (170:178) - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (165:173) duplicated block id: 158 size: 9 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (574:583) - pytorch_translate/ensemble_export.py (722:731) duplicated block id: 159 size: 9 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (695:704) - pytorch_translate/ensemble_export.py (754:763) duplicated block id: 160 size: 9 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_criterion.py (243:251) - pytorch_translate/research/knowledge_distillation/knowledge_distillation_loss.py (121:129) duplicated block id: 161 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (194:203) - pytorch_translate/multi_model.py (375:384) duplicated block id: 162 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (194:203) - pytorch_translate/multi_model.py (347:356) duplicated block id: 163 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (165:174) - pytorch_translate/multi_model.py (259:268) duplicated block id: 164 size: 9 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (379:387) - pytorch_translate/ensemble_export.py (968:976) duplicated block id: 165 size: 9 cleaned lines of code in 2 files: - pytorch_translate/preprocess.py (454:462) - pytorch_translate/preprocess.py (487:495) duplicated block id: 166 size: 9 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (627:636) - pytorch_translate/ensemble_export.py (722:731) duplicated block id: 167 size: 9 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (144:152) - pytorch_translate/dual_learning/dual_learning_criterion.py (39:47) duplicated block id: 168 size: 9 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (259:268) - pytorch_translate/multi_model.py (543:552) duplicated block id: 169 size: 9 cleaned lines of code in 2 files: - pytorch_translate/data/char_data.py (134:143) - pytorch_translate/data/char_data.py (190:200) duplicated block id: 170 size: 9 cleaned lines of code in 2 files: - pytorch_translate/data/dictionary.py (106:114) - pytorch_translate/data/dictionary.py (152:160) duplicated block id: 171 size: 9 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (676:685) - pytorch_translate/ensemble_export.py (722:731) duplicated block id: 172 size: 8 cleaned lines of code in 2 files: - pytorch_translate/common_layers.py (528:536) - pytorch_translate/transformer_aan.py (214:222) duplicated block id: 173 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (87:94) - pytorch_translate/multi_model.py (349:356) duplicated block id: 174 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (87:94) - pytorch_translate/multi_model.py (317:324) duplicated block id: 175 size: 8 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (313:320) - pytorch_translate/transformer.py (466:473) duplicated block id: 176 size: 8 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (128:135) - pytorch_translate/transformer_aan.py (259:266) duplicated block id: 177 size: 8 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (67:74) - pytorch_translate/transformer.py (139:146) duplicated block id: 178 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (317:324) - pytorch_translate/multi_model.py (516:523) duplicated block id: 179 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (87:94) - pytorch_translate/multi_model.py (136:143) duplicated block id: 180 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (225:232) - pytorch_translate/multi_model.py (317:324) duplicated block id: 181 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (167:174) - pytorch_translate/multi_model.py (516:523) duplicated block id: 182 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (225:232) - pytorch_translate/multi_model.py (349:356) duplicated block id: 183 size: 8 cleaned lines of code in 2 files: - pytorch_translate/ngram.py (56:63) - pytorch_translate/rnn.py (1089:1096) duplicated block id: 184 size: 8 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (413:421) - pytorch_translate/transformer_aan.py (316:324) duplicated block id: 185 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (225:232) - pytorch_translate/multi_model.py (377:384) duplicated block id: 186 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (87:94) - pytorch_translate/multi_model.py (377:384) duplicated block id: 187 size: 8 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (421:428) - pytorch_translate/transformer.py (557:564) duplicated block id: 188 size: 8 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (374:386) - pytorch_translate/transformer_aan.py (415:427) duplicated block id: 189 size: 8 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_models.py (121:128) - pytorch_translate/word_prediction/word_prediction_model.py (83:90) duplicated block id: 190 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (340:356) - pytorch_translate/char_source_transformer_model.py (279:295) duplicated block id: 191 size: 8 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (274:281) - pytorch_translate/word_prediction/word_prediction_model.py (118:125) duplicated block id: 192 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (136:143) - pytorch_translate/multi_model.py (545:552) duplicated block id: 193 size: 8 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (133:142) - pytorch_translate/tasks/translation_from_pretrained_xlm.py (77:86) duplicated block id: 194 size: 8 cleaned lines of code in 2 files: - pytorch_translate/options.py (138:145) - pytorch_translate/options.py (207:214) duplicated block id: 195 size: 8 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (180:187) - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (125:132) duplicated block id: 196 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (128:140) - pytorch_translate/char_source_transformer_model.py (182:194) duplicated block id: 197 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_aware_hybrid.py (34:43) - pytorch_translate/char_source_transformer_model.py (97:106) duplicated block id: 198 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (87:94) - pytorch_translate/multi_model.py (516:523) duplicated block id: 199 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (349:356) - pytorch_translate/multi_model.py (516:523) duplicated block id: 200 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (42:55) - pytorch_translate/char_source_transformer_model.py (147:161) duplicated block id: 201 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_encoder.py (14:21) - pytorch_translate/char_source_transformer_model.py (37:44) duplicated block id: 202 size: 8 cleaned lines of code in 2 files: - pytorch_translate/rescoring/rescorer.py (268:275) - pytorch_translate/research/rescore/rescoring_criterion.py (217:224) duplicated block id: 203 size: 8 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (533:540) - pytorch_translate/transformer_aan.py (427:434) duplicated block id: 204 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (136:143) - pytorch_translate/multi_model.py (415:422) duplicated block id: 205 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (87:94) - pytorch_translate/multi_model.py (545:552) duplicated block id: 206 size: 8 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (869:877) - pytorch_translate/transformer_aan.py (760:768) duplicated block id: 207 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (225:232) - pytorch_translate/multi_model.py (261:268) duplicated block id: 208 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_aware_hybrid.py (34:43) - pytorch_translate/char_source_hybrid.py (110:119) duplicated block id: 209 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (377:384) - pytorch_translate/multi_model.py (516:523) duplicated block id: 210 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (136:143) - pytorch_translate/multi_model.py (317:324) duplicated block id: 211 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (196:203) - pytorch_translate/multi_model.py (516:523) duplicated block id: 212 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (136:143) - pytorch_translate/multi_model.py (349:356) duplicated block id: 213 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (87:94) - pytorch_translate/multi_model.py (415:422) duplicated block id: 214 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (135:148) - pytorch_translate/char_source_transformer_model.py (182:194) duplicated block id: 215 size: 8 cleaned lines of code in 2 files: - pytorch_translate/data/weighted_data.py (63:77) - pytorch_translate/data/weighted_data.py (128:142) duplicated block id: 216 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (136:143) - pytorch_translate/multi_model.py (377:384) duplicated block id: 217 size: 8 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (180:187) - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (128:135) duplicated block id: 218 size: 8 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_models.py (166:173) - pytorch_translate/word_prediction/word_prediction_model.py (83:90) duplicated block id: 219 size: 8 cleaned lines of code in 2 files: - pytorch_translate/research/multisource/multisource_decode.py (142:149) - pytorch_translate/research/multisource/multisource_decode.py (157:164) duplicated block id: 220 size: 8 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (128:135) - pytorch_translate/transformer.py (274:281) duplicated block id: 221 size: 8 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (26:35) - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (26:35) duplicated block id: 222 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (415:422) - pytorch_translate/multi_model.py (516:523) duplicated block id: 223 size: 8 cleaned lines of code in 2 files: - pytorch_translate/common_layers.py (392:399) - pytorch_translate/common_layers.py (492:499) duplicated block id: 224 size: 8 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (91:98) - pytorch_translate/transformer.py (139:146) duplicated block id: 225 size: 8 cleaned lines of code in 2 files: - pytorch_translate/ngram.py (46:53) - pytorch_translate/rnn.py (1073:1080) duplicated block id: 226 size: 8 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (125:132) - pytorch_translate/word_prediction/word_prediction_model.py (118:125) duplicated block id: 227 size: 8 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (274:281) - pytorch_translate/transformer_aan.py (259:266) duplicated block id: 228 size: 8 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (109:116) - pytorch_translate/transformer.py (91:98) duplicated block id: 229 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (136:143) - pytorch_translate/multi_model.py (167:174) duplicated block id: 230 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (136:143) - pytorch_translate/multi_model.py (196:203) duplicated block id: 231 size: 8 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (125:132) - pytorch_translate/transformer_aan.py (259:266) duplicated block id: 232 size: 8 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (453:460) - pytorch_translate/word_prediction/word_prediction_model.py (82:89) duplicated block id: 233 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (196:203) - pytorch_translate/multi_model.py (317:324) duplicated block id: 234 size: 8 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (125:132) - pytorch_translate/transformer.py (274:281) duplicated block id: 235 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (136:143) - pytorch_translate/multi_model.py (225:232) duplicated block id: 236 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (136:143) - pytorch_translate/multi_model.py (261:268) duplicated block id: 237 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_encoder.py (14:21) - pytorch_translate/char_source_hybrid.py (50:57) duplicated block id: 238 size: 8 cleaned lines of code in 2 files: - pytorch_translate/transformer_aan.py (259:266) - pytorch_translate/word_prediction/word_prediction_model.py (118:125) duplicated block id: 239 size: 8 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (115:122) - pytorch_translate/transformer.py (139:146) duplicated block id: 240 size: 8 cleaned lines of code in 2 files: - pytorch_translate/data/weighted_data.py (46:53) - pytorch_translate/research/knowledge_distillation/teacher_score_data.py (22:29) duplicated block id: 241 size: 8 cleaned lines of code in 2 files: - pytorch_translate/common_layers.py (528:536) - pytorch_translate/research/deliberation_networks/deliberation_networks.py (127:135) duplicated block id: 242 size: 8 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (832:840) - pytorch_translate/transformer_aan.py (737:744) duplicated block id: 243 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (87:94) - pytorch_translate/multi_model.py (196:203) duplicated block id: 244 size: 8 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (669:677) - pytorch_translate/transformer.py (869:877) duplicated block id: 245 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (87:94) - pytorch_translate/multi_model.py (167:174) duplicated block id: 246 size: 8 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (960:968) - pytorch_translate/beam_search_and_decode_v2.py (253:260) duplicated block id: 247 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (277:293) - pytorch_translate/char_source_model.py (340:356) duplicated block id: 248 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (225:232) - pytorch_translate/multi_model.py (415:422) duplicated block id: 249 size: 8 cleaned lines of code in 2 files: - pytorch_translate/data/char_data.py (302:317) - pytorch_translate/data/weighted_data.py (63:77) duplicated block id: 250 size: 8 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (749:757) - pytorch_translate/rnn.py (1339:1347) duplicated block id: 251 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (225:232) - pytorch_translate/multi_model.py (516:523) duplicated block id: 252 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (516:523) - pytorch_translate/multi_model.py (545:552) duplicated block id: 253 size: 8 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (421:428) - pytorch_translate/transformer_aan.py (452:459) duplicated block id: 254 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (87:94) - pytorch_translate/multi_model.py (261:268) duplicated block id: 255 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (135:148) - pytorch_translate/char_source_model.py (128:140) duplicated block id: 256 size: 8 cleaned lines of code in 2 files: - pytorch_translate/data/char_data.py (302:317) - pytorch_translate/data/weighted_data.py (128:142) duplicated block id: 257 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (167:174) - pytorch_translate/multi_model.py (317:324) duplicated block id: 258 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (225:232) - pytorch_translate/multi_model.py (545:552) duplicated block id: 259 size: 8 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (180:187) - pytorch_translate/word_prediction/word_prediction_model.py (118:125) duplicated block id: 260 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (87:94) - pytorch_translate/multi_model.py (225:232) duplicated block id: 261 size: 8 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (128:135) - pytorch_translate/word_prediction/word_prediction_model.py (118:125) duplicated block id: 262 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (196:203) - pytorch_translate/multi_model.py (225:232) duplicated block id: 263 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_aware_hybrid.py (46:58) - pytorch_translate/char_source_hybrid.py (118:130) duplicated block id: 264 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (317:324) - pytorch_translate/multi_model.py (545:552) duplicated block id: 265 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (167:174) - pytorch_translate/multi_model.py (225:232) duplicated block id: 266 size: 8 cleaned lines of code in 2 files: - pytorch_translate/data/char_data.py (267:274) - pytorch_translate/research/knowledge_distillation/teacher_score_data.py (22:29) duplicated block id: 267 size: 8 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (126:134) - pytorch_translate/tasks/translation_lev_task.py (47:54) duplicated block id: 268 size: 8 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (261:268) - pytorch_translate/multi_model.py (516:523) duplicated block id: 269 size: 8 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (191:198) - pytorch_translate/char_source_model.py (325:332) duplicated block id: 270 size: 8 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (109:116) - pytorch_translate/rnn.py (115:122) duplicated block id: 271 size: 8 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (180:187) - pytorch_translate/transformer_aan.py (259:266) duplicated block id: 272 size: 8 cleaned lines of code in 2 files: - pytorch_translate/vocab_reduction.py (166:173) - pytorch_translate/vocab_reduction.py (185:192) duplicated block id: 273 size: 8 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (67:74) - pytorch_translate/hybrid_transformer_rnn.py (109:116) duplicated block id: 274 size: 7 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1104:1110) - pytorch_translate/ensemble_export.py (1529:1535) duplicated block id: 275 size: 7 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (224:230) - pytorch_translate/tasks/pytorch_translate_task.py (240:246) duplicated block id: 276 size: 7 cleaned lines of code in 2 files: - pytorch_translate/evals.py (142:148) - pytorch_translate/train.py (433:439) duplicated block id: 277 size: 7 cleaned lines of code in 2 files: - pytorch_translate/benchmark.py (133:139) - pytorch_translate/generate.py (719:725) duplicated block id: 278 size: 7 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (12:19) - pytorch_translate/transformer_aan.py (10:17) duplicated block id: 279 size: 7 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (911:917) - pytorch_translate/ensemble_export.py (929:935) duplicated block id: 280 size: 7 cleaned lines of code in 2 files: - pytorch_translate/generate.py (719:725) - pytorch_translate/research/knowledge_distillation/collect_top_k_probs.py (120:126) duplicated block id: 281 size: 7 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (558:564) - pytorch_translate/ensemble_export.py (844:850) duplicated block id: 282 size: 7 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (329:338) - pytorch_translate/rnn.py (795:805) duplicated block id: 283 size: 7 cleaned lines of code in 2 files: - pytorch_translate/train.py (600:606) - pytorch_translate/train.py (642:648) duplicated block id: 284 size: 7 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (754:763) - pytorch_translate/transformer_aan.py (663:672) duplicated block id: 285 size: 7 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (88:94) - pytorch_translate/research/multisource/multisource_decode.py (72:78) duplicated block id: 286 size: 7 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (480:486) - pytorch_translate/ensemble_export.py (539:545) duplicated block id: 287 size: 7 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (308:314) - pytorch_translate/research/deliberation_networks/deliberation_networks.py (338:344) duplicated block id: 288 size: 7 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (227:233) - pytorch_translate/transformer_aan.py (224:230) duplicated block id: 289 size: 7 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (92:98) - pytorch_translate/dual_learning/dual_learning_models.py (167:173) duplicated block id: 290 size: 7 cleaned lines of code in 2 files: - pytorch_translate/benchmark.py (133:139) - pytorch_translate/research/knowledge_distillation/collect_top_k_probs.py (120:126) duplicated block id: 291 size: 7 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (288:294) - pytorch_translate/transformer_aan.py (332:338) duplicated block id: 292 size: 7 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_models.py (166:172) - pytorch_translate/rnn.py (454:460) duplicated block id: 293 size: 7 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (481:487) - pytorch_translate/beam_search_and_decode_v2.py (524:530) duplicated block id: 294 size: 7 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (216:222) - pytorch_translate/multi_model.py (537:543) duplicated block id: 295 size: 7 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (171:177) - pytorch_translate/tasks/pytorch_translate_task.py (451:457) duplicated block id: 296 size: 7 cleaned lines of code in 2 files: - pytorch_translate/char_aware_hybrid.py (211:217) - pytorch_translate/hybrid_transformer_rnn.py (313:319) duplicated block id: 297 size: 7 cleaned lines of code in 2 files: - pytorch_translate/tasks/denoising_autoencoder_task.py (94:100) - pytorch_translate/tasks/denoising_autoencoder_task.py (103:109) duplicated block id: 298 size: 7 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (92:98) - pytorch_translate/word_prediction/word_prediction_model.py (84:90) duplicated block id: 299 size: 7 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (92:98) - pytorch_translate/dual_learning/dual_learning_models.py (122:128) duplicated block id: 300 size: 7 cleaned lines of code in 2 files: - pytorch_translate/rescoring/weights_search.py (42:49) - pytorch_translate/rescoring/weights_search.py (76:83) duplicated block id: 301 size: 7 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (558:564) - pytorch_translate/ensemble_export.py (1104:1110) duplicated block id: 302 size: 7 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (543:552) - pytorch_translate/transformer_aan.py (663:672) duplicated block id: 303 size: 7 cleaned lines of code in 2 files: - pytorch_translate/generate.py (709:715) - pytorch_translate/research/knowledge_distillation/collect_top_k_probs.py (108:114) duplicated block id: 304 size: 7 cleaned lines of code in 2 files: - pytorch_translate/char_aware_hybrid.py (319:327) - pytorch_translate/data/char_data.py (95:103) duplicated block id: 305 size: 7 cleaned lines of code in 2 files: - pytorch_translate/char_aware_hybrid.py (211:217) - pytorch_translate/transformer.py (466:472) duplicated block id: 306 size: 7 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (159:165) - pytorch_translate/multi_model.py (216:222) duplicated block id: 307 size: 7 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (98:105) - pytorch_translate/rnn.py (568:574) duplicated block id: 308 size: 7 cleaned lines of code in 2 files: - pytorch_translate/generate.py (211:217) - pytorch_translate/generate.py (363:369) duplicated block id: 309 size: 7 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (157:164) - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (152:159) duplicated block id: 310 size: 7 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (120:126) - pytorch_translate/multi_model.py (498:504) duplicated block id: 311 size: 7 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (4:11) - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (4:11) duplicated block id: 312 size: 7 cleaned lines of code in 2 files: - pytorch_translate/average_attention.py (139:145) - pytorch_translate/average_attention.py (205:211) duplicated block id: 313 size: 7 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (719:725) - pytorch_translate/multilingual.py (136:142) duplicated block id: 314 size: 7 cleaned lines of code in 2 files: - pytorch_translate/benchmark.py (125:131) - pytorch_translate/research/knowledge_distillation/collect_top_k_probs.py (108:114) duplicated block id: 315 size: 7 cleaned lines of code in 2 files: - pytorch_translate/preprocess.py (219:229) - pytorch_translate/preprocess.py (335:345) duplicated block id: 316 size: 7 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (765:771) - pytorch_translate/rnn.py (912:918) duplicated block id: 317 size: 7 cleaned lines of code in 2 files: - pytorch_translate/research/rescore/cloze_transformer_model.py (25:31) - pytorch_translate/transformer_aan.py (224:230) duplicated block id: 318 size: 7 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (427:434) - pytorch_translate/ensemble_export.py (1207:1214) duplicated block id: 319 size: 7 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (481:487) - pytorch_translate/beam_search_and_decode_v2.py (502:508) duplicated block id: 320 size: 7 cleaned lines of code in 2 files: - pytorch_translate/benchmark.py (125:131) - pytorch_translate/generate.py (709:715) duplicated block id: 321 size: 7 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (17:24) - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (17:24) duplicated block id: 322 size: 7 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (844:850) - pytorch_translate/ensemble_export.py (1529:1535) duplicated block id: 323 size: 7 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1075:1082) - pytorch_translate/ensemble_export.py (1093:1100) duplicated block id: 324 size: 7 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (590:596) - pytorch_translate/tasks/pytorch_translate_task.py (706:712) duplicated block id: 325 size: 7 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (612:618) - pytorch_translate/transformer_aan.py (740:746) duplicated block id: 326 size: 7 cleaned lines of code in 2 files: - pytorch_translate/train.py (709:715) - pytorch_translate/train.py (760:766) duplicated block id: 327 size: 7 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_loss.py (143:149) - pytorch_translate/sequence_criterions.py (154:160) duplicated block id: 328 size: 7 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (805:812) - pytorch_translate/transformer_aan.py (698:704) duplicated block id: 329 size: 7 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_models.py (121:127) - pytorch_translate/rnn.py (454:460) duplicated block id: 330 size: 6 cleaned lines of code in 2 files: - pytorch_translate/common_layers.py (441:446) - pytorch_translate/multi_model.py (720:725) duplicated block id: 331 size: 6 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (163:168) - pytorch_translate/transformer.py (136:141) duplicated block id: 332 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (243:248) - pytorch_translate/ensemble_export.py (1529:1534) duplicated block id: 333 size: 6 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (224:229) - pytorch_translate/tasks/pytorch_translate_task.py (251:256) duplicated block id: 334 size: 6 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (64:69) - pytorch_translate/dual_learning/dual_learning_task.py (78:83) duplicated block id: 335 size: 6 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (558:563) - pytorch_translate/ensemble_export.py (243:248) duplicated block id: 336 size: 6 cleaned lines of code in 2 files: - pytorch_translate/generate.py (212:217) - pytorch_translate/rescoring/rescorer.py (323:328) duplicated block id: 337 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (855:860) - pytorch_translate/ensemble_export.py (1116:1121) duplicated block id: 338 size: 6 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (425:431) - pytorch_translate/transformer_aan.py (326:332) duplicated block id: 339 size: 6 cleaned lines of code in 2 files: - pytorch_translate/data/char_data.py (119:124) - pytorch_translate/data/char_data.py (169:174) duplicated block id: 340 size: 6 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (240:245) - pytorch_translate/tasks/pytorch_translate_task.py (534:539) duplicated block id: 341 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (73:78) - pytorch_translate/char_source_transformer_model.py (171:176) duplicated block id: 342 size: 6 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (240:245) - pytorch_translate/tasks/pytorch_translate_task.py (549:554) duplicated block id: 343 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (67:72) - pytorch_translate/word_prediction/word_prediction_model.py (84:89) duplicated block id: 344 size: 6 cleaned lines of code in 2 files: - pytorch_translate/common_layers.py (128:133) - pytorch_translate/rnn.py (1113:1118) duplicated block id: 345 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (156:161) - pytorch_translate/ensemble_export.py (272:277) duplicated block id: 346 size: 6 cleaned lines of code in 2 files: - pytorch_translate/options.py (683:688) - pytorch_translate/rescoring/rescorer.py (200:205) duplicated block id: 347 size: 6 cleaned lines of code in 2 files: - pytorch_translate/research/rescore/cloze_transformer_model.py (51:56) - pytorch_translate/transformer.py (244:249) duplicated block id: 348 size: 6 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (41:46) - pytorch_translate/rnn.py (57:62) duplicated block id: 349 size: 6 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (822:827) - pytorch_translate/transformer_aan.py (729:734) duplicated block id: 350 size: 6 cleaned lines of code in 2 files: - pytorch_translate/research/tune_ensemble_weights/tune_model_weights.py (38:45) - pytorch_translate/research/tune_ensemble_weights/tune_model_weights_with_ax.py (48:55) duplicated block id: 351 size: 6 cleaned lines of code in 2 files: - pytorch_translate/research/rescore/cloze_transformer_model.py (42:47) - pytorch_translate/transformer.py (253:258) duplicated block id: 352 size: 6 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (188:193) - pytorch_translate/transformer_aan.py (140:145) duplicated block id: 353 size: 6 cleaned lines of code in 2 files: - pytorch_translate/common_layers.py (275:280) - pytorch_translate/rnn.py (1068:1073) duplicated block id: 354 size: 6 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (614:619) - pytorch_translate/transformer.py (622:627) duplicated block id: 355 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (844:849) - pytorch_translate/ensemble_export.py (1426:1431) duplicated block id: 356 size: 6 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (81:87) - pytorch_translate/transformer.py (49:56) duplicated block id: 357 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1067:1072) - pytorch_translate/ensemble_export.py (1085:1090) duplicated block id: 358 size: 6 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (501:506) - pytorch_translate/ensemble_export.py (1084:1089) duplicated block id: 359 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (230:235) - pytorch_translate/rnn.py (56:61) duplicated block id: 360 size: 6 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (431:437) - pytorch_translate/research/multisource/multisource_decode.py (354:360) duplicated block id: 361 size: 6 cleaned lines of code in 2 files: - pytorch_translate/research/multisource/multisource_decode.py (538:543) - pytorch_translate/rnn.py (40:45) duplicated block id: 362 size: 6 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (268:273) - pytorch_translate/dual_learning/dual_learning_task.py (281:286) duplicated block id: 363 size: 6 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (56:61) - pytorch_translate/rnn.py (848:853) duplicated block id: 364 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (67:72) - pytorch_translate/char_source_model.py (92:97) duplicated block id: 365 size: 6 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (336:341) - pytorch_translate/transformer.py (468:473) duplicated block id: 366 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (407:412) - pytorch_translate/rnn.py (56:61) duplicated block id: 367 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (67:72) - pytorch_translate/dual_learning/dual_learning_models.py (167:172) duplicated block id: 368 size: 6 cleaned lines of code in 2 files: - pytorch_translate/generate.py (535:540) - pytorch_translate/options.py (668:673) duplicated block id: 369 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (159:164) - pytorch_translate/hybrid_transformer_rnn.py (159:164) duplicated block id: 370 size: 6 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (209:214) - pytorch_translate/tasks/denoising_autoencoder_task.py (125:130) duplicated block id: 371 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (175:180) - pytorch_translate/char_source_model.py (73:78) duplicated block id: 372 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (443:449) - pytorch_translate/ensemble_export.py (1216:1222) duplicated block id: 373 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (159:164) - pytorch_translate/research/knowledge_distillation/dual_decoder_kd_model.py (91:96) duplicated block id: 374 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_aware_hybrid.py (124:129) - pytorch_translate/transformer_aan.py (275:280) duplicated block id: 375 size: 6 cleaned lines of code in 2 files: - pytorch_translate/generate.py (212:217) - pytorch_translate/generate.py (236:241) duplicated block id: 376 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (267:272) - pytorch_translate/rnn.py (763:768) duplicated block id: 377 size: 6 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (92:97) - pytorch_translate/dual_learning/dual_learning_task.py (106:111) duplicated block id: 378 size: 6 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (315:320) - pytorch_translate/hybrid_transformer_rnn.py (336:341) duplicated block id: 379 size: 6 cleaned lines of code in 2 files: - pytorch_translate/multi_model.py (272:277) - pytorch_translate/multi_model.py (358:363) duplicated block id: 380 size: 6 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (8:13) - pytorch_translate/transformer_aan.py (10:15) duplicated block id: 381 size: 6 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (814:819) - pytorch_translate/beam_decode.py (986:991) duplicated block id: 382 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (67:72) - pytorch_translate/rnn.py (455:460) duplicated block id: 383 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (243:248) - pytorch_translate/ensemble_export.py (844:849) duplicated block id: 384 size: 6 cleaned lines of code in 2 files: - pytorch_translate/generate.py (236:241) - pytorch_translate/sequence_criterions.py (25:30) duplicated block id: 385 size: 6 cleaned lines of code in 2 files: - pytorch_translate/common_layers.py (343:348) - pytorch_translate/multilingual.py (136:141) duplicated block id: 386 size: 6 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (223:228) - pytorch_translate/dual_learning/dual_learning_task.py (268:273) duplicated block id: 387 size: 6 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (209:214) - pytorch_translate/dual_learning/dual_learning_task.py (281:286) duplicated block id: 388 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (855:860) - pytorch_translate/ensemble_export.py (1543:1548) duplicated block id: 389 size: 6 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (328:333) - pytorch_translate/tasks/pytorch_translate_task.py (337:342) duplicated block id: 390 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_transformer_model.py (125:130) - pytorch_translate/char_source_transformer_model.py (134:139) duplicated block id: 391 size: 6 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (774:779) - pytorch_translate/rnn.py (919:924) duplicated block id: 392 size: 6 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (145:157) - pytorch_translate/transformer.py (213:225) duplicated block id: 393 size: 6 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (56:61) - pytorch_translate/rnn.py (1019:1024) duplicated block id: 394 size: 6 cleaned lines of code in 2 files: - pytorch_translate/rescoring/rescorer.py (323:328) - pytorch_translate/sequence_criterions.py (25:30) duplicated block id: 395 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (501:507) - pytorch_translate/ensemble_export.py (735:741) duplicated block id: 396 size: 6 cleaned lines of code in 2 files: - pytorch_translate/data/weighted_data.py (94:100) - pytorch_translate/data/weighted_data.py (148:154) duplicated block id: 397 size: 6 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (224:229) - pytorch_translate/tasks/pytorch_translate_task.py (549:554) duplicated block id: 398 size: 6 cleaned lines of code in 2 files: - pytorch_translate/generate.py (236:241) - pytorch_translate/generate.py (364:369) duplicated block id: 399 size: 6 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (244:249) - pytorch_translate/transformer.py (253:258) duplicated block id: 400 size: 6 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (8:13) - pytorch_translate/transformer.py (12:17) duplicated block id: 401 size: 6 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (25:32) - pytorch_translate/rnn.py (81:87) duplicated block id: 402 size: 6 cleaned lines of code in 2 files: - pytorch_translate/research/deliberation_networks/deliberation_networks.py (392:397) - pytorch_translate/transformer_aan.py (430:435) duplicated block id: 403 size: 6 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (240:245) - pytorch_translate/tasks/pytorch_translate_task.py (251:256) duplicated block id: 404 size: 6 cleaned lines of code in 2 files: - pytorch_translate/data/char_data.py (211:217) - pytorch_translate/data/char_data.py (250:256) duplicated block id: 405 size: 6 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (431:436) - pytorch_translate/transformer_aan.py (143:148) duplicated block id: 406 size: 6 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (418:423) - pytorch_translate/ensemble_export.py (997:1002) duplicated block id: 407 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (152:157) - pytorch_translate/ensemble_export.py (1336:1341) duplicated block id: 408 size: 6 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (81:87) - pytorch_translate/transformer_aan.py (37:44) duplicated block id: 409 size: 6 cleaned lines of code in 2 files: - pytorch_translate/research/beam_search/competing_completed.py (195:201) - pytorch_translate/research/multisource/multisource_decode.py (389:395) duplicated block id: 410 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (421:426) - pytorch_translate/ensemble_export.py (768:773) duplicated block id: 411 size: 6 cleaned lines of code in 2 files: - pytorch_translate/transformer.py (843:849) - pytorch_translate/transformer_aan.py (746:752) duplicated block id: 412 size: 6 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (209:214) - pytorch_translate/dual_learning/dual_learning_task.py (223:228) duplicated block id: 413 size: 6 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (534:539) - pytorch_translate/tasks/pytorch_translate_task.py (549:554) duplicated block id: 414 size: 6 cleaned lines of code in 2 files: - pytorch_translate/generate.py (236:241) - pytorch_translate/rescoring/rescorer.py (323:328) duplicated block id: 415 size: 6 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (268:273) - pytorch_translate/tasks/denoising_autoencoder_task.py (125:130) duplicated block id: 416 size: 6 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (572:577) - pytorch_translate/ensemble_export.py (855:860) duplicated block id: 417 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_aware_hybrid.py (96:101) - pytorch_translate/char_source_hybrid.py (184:189) duplicated block id: 418 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (92:97) - pytorch_translate/rnn.py (455:460) duplicated block id: 419 size: 6 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (106:111) - pytorch_translate/rnn.py (163:168) duplicated block id: 420 size: 6 cleaned lines of code in 2 files: - pytorch_translate/common_layers.py (441:446) - pytorch_translate/multilingual.py (137:142) duplicated block id: 421 size: 6 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (138:143) - pytorch_translate/transformer_aan.py (187:192) duplicated block id: 422 size: 6 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (558:563) - pytorch_translate/ensemble_export.py (1426:1431) duplicated block id: 423 size: 6 cleaned lines of code in 2 files: - pytorch_translate/research/knowledge_distillation/knowledge_distillation_loss.py (110:117) - pytorch_translate/research/rescore/rescoring_criterion.py (193:200) duplicated block id: 424 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_hybrid.py (159:164) - pytorch_translate/research/knowledge_distillation/hybrid_dual_decoder_kd_model.py (91:96) duplicated block id: 425 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (281:287) - pytorch_translate/ensemble_export.py (1177:1183) duplicated block id: 426 size: 6 cleaned lines of code in 2 files: - pytorch_translate/generate.py (364:369) - pytorch_translate/sequence_criterions.py (25:30) duplicated block id: 427 size: 6 cleaned lines of code in 2 files: - pytorch_translate/generate.py (364:369) - pytorch_translate/rescoring/rescorer.py (323:328) duplicated block id: 428 size: 6 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (1007:1012) - pytorch_translate/rnn.py (1418:1423) duplicated block id: 429 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1104:1109) - pytorch_translate/ensemble_export.py (1426:1431) duplicated block id: 430 size: 6 cleaned lines of code in 2 files: - pytorch_translate/beam_decode.py (814:819) - pytorch_translate/beam_search_and_decode_v2.py (274:279) duplicated block id: 431 size: 6 cleaned lines of code in 2 files: - pytorch_translate/research/rescore/cloze_transformer_model.py (42:47) - pytorch_translate/research/rescore/cloze_transformer_model.py (51:56) duplicated block id: 432 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1426:1431) - pytorch_translate/ensemble_export.py (1529:1534) duplicated block id: 433 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (1585:1590) - pytorch_translate/ensemble_export.py (1600:1605) duplicated block id: 434 size: 6 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (223:228) - pytorch_translate/tasks/denoising_autoencoder_task.py (125:130) duplicated block id: 435 size: 6 cleaned lines of code in 2 files: - pytorch_translate/rnn.py (818:825) - pytorch_translate/rnn.py (958:965) duplicated block id: 436 size: 6 cleaned lines of code in 2 files: - pytorch_translate/beam_search_and_decode_v2.py (515:521) - pytorch_translate/beam_search_and_decode_v2.py (537:543) duplicated block id: 437 size: 6 cleaned lines of code in 2 files: - pytorch_translate/ensemble_export.py (243:248) - pytorch_translate/ensemble_export.py (1104:1109) duplicated block id: 438 size: 6 cleaned lines of code in 2 files: - pytorch_translate/hybrid_transformer_rnn.py (138:143) - pytorch_translate/transformer.py (198:203) duplicated block id: 439 size: 6 cleaned lines of code in 2 files: - pytorch_translate/dual_learning/dual_learning_task.py (281:286) - pytorch_translate/tasks/denoising_autoencoder_task.py (125:130) duplicated block id: 440 size: 6 cleaned lines of code in 2 files: - pytorch_translate/generate.py (212:217) - pytorch_translate/sequence_criterions.py (25:30) duplicated block id: 441 size: 6 cleaned lines of code in 2 files: - pytorch_translate/common_layers.py (343:348) - pytorch_translate/multi_model.py (719:724) duplicated block id: 442 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_encoder.py (184:189) - pytorch_translate/char_encoder.py (397:402) duplicated block id: 443 size: 6 cleaned lines of code in 2 files: - pytorch_translate/tasks/knowledge_distillation_task.py (117:122) - pytorch_translate/tasks/knowledge_distillation_task.py (132:137) duplicated block id: 444 size: 6 cleaned lines of code in 2 files: - pytorch_translate/char_source_model.py (67:72) - pytorch_translate/dual_learning/dual_learning_models.py (122:127) duplicated block id: 445 size: 6 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (251:256) - pytorch_translate/tasks/pytorch_translate_task.py (549:554) duplicated block id: 446 size: 6 cleaned lines of code in 2 files: - pytorch_translate/tasks/pytorch_translate_task.py (251:256) - pytorch_translate/tasks/pytorch_translate_task.py (534:539)