duplicated block id: 1 size: 61 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (211:276) - pytext/data/squad_for_bert_tensorizer.py (391:455) duplicated block id: 2 size: 50 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (371:425) - pytext/data/token_tensorizer.py (191:245) duplicated block id: 3 size: 48 cleaned lines of code in 2 files: - pytext/models/representations/lightconv.py (173:231) - pytext/models/seq_models/conv_encoder.py (317:375) duplicated block id: 4 size: 35 cleaned lines of code in 2 files: - pytext/models/decoders/mlp_decoder_n_tower.py (61:100) - pytext/models/decoders/mlp_decoder_tri_tower.py (82:121) duplicated block id: 5 size: 35 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1087:1125) - pytext/torchscript/module.py (1983:2021) duplicated block id: 6 size: 33 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (169:206) - pytext/data/squad_for_bert_tensorizer.py (347:384) duplicated block id: 7 size: 30 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (347:378) - pytext/data/squad_tensorizer.py (218:249) duplicated block id: 8 size: 30 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (169:200) - pytext/data/squad_tensorizer.py (218:249) duplicated block id: 9 size: 28 cleaned lines of code in 2 files: - pytext/models/decoders/mlp_decoder_n_tower.py (68:100) - pytext/models/decoders/mlp_decoder_two_tower.py (120:152) duplicated block id: 10 size: 28 cleaned lines of code in 2 files: - pytext/torchscript/module.py (789:817) - pytext/torchscript/module.py (847:875) duplicated block id: 11 size: 28 cleaned lines of code in 2 files: - pytext/models/decoders/mlp_decoder_tri_tower.py (89:121) - pytext/models/decoders/mlp_decoder_two_tower.py (120:152) duplicated block id: 12 size: 27 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (149:183) - pytext/metric_reporters/mask_seq2seq_topk.py (80:114) duplicated block id: 13 size: 26 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (357:394) - pytext/torchscript/batchutils.py (449:486) duplicated block id: 14 size: 26 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1229:1254) - pytext/torchscript/module.py (1286:1311) duplicated block id: 15 size: 24 cleaned lines of code in 2 files: - pytext/torchscript/module.py (686:716) - pytext/torchscript/module.py (1161:1191) duplicated block id: 16 size: 24 cleaned lines of code in 2 files: - pytext/models/representations/transformer/luna_attention.py (393:422) - pytext/models/representations/transformer/luna_attention.py (724:753) duplicated block id: 17 size: 23 cleaned lines of code in 2 files: - pytext/torchscript/module.py (71:100) - pytext/torchscript/module.py (1364:1392) duplicated block id: 18 size: 23 cleaned lines of code in 2 files: - pytext/models/doc_model.py (157:182) - pytext/models/word_model.py (159:184) duplicated block id: 19 size: 22 cleaned lines of code in 2 files: - pytext/models/representations/augmented_lstm.py (438:460) - pytext/models/representations/augmented_lstm.py (497:520) duplicated block id: 20 size: 22 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (1076:1100) - pytext/metrics/__init__.py (1242:1266) duplicated block id: 21 size: 21 cleaned lines of code in 2 files: - pytext/torchscript/module.py (688:715) - pytext/torchscript/module.py (1368:1395) duplicated block id: 22 size: 21 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (458:486) - pytext/torchscript/module.py (1517:1545) duplicated block id: 23 size: 21 cleaned lines of code in 2 files: - pytext/utils/mobile_onnx.py (19:40) - pytext/utils/onnx.py (21:42) duplicated block id: 24 size: 21 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (366:394) - pytext/torchscript/module.py (1517:1545) duplicated block id: 25 size: 21 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1163:1190) - pytext/torchscript/module.py (1368:1395) duplicated block id: 26 size: 21 cleaned lines of code in 2 files: - pytext/models/tri_tower_classification_model.py (95:117) - pytext/models/two_tower_classification_model.py (101:123) duplicated block id: 27 size: 20 cleaned lines of code in 2 files: - pytext/models/tri_tower_classification_model.py (159:181) - pytext/models/two_tower_classification_model.py (172:194) duplicated block id: 28 size: 19 cleaned lines of code in 2 files: - pytext/torchscript/module.py (76:100) - pytext/torchscript/module.py (688:712) duplicated block id: 29 size: 19 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (119:137) - pytext/metric_reporters/mask_compositional.py (341:359) duplicated block id: 30 size: 19 cleaned lines of code in 2 files: - pytext/models/representations/lightconv.py (31:53) - pytext/models/seq_models/nar_length.py (17:39) duplicated block id: 31 size: 19 cleaned lines of code in 2 files: - pytext/torchscript/module.py (76:100) - pytext/torchscript/module.py (1163:1187) duplicated block id: 32 size: 19 cleaned lines of code in 2 files: - pytext/models/representations/sparse_transformer_sentence_encoder.py (87:105) - pytext/models/representations/transformer_sentence_encoder.py (92:110) duplicated block id: 33 size: 18 cleaned lines of code in 2 files: - pytext/models/representations/huggingface_bert_sentence_encoder.py (61:79) - pytext/models/representations/huggingface_electra_sentence_encoder.py (52:70) duplicated block id: 34 size: 18 cleaned lines of code in 2 files: - pytext/models/qna/bert_squad_qa.py (117:134) - pytext/models/qna/dr_qa.py (186:203) duplicated block id: 35 size: 18 cleaned lines of code in 2 files: - pytext/torchscript/module.py (750:767) - pytext/torchscript/module.py (791:808) duplicated block id: 36 size: 18 cleaned lines of code in 2 files: - pytext/legacy/datasets/imdb.py (58:91) - pytext/legacy/datasets/trec.py (72:104) duplicated block id: 37 size: 18 cleaned lines of code in 2 files: - pytext/torchscript/module.py (750:767) - pytext/torchscript/module.py (849:866) duplicated block id: 38 size: 18 cleaned lines of code in 2 files: - pytext/models/representations/transformer/luna_attention.py (369:388) - pytext/models/representations/transformer/luna_attention.py (703:722) duplicated block id: 39 size: 17 cleaned lines of code in 2 files: - pytext/legacy/datasets/language_modeling.py (68:106) - pytext/legacy/datasets/language_modeling.py (143:181) duplicated block id: 40 size: 17 cleaned lines of code in 2 files: - pytext/torchscript/module.py (807:826) - pytext/torchscript/module.py (2082:2100) duplicated block id: 41 size: 17 cleaned lines of code in 2 files: - pytext/models/tri_tower_classification_model.py (217:237) - pytext/models/two_tower_classification_model.py (210:230) duplicated block id: 42 size: 17 cleaned lines of code in 2 files: - pytext/legacy/datasets/language_modeling.py (143:181) - pytext/legacy/datasets/language_modeling.py (223:259) duplicated block id: 43 size: 17 cleaned lines of code in 2 files: - pytext/legacy/datasets/language_modeling.py (68:106) - pytext/legacy/datasets/language_modeling.py (223:259) duplicated block id: 44 size: 17 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (752:768) - pytext/metrics/__init__.py (861:877) duplicated block id: 45 size: 16 cleaned lines of code in 2 files: - pytext/models/seq_models/conv_decoder.py (452:468) - pytext/models/seq_models/conv_decoder.py (508:524) duplicated block id: 46 size: 16 cleaned lines of code in 2 files: - pytext/models/seq_models/conv_decoder.py (411:431) - pytext/models/seq_models/conv_encoder.py (329:348) duplicated block id: 47 size: 16 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (835:855) - pytext/data/token_tensorizer.py (31:50) duplicated block id: 48 size: 16 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (240:256) - pytext/metric_reporters/mask_seq2seq_topk.py (168:183) duplicated block id: 49 size: 16 cleaned lines of code in 2 files: - pytext/legacy/datasets/translation.py (81:96) - pytext/legacy/datasets/translation.py (195:210) duplicated block id: 50 size: 16 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (162:180) - pytext/models/output_layers/doc_classification_output_layer.py (212:230) duplicated block id: 51 size: 16 cleaned lines of code in 2 files: - pytext/models/representations/lightconv.py (185:204) - pytext/models/seq_models/conv_decoder.py (411:431) duplicated block id: 52 size: 15 cleaned lines of code in 2 files: - pytext/torchscript/module.py (773:788) - pytext/torchscript/module.py (2051:2066) duplicated block id: 53 size: 15 cleaned lines of code in 2 files: - pytext/loss/regularized_loss.py (227:242) - pytext/loss/regularized_loss.py (304:319) duplicated block id: 54 size: 15 cleaned lines of code in 2 files: - pytext/torchscript/module.py (830:845) - pytext/torchscript/module.py (2051:2066) duplicated block id: 55 size: 15 cleaned lines of code in 2 files: - pytext/models/doc_model.py (353:368) - pytext/models/doc_model.py (394:409) duplicated block id: 56 size: 15 cleaned lines of code in 2 files: - pytext/trainers/trainer.py (235:250) - pytext/trainers/trainer.py (781:796) duplicated block id: 57 size: 15 cleaned lines of code in 2 files: - pytext/metrics/mask_metrics.py (147:161) - pytext/metrics/mask_metrics.py (220:234) duplicated block id: 58 size: 15 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (194:208) - pytext/metric_reporters/mask_compositional.py (376:390) duplicated block id: 59 size: 15 cleaned lines of code in 2 files: - pytext/torchscript/module.py (773:788) - pytext/torchscript/module.py (830:845) duplicated block id: 60 size: 15 cleaned lines of code in 2 files: - pytext/data/decoupled_data.py (33:55) - pytext/data/decoupled_data.py (79:101) duplicated block id: 61 size: 15 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1028:1046) - pytext/data/token_tensorizer.py (250:268) duplicated block id: 62 size: 15 cleaned lines of code in 2 files: - pytext/models/embeddings/int_single_category_embedding.py (59:73) - pytext/models/embeddings/int_weighted_multi_category_embedding.py (109:123) duplicated block id: 63 size: 15 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_seq2seq_topk.py (146:162) - pytext/metric_reporters/seq2seq_compositional.py (125:142) duplicated block id: 64 size: 15 cleaned lines of code in 2 files: - pytext/models/representations/transformer_sentence_encoder_base.py (134:152) - pytext/models/roberta.py (359:377) duplicated block id: 65 size: 14 cleaned lines of code in 2 files: - pytext/models/seq_models/rnn_decoder.py (76:89) - pytext/models/seq_models/rnn_decoder.py (398:411) duplicated block id: 66 size: 14 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1927:1945) - pytext/torchscript/module.py (2169:2187) duplicated block id: 67 size: 14 cleaned lines of code in 2 files: - pytext/metric_reporters/squad_metric_reporter.py (220:233) - pytext/metric_reporters/squad_metric_reporter.py (251:264) duplicated block id: 68 size: 14 cleaned lines of code in 2 files: - pytext/optimizer/fp16_optimizer.py (301:317) - pytext/optimizer/fp16_optimizer.py (401:417) duplicated block id: 69 size: 14 cleaned lines of code in 2 files: - pytext/models/seq_models/rnn_decoder.py (77:90) - pytext/models/seq_models/rnn_decoder.py (380:393) duplicated block id: 70 size: 14 cleaned lines of code in 2 files: - pytext/models/representations/transformer/luna_attention.py (68:87) - pytext/models/representations/transformer/luna_attention.py (465:484) duplicated block id: 71 size: 14 cleaned lines of code in 2 files: - pytext/models/roberta.py (434:448) - pytext/models/tri_tower_classification_model.py (101:115) duplicated block id: 72 size: 14 cleaned lines of code in 2 files: - pytext/loss/regularized_loss.py (205:225) - pytext/loss/regularized_loss.py (280:300) duplicated block id: 73 size: 14 cleaned lines of code in 2 files: - pytext/models/roberta.py (434:448) - pytext/models/two_tower_classification_model.py (107:121) duplicated block id: 74 size: 14 cleaned lines of code in 2 files: - pytext/torchscript/module.py (109:134) - pytext/torchscript/module.py (1407:1432) duplicated block id: 75 size: 13 cleaned lines of code in 2 files: - pytext/fields/text_field_with_special_unk.py (108:123) - pytext/legacy/data/field.py (369:384) duplicated block id: 76 size: 13 cleaned lines of code in 2 files: - pytext/models/representations/sparse_transformer_sentence_encoder.py (30:54) - pytext/models/representations/transformer_sentence_encoder.py (34:58) duplicated block id: 77 size: 13 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (993:1006) - pytext/data/token_tensorizer.py (216:229) duplicated block id: 78 size: 13 cleaned lines of code in 2 files: - pytext/metric_reporters/channel.py (38:50) - pytext/metric_reporters/channel.py (121:133) duplicated block id: 79 size: 13 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (396:409) - pytext/data/tensorizers.py (993:1006) duplicated block id: 80 size: 13 cleaned lines of code in 2 files: - pytext/metric_reporters/channel.py (89:101) - pytext/metric_reporters/channel.py (121:133) duplicated block id: 81 size: 13 cleaned lines of code in 2 files: - pytext/fields/field.py (169:181) - pytext/fields/field.py (224:236) duplicated block id: 82 size: 13 cleaned lines of code in 2 files: - pytext/metric_reporters/channel.py (38:50) - pytext/metric_reporters/channel.py (89:101) duplicated block id: 83 size: 13 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (978:990) - pytext/data/token_tensorizer.py (203:215) duplicated block id: 84 size: 13 cleaned lines of code in 2 files: - pytext/metric_reporters/channel.py (86:99) - pytext/metric_reporters/channel.py (190:203) duplicated block id: 85 size: 13 cleaned lines of code in 2 files: - pytext/torchscript/tensorizer/roberta.py (102:116) - pytext/torchscript/tensorizer/xlm.py (181:195) duplicated block id: 86 size: 13 cleaned lines of code in 2 files: - pytext/data/masked_util.py (180:195) - pytext/data/masked_util.py (213:228) duplicated block id: 87 size: 13 cleaned lines of code in 2 files: - pytext/models/seq_models/rnn_decoder.py (380:392) - pytext/models/seq_models/rnn_decoder.py (399:411) duplicated block id: 88 size: 13 cleaned lines of code in 2 files: - pytext/models/bert_classification_models.py (116:131) - pytext/models/tri_tower_classification_model.py (218:233) duplicated block id: 89 size: 13 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (468:482) - pytext/data/token_tensorizer.py (260:274) duplicated block id: 90 size: 13 cleaned lines of code in 2 files: - pytext/models/representations/bilstm_doc_attention.py (80:93) - pytext/models/representations/bilstm_slot_attn.py (59:72) duplicated block id: 91 size: 13 cleaned lines of code in 2 files: - pytext/data/dense_retrieval_tensorizer.py (118:130) - pytext/data/roberta_tensorizer.py (114:126) duplicated block id: 92 size: 13 cleaned lines of code in 2 files: - pytext/fields/char_field.py (41:54) - pytext/fields/dict_field.py (40:53) duplicated block id: 93 size: 13 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (383:395) - pytext/data/tensorizers.py (978:990) duplicated block id: 94 size: 13 cleaned lines of code in 2 files: - pytext/models/embeddings/int_single_category_embedding.py (78:92) - pytext/models/embeddings/int_weighted_multi_category_embedding.py (123:137) duplicated block id: 95 size: 13 cleaned lines of code in 2 files: - pytext/optimizer/fp16_optimizer.py (267:280) - pytext/optimizer/fp16_optimizer.py (361:374) duplicated block id: 96 size: 13 cleaned lines of code in 2 files: - pytext/torchscript/seq2seq/export_model.py (33:45) - pytext/torchscript/seq2seq/scripted_seq2seq_generator.py (20:32) duplicated block id: 97 size: 13 cleaned lines of code in 2 files: - pytext/models/bert_classification_models.py (116:131) - pytext/models/two_tower_classification_model.py (211:226) duplicated block id: 98 size: 12 cleaned lines of code in 2 files: - pytext/data/masked_tensorizer.py (31:43) - pytext/data/token_tensorizer.py (208:220) duplicated block id: 99 size: 12 cleaned lines of code in 2 files: - pytext/models/representations/huggingface_bert_sentence_encoder.py (82:93) - pytext/models/representations/huggingface_electra_sentence_encoder.py (73:84) duplicated block id: 100 size: 12 cleaned lines of code in 2 files: - pytext/optimizer/fp16_optimizer.py (282:293) - pytext/optimizer/fp16_optimizer.py (382:393) duplicated block id: 101 size: 12 cleaned lines of code in 2 files: - pytext/task/serialize.py (155:166) - pytext/task/serialize.py (253:264) duplicated block id: 102 size: 12 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (492:504) - pytext/data/token_tensorizer.py (276:288) duplicated block id: 103 size: 12 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (1109:1140) - pytext/metrics/__init__.py (1192:1223) duplicated block id: 104 size: 12 cleaned lines of code in 2 files: - pytext/data/masked_tensorizer.py (31:43) - pytext/data/tensorizers.py (388:400) duplicated block id: 105 size: 12 cleaned lines of code in 2 files: - pytext/torchscript/module.py (892:904) - pytext/torchscript/module.py (1830:1842) duplicated block id: 106 size: 12 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (913:929) - pytext/data/token_tensorizer.py (58:74) duplicated block id: 107 size: 12 cleaned lines of code in 2 files: - pytext/fields/field.py (195:206) - pytext/fields/field.py (244:255) duplicated block id: 108 size: 12 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (193:205) - pytext/models/output_layers/word_tagging_output_layer.py (171:183) duplicated block id: 109 size: 12 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (135:152) - pytext/torchscript/tensorizer/tensorizer.py (28:45) duplicated block id: 110 size: 12 cleaned lines of code in 2 files: - pytext/data/sources/squad.py (195:207) - pytext/data/sources/squad.py (293:305) duplicated block id: 111 size: 12 cleaned lines of code in 2 files: - pytext/models/doc_model.py (150:162) - pytext/models/doc_model.py (193:205) duplicated block id: 112 size: 12 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1026:1037) - pytext/torchscript/module.py (1062:1073) duplicated block id: 113 size: 12 cleaned lines of code in 2 files: - pytext/torchscript/module.py (616:628) - pytext/torchscript/module.py (1753:1765) duplicated block id: 114 size: 12 cleaned lines of code in 2 files: - pytext/fields/text_field_with_special_unk.py (48:59) - pytext/legacy/data/field.py (319:330) duplicated block id: 115 size: 12 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (348:364) - pytext/torchscript/module.py (1500:1515) duplicated block id: 116 size: 12 cleaned lines of code in 2 files: - pytext/trainers/trainer.py (654:666) - pytext/trainers/trainer.py (719:738) duplicated block id: 117 size: 11 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1532:1545) - pytext/torchscript/module.py (1945:1958) duplicated block id: 118 size: 11 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1869:1879) - pytext/torchscript/module.py (2026:2037) duplicated block id: 119 size: 11 cleaned lines of code in 2 files: - pytext/fields/text_field_with_special_unk.py (126:139) - pytext/legacy/data/field.py (386:399) duplicated block id: 120 size: 11 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1310:1324) - pytext/data/tensorizers.py (1376:1390) duplicated block id: 121 size: 11 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (416:427) - pytext/data/roberta_tensorizer.py (73:84) duplicated block id: 122 size: 11 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (410:420) - pytext/data/tensorizers.py (1009:1019) duplicated block id: 123 size: 11 cleaned lines of code in 2 files: - pytext/models/roberta.py (196:206) - pytext/models/roberta.py (208:218) duplicated block id: 124 size: 11 cleaned lines of code in 2 files: - pytext/models/doc_model.py (163:175) - pytext/models/doc_model.py (207:219) duplicated block id: 125 size: 11 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (93:104) - pytext/metric_reporters/mask_seq2seq_topk.py (31:42) duplicated block id: 126 size: 11 cleaned lines of code in 2 files: - pytext/models/embeddings/word_embedding.py (67:79) - pytext/models/embeddings/word_seq_embedding.py (66:78) duplicated block id: 127 size: 11 cleaned lines of code in 2 files: - pytext/fields/text_field_with_special_unk.py (92:103) - pytext/legacy/data/field.py (353:364) duplicated block id: 128 size: 11 cleaned lines of code in 2 files: - pytext/torchscript/module.py (442:455) - pytext/torchscript/module.py (1070:1083) duplicated block id: 129 size: 11 cleaned lines of code in 2 files: - pytext/torchscript/module.py (571:582) - pytext/torchscript/module.py (1715:1726) duplicated block id: 130 size: 11 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1294:1306) - pytext/data/tensorizers.py (1355:1367) duplicated block id: 131 size: 11 cleaned lines of code in 2 files: - pytext/fields/text_field_with_special_unk.py (34:45) - pytext/legacy/data/field.py (308:318) duplicated block id: 132 size: 11 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (182:192) - pytext/torchscript/tensorizer/bert.py (103:114) duplicated block id: 133 size: 11 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1009:1019) - pytext/data/token_tensorizer.py (230:240) duplicated block id: 134 size: 11 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (23:37) - pytext/data/squad_for_bert_tensorizer.py (290:304) duplicated block id: 135 size: 11 cleaned lines of code in 2 files: - pytext/metric_reporters/channel.py (38:48) - pytext/metric_reporters/channel.py (193:203) duplicated block id: 136 size: 11 cleaned lines of code in 2 files: - pytext/metric_reporters/multi_span_qa_metric_reporter.py (293:307) - pytext/metric_reporters/squad_metric_reporter.py (424:438) duplicated block id: 137 size: 11 cleaned lines of code in 2 files: - pytext/models/doc_model.py (207:219) - pytext/models/word_model.py (165:177) duplicated block id: 138 size: 11 cleaned lines of code in 2 files: - pytext/optimizer/adabelief.py (121:135) - pytext/optimizer/adabelief.py (166:179) duplicated block id: 139 size: 11 cleaned lines of code in 2 files: - pytext/models/representations/transformer/luna_attention.py (353:364) - pytext/models/representations/transformer/luna_attention.py (691:702) duplicated block id: 140 size: 11 cleaned lines of code in 2 files: - pytext/data/sources/squad.py (223:233) - pytext/data/sources/squad.py (324:334) duplicated block id: 141 size: 11 cleaned lines of code in 2 files: - pytext/optimizer/adabelief.py (137:154) - pytext/optimizer/lamb.py (64:81) duplicated block id: 142 size: 11 cleaned lines of code in 2 files: - pytext/metric_reporters/channel.py (121:131) - pytext/metric_reporters/channel.py (193:203) duplicated block id: 143 size: 11 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (381:394) - pytext/torchscript/module.py (1945:1958) duplicated block id: 144 size: 11 cleaned lines of code in 2 files: - pytext/data/data.py (268:278) - pytext/data/decoupled_data.py (144:154) duplicated block id: 145 size: 11 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (473:486) - pytext/torchscript/module.py (1945:1958) duplicated block id: 146 size: 11 cleaned lines of code in 2 files: - pytext/torchscript/module.py (423:438) - pytext/torchscript/module.py (1049:1064) duplicated block id: 147 size: 10 cleaned lines of code in 2 files: - pytext/fields/field.py (106:116) - pytext/fields/field.py (169:178) duplicated block id: 148 size: 10 cleaned lines of code in 2 files: - pytext/models/bert_classification_models.py (118:129) - pytext/models/doc_model.py (258:268) duplicated block id: 149 size: 10 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (297:306) - pytext/metrics/__init__.py (323:332) duplicated block id: 150 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (382:394) - pytext/torchscript/module.py (443:455) duplicated block id: 151 size: 10 cleaned lines of code in 2 files: - pytext/data/masked_tensorizer.py (45:54) - pytext/data/token_tensorizer.py (221:230) duplicated block id: 152 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (408:417) - pytext/torchscript/module.py (436:445) duplicated block id: 153 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1049:1063) - pytext/torchscript/module.py (1929:1943) duplicated block id: 154 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1071:1083) - pytext/torchscript/module.py (1533:1545) duplicated block id: 155 size: 10 cleaned lines of code in 2 files: - pytext/metrics/intent_slot_metrics.py (175:184) - pytext/metrics/mask_metrics.py (55:64) duplicated block id: 156 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (382:394) - pytext/torchscript/module.py (2190:2202) duplicated block id: 157 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (423:437) - pytext/torchscript/module.py (1929:1943) duplicated block id: 158 size: 10 cleaned lines of code in 2 files: - pytext/models/doc_model.py (258:268) - pytext/models/tri_tower_classification_model.py (220:231) duplicated block id: 159 size: 10 cleaned lines of code in 2 files: - pytext/legacy/datasets/language_modeling.py (42:51) - pytext/legacy/datasets/language_modeling.py (117:126) duplicated block id: 160 size: 10 cleaned lines of code in 2 files: - pytext/fields/field.py (106:116) - pytext/fields/field.py (224:233) duplicated block id: 161 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (474:486) - pytext/torchscript/module.py (1071:1083) duplicated block id: 162 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (443:455) - pytext/torchscript/module.py (1946:1958) duplicated block id: 163 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (474:486) - pytext/torchscript/module.py (2190:2202) duplicated block id: 164 size: 10 cleaned lines of code in 2 files: - pytext/models/doc_model.py (182:192) - pytext/models/doc_model.py (383:393) duplicated block id: 165 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1071:1083) - pytext/torchscript/module.py (1946:1958) duplicated block id: 166 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1533:1545) - pytext/torchscript/module.py (2190:2202) duplicated block id: 167 size: 10 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (507:517) - pytext/data/token_tensorizer.py (289:299) duplicated block id: 168 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (920:929) - pytext/torchscript/module.py (1137:1146) duplicated block id: 169 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (865:875) - pytext/torchscript/module.py (2082:2092) duplicated block id: 170 size: 10 cleaned lines of code in 2 files: - pytext/data/sources/tsv.py (153:162) - pytext/data/sources/tsv.py (314:323) duplicated block id: 171 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (443:455) - pytext/torchscript/module.py (1533:1545) duplicated block id: 172 size: 10 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1199:1208) - pytext/data/tensorizers.py (1359:1368) duplicated block id: 173 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1946:1958) - pytext/torchscript/module.py (2190:2202) duplicated block id: 174 size: 10 cleaned lines of code in 2 files: - pytext/data/roberta_tensorizer.py (53:62) - pytext/data/roberta_tensorizer.py (111:120) duplicated block id: 175 size: 10 cleaned lines of code in 2 files: - pytext/data/masked_tensorizer.py (45:54) - pytext/data/tensorizers.py (401:410) duplicated block id: 176 size: 10 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1928:1940) - pytext/fields/dict_field.py (75:87) duplicated block id: 177 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1013:1022) - pytext/torchscript/module.py (1063:1072) duplicated block id: 178 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (238:249) - pytext/torchscript/batchutils.py (259:270) duplicated block id: 179 size: 10 cleaned lines of code in 2 files: - pytext/metric_reporters/squad_metric_reporter.py (334:343) - pytext/metric_reporters/squad_metric_reporter.py (362:371) duplicated block id: 180 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1013:1022) - pytext/torchscript/module.py (1027:1036) duplicated block id: 181 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (423:437) - pytext/torchscript/module.py (2171:2185) duplicated block id: 182 size: 10 cleaned lines of code in 2 files: - pytext/models/doc_model.py (258:268) - pytext/models/two_tower_classification_model.py (213:224) duplicated block id: 183 size: 10 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1111:1121) - pytext/data/token_tensorizer.py (315:325) duplicated block id: 184 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (443:455) - pytext/torchscript/module.py (2190:2202) duplicated block id: 185 size: 10 cleaned lines of code in 2 files: - pytext/task/new_task.py (136:145) - pytext/task/tasks.py (206:215) duplicated block id: 186 size: 10 cleaned lines of code in 2 files: - pytext/metric_reporters/multi_span_qa_metric_reporter.py (198:207) - pytext/metric_reporters/squad_metric_reporter.py (394:403) duplicated block id: 187 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (474:486) - pytext/torchscript/module.py (443:455) duplicated block id: 188 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1071:1083) - pytext/torchscript/module.py (2190:2202) duplicated block id: 189 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (382:394) - pytext/torchscript/module.py (1071:1083) duplicated block id: 190 size: 10 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (113:123) - pytext/metric_reporters/mask_seq2seq_topk.py (50:60) duplicated block id: 191 size: 10 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1049:1063) - pytext/torchscript/module.py (2171:2185) duplicated block id: 192 size: 10 cleaned lines of code in 2 files: - pytext/metric_reporters/multi_span_qa_metric_reporter.py (85:94) - pytext/metric_reporters/multi_span_qa_metric_reporter.py (158:167) duplicated block id: 193 size: 10 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (509:519) - pytext/data/tensorizers.py (1084:1094) duplicated block id: 194 size: 10 cleaned lines of code in 2 files: - pytext/utils/mobile_onnx.py (98:107) - pytext/utils/onnx.py (103:114) duplicated block id: 195 size: 9 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (811:819) - pytext/metrics/__init__.py (869:877) duplicated block id: 196 size: 9 cleaned lines of code in 2 files: - pytext/models/doc_model.py (143:151) - pytext/models/word_model.py (145:153) duplicated block id: 197 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (528:538) - pytext/torchscript/module.py (626:636) duplicated block id: 198 size: 9 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (964:974) - pytext/data/token_tensorizer.py (191:201) duplicated block id: 199 size: 9 cleaned lines of code in 2 files: - pytext/models/tri_tower_classification_model.py (188:197) - pytext/models/two_tower_classification_model.py (194:203) duplicated block id: 200 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (480:490) - pytext/torchscript/module.py (1552:1561) duplicated block id: 201 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (852:860) - pytext/torchscript/module.py (1291:1299) duplicated block id: 202 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (518:526) - pytext/torchscript/module.py (1599:1607) duplicated block id: 203 size: 9 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (760:768) - pytext/metrics/__init__.py (811:819) duplicated block id: 204 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1908:1918) - pytext/torchscript/module.py (2138:2148) duplicated block id: 205 size: 9 cleaned lines of code in 2 files: - pytext/models/representations/transformer/luna_attention.py (334:344) - pytext/models/representations/transformer/luna_attention.py (672:682) duplicated block id: 206 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (753:761) - pytext/torchscript/module.py (1234:1242) duplicated block id: 207 size: 9 cleaned lines of code in 2 files: - pytext/optimizer/adabelief.py (83:91) - pytext/optimizer/lamb.py (47:55) duplicated block id: 208 size: 9 cleaned lines of code in 2 files: - pytext/models/embeddings/int_single_category_embedding.py (102:111) - pytext/models/embeddings/int_weighted_multi_category_embedding.py (161:170) duplicated block id: 209 size: 9 cleaned lines of code in 2 files: - pytext/data/sources/conllu.py (52:61) - pytext/data/sources/tsv.py (123:132) duplicated block id: 210 size: 9 cleaned lines of code in 2 files: - pytext/metrics/intent_slot_metrics.py (552:560) - pytext/metrics/mask_metrics.py (151:159) duplicated block id: 211 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (494:504) - pytext/torchscript/module.py (586:596) duplicated block id: 212 size: 9 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (371:381) - pytext/data/tensorizers.py (964:974) duplicated block id: 213 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (794:802) - pytext/torchscript/module.py (1234:1242) duplicated block id: 214 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (852:860) - pytext/torchscript/module.py (1234:1242) duplicated block id: 215 size: 9 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (750:758) - pytext/metrics/__init__.py (799:807) duplicated block id: 216 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (534:543) - pytext/torchscript/module.py (1611:1620) duplicated block id: 217 size: 9 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (725:748) - pytext/metrics/__init__.py (773:797) duplicated block id: 218 size: 9 cleaned lines of code in 2 files: - pytext/models/doc_model.py (363:371) - pytext/models/word_model.py (251:259) duplicated block id: 219 size: 9 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (62:70) - pytext/models/output_layers/lm_output_layer.py (31:39) duplicated block id: 220 size: 9 cleaned lines of code in 2 files: - pytext/models/representations/transformer/multihead_linear_attention.py (27:35) - pytext/models/representations/transformer/multihead_linear_attention.py (179:187) duplicated block id: 221 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (794:802) - pytext/torchscript/module.py (1291:1299) duplicated block id: 222 size: 9 cleaned lines of code in 2 files: - pytext/metric_reporters/classification_metric_reporter.py (169:180) - pytext/metric_reporters/metric_reporter.py (104:114) duplicated block id: 223 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (402:410) - pytext/torchscript/module.py (1020:1028) duplicated block id: 224 size: 9 cleaned lines of code in 2 files: - pytext/data/masked_tensorizer.py (45:53) - pytext/data/tensorizers.py (998:1006) duplicated block id: 225 size: 9 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1199:1207) - pytext/data/tensorizers.py (1298:1306) duplicated block id: 226 size: 9 cleaned lines of code in 2 files: - pytext/data/squad_tensorizer.py (175:184) - pytext/data/squad_tensorizer.py (267:276) duplicated block id: 227 size: 9 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (240:249) - pytext/data/xlm_tensorizer.py (88:97) duplicated block id: 228 size: 9 cleaned lines of code in 2 files: - pytext/models/doc_model.py (112:120) - pytext/models/joint_model.py (171:179) duplicated block id: 229 size: 9 cleaned lines of code in 2 files: - pytext/models/representations/sparse_transformer_sentence_encoder.py (70:78) - pytext/models/representations/transformer_sentence_encoder.py (74:82) duplicated block id: 230 size: 9 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1084:1092) - pytext/data/token_tensorizer.py (291:299) duplicated block id: 231 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (172:182) - pytext/torchscript/module.py (541:551) duplicated block id: 232 size: 9 cleaned lines of code in 2 files: - pytext/metrics/intent_slot_metrics.py (552:560) - pytext/metrics/mask_metrics.py (224:232) duplicated block id: 233 size: 9 cleaned lines of code in 2 files: - pytext/optimizer/fp16_optimizer.py (236:253) - pytext/optimizer/fp16_optimizer.py (325:342) duplicated block id: 234 size: 9 cleaned lines of code in 2 files: - pytext/loss/regularized_loss.py (256:264) - pytext/loss/regularized_loss.py (337:345) duplicated block id: 235 size: 9 cleaned lines of code in 2 files: - pytext/metric_reporters/seq2seq_compositional.py (190:198) - pytext/metric_reporters/seq2seq_metric_reporter.py (168:176) duplicated block id: 236 size: 9 cleaned lines of code in 2 files: - pytext/metric_reporters/squad_metric_reporter.py (124:132) - pytext/metric_reporters/squad_metric_reporter.py (288:296) duplicated block id: 237 size: 9 cleaned lines of code in 2 files: - pytext/data/roberta_tensorizer.py (223:231) - pytext/data/squad_for_bert_tensorizer.py (334:342) duplicated block id: 238 size: 9 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1054:1063) - pytext/data/token_tensorizer.py (273:282) duplicated block id: 239 size: 9 cleaned lines of code in 2 files: - pytext/models/embeddings/word_embedding.py (127:138) - pytext/models/embeddings/word_seq_embedding.py (124:135) duplicated block id: 240 size: 9 cleaned lines of code in 2 files: - pytext/models/doc_model.py (199:207) - pytext/models/doc_model.py (403:411) duplicated block id: 241 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (2156:2164) - pytext/torchscript/module.py (2184:2192) duplicated block id: 242 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1146:1156) - pytext/torchscript/module.py (2037:2047) duplicated block id: 243 size: 9 cleaned lines of code in 2 files: - pytext/torchscript/module.py (753:761) - pytext/torchscript/module.py (1291:1299) duplicated block id: 244 size: 8 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (587:596) - pytext/data/tensorizers.py (688:697) duplicated block id: 245 size: 8 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (249:257) - pytext/data/squad_tensorizer.py (275:282) duplicated block id: 246 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/word_tagging_output_layer.py (171:178) - pytext/models/output_layers/word_tagging_output_layer.py (275:282) duplicated block id: 247 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1481:1488) - pytext/torchscript/module.py (1803:1810) duplicated block id: 248 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (218:225) - pytext/models/output_layers/word_tagging_output_layer.py (275:282) duplicated block id: 249 size: 8 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (825:832) - pytext/data/token_tensorizer.py (23:30) duplicated block id: 250 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_regression_output_layer.py (37:45) - pytext/models/output_layers/output_layer_base.py (41:49) duplicated block id: 251 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (397:404) - pytext/torchscript/module.py (409:416) duplicated block id: 252 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1493:1502) - pytext/torchscript/module.py (2138:2147) duplicated block id: 253 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (936:943) - pytext/torchscript/module.py (1013:1020) duplicated block id: 254 size: 8 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1085:1092) - pytext/data/tensorizers.py (2495:2502) duplicated block id: 255 size: 8 cleaned lines of code in 2 files: - pytext/metrics/intent_slot_metrics.py (164:171) - pytext/metrics/mask_metrics.py (30:37) duplicated block id: 256 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (936:943) - pytext/torchscript/module.py (1027:1034) duplicated block id: 257 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (168:175) - pytext/models/output_layers/word_tagging_output_layer.py (275:282) duplicated block id: 258 size: 8 cleaned lines of code in 2 files: - pytext/models/doc_model.py (404:411) - pytext/torchscript/module.py (193:202) duplicated block id: 259 size: 8 cleaned lines of code in 2 files: - pytext/models/model.py (157:170) - pytext/models/seq_models/nar_seq2seq_model.py (182:192) duplicated block id: 260 size: 8 cleaned lines of code in 2 files: - pytext/legacy/datasets/translation.py (119:144) - pytext/legacy/datasets/translation.py (269:297) duplicated block id: 261 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (218:225) - pytext/models/output_layers/word_tagging_output_layer.py (171:178) duplicated block id: 262 size: 8 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (428:436) - pytext/data/squad_tensorizer.py (275:282) duplicated block id: 263 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (747:754) - pytext/torchscript/module.py (911:918) duplicated block id: 264 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (439:446) - pytext/torchscript/module.py (1698:1705) duplicated block id: 265 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1691:1700) - pytext/torchscript/module.py (1908:1917) duplicated block id: 266 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (494:503) - pytext/torchscript/module.py (663:672) duplicated block id: 267 size: 8 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1942:1950) - pytext/fields/dict_field.py (89:97) duplicated block id: 268 size: 8 cleaned lines of code in 2 files: - pytext/models/doc_model.py (156:163) - pytext/models/doc_model.py (362:369) duplicated block id: 269 size: 8 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (1160:1167) - pytext/metrics/__init__.py (1242:1249) duplicated block id: 270 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (494:503) - pytext/torchscript/module.py (541:550) duplicated block id: 271 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (194:204) - pytext/torchscript/module.py (496:505) duplicated block id: 272 size: 8 cleaned lines of code in 2 files: - pytext/models/doc_model.py (200:207) - pytext/torchscript/module.py (193:202) duplicated block id: 273 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (168:175) - pytext/models/output_layers/output_layer_base.py (88:95) duplicated block id: 274 size: 8 cleaned lines of code in 2 files: - pytext/models/decoders/mlp_decoder_tri_tower.py (50:57) - pytext/models/decoders/mlp_decoder_two_tower.py (52:59) duplicated block id: 275 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (397:404) - pytext/torchscript/module.py (437:444) duplicated block id: 276 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (172:181) - pytext/torchscript/module.py (494:503) duplicated block id: 277 size: 8 cleaned lines of code in 2 files: - pytext/data/dense_retrieval_tensorizer.py (59:66) - pytext/data/dense_retrieval_tensorizer.py (76:83) duplicated block id: 278 size: 8 cleaned lines of code in 2 files: - pytext/models/representations/lightconv.py (151:161) - pytext/models/seq_models/conv_encoder.py (289:299) duplicated block id: 279 size: 8 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (1181:1188) - pytext/metrics/__init__.py (1264:1271) duplicated block id: 280 size: 8 cleaned lines of code in 2 files: - pytext/data/masked_tensorizer.py (31:38) - pytext/data/tensorizers.py (983:990) duplicated block id: 281 size: 8 cleaned lines of code in 2 files: - pytext/models/doc_model.py (142:149) - pytext/models/doc_model.py (345:352) duplicated block id: 282 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (586:595) - pytext/torchscript/module.py (663:672) duplicated block id: 283 size: 8 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (2495:2502) - pytext/data/token_tensorizer.py (292:299) duplicated block id: 284 size: 8 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (1076:1083) - pytext/metrics/__init__.py (1160:1167) duplicated block id: 285 size: 8 cleaned lines of code in 2 files: - pytext/models/embeddings/mlp_embedding.py (79:86) - pytext/models/embeddings/word_embedding.py (141:148) duplicated block id: 286 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1493:1502) - pytext/torchscript/module.py (1908:1917) duplicated block id: 287 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (168:175) - pytext/models/output_layers/word_tagging_output_layer.py (171:178) duplicated block id: 288 size: 8 cleaned lines of code in 2 files: - pytext/optimizer/lamb.py (64:78) - pytext/optimizer/radam.py (33:42) duplicated block id: 289 size: 8 cleaned lines of code in 2 files: - pytext/models/embeddings/word_embedding.py (81:88) - pytext/models/embeddings/word_seq_embedding.py (80:87) duplicated block id: 290 size: 8 cleaned lines of code in 2 files: - pytext/models/representations/traced_transformer_encoder.py (22:30) - pytext/models/representations/traced_transformer_encoder.py (78:86) duplicated block id: 291 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (168:175) - pytext/models/output_layers/doc_classification_output_layer.py (193:200) duplicated block id: 292 size: 8 cleaned lines of code in 2 files: - pytext/models/doc_model.py (218:226) - pytext/models/doc_model.py (412:420) duplicated block id: 293 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (714:727) - pytext/torchscript/module.py (1842:1855) duplicated block id: 294 size: 8 cleaned lines of code in 2 files: - pytext/optimizer/adabelief.py (137:151) - pytext/optimizer/radam.py (33:42) duplicated block id: 295 size: 8 cleaned lines of code in 2 files: - pytext/data/dense_retrieval_tensorizer.py (123:130) - pytext/data/xlm_tensorizer.py (153:160) duplicated block id: 296 size: 8 cleaned lines of code in 2 files: - pytext/models/word_model.py (158:165) - pytext/models/word_model.py (250:257) duplicated block id: 297 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (172:181) - pytext/torchscript/module.py (663:672) duplicated block id: 298 size: 8 cleaned lines of code in 2 files: - pytext/models/decoders/mlp_decoder_tri_tower.py (68:75) - pytext/models/decoders/mlp_decoder_two_tower.py (61:68) duplicated block id: 299 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1691:1700) - pytext/torchscript/module.py (2138:2147) duplicated block id: 300 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/output_layer_base.py (88:95) - pytext/models/output_layers/word_tagging_output_layer.py (171:178) duplicated block id: 301 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (172:181) - pytext/torchscript/module.py (586:595) duplicated block id: 302 size: 8 cleaned lines of code in 2 files: - pytext/data/data.py (153:161) - pytext/data/dynamic_pooling_batcher.py (52:60) duplicated block id: 303 size: 8 cleaned lines of code in 2 files: - pytext/builtin_task.py (16:23) - pytext/builtin_task.py (70:77) duplicated block id: 304 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (193:200) - pytext/models/output_layers/output_layer_base.py (88:95) duplicated block id: 305 size: 8 cleaned lines of code in 2 files: - pytext/data/roberta_tensorizer.py (119:126) - pytext/data/xlm_tensorizer.py (153:160) duplicated block id: 306 size: 8 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (100:107) - pytext/metric_reporters/mask_compositional.py (316:323) duplicated block id: 307 size: 8 cleaned lines of code in 2 files: - pytext/builtin_task.py (24:31) - pytext/builtin_task.py (79:86) duplicated block id: 308 size: 8 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (136:144) - pytext/metric_reporters/mask_seq2seq_topk.py (67:75) duplicated block id: 309 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (904:913) - pytext/torchscript/module.py (1857:1866) duplicated block id: 310 size: 8 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (245:253) - pytext/metric_reporters/seq2seq_compositional.py (155:163) duplicated block id: 311 size: 8 cleaned lines of code in 2 files: - pytext/data/data.py (145:152) - pytext/data/dynamic_pooling_batcher.py (43:50) duplicated block id: 312 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (193:200) - pytext/models/output_layers/word_tagging_output_layer.py (275:282) duplicated block id: 313 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (193:200) - pytext/models/output_layers/doc_classification_output_layer.py (218:225) duplicated block id: 314 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (911:918) - pytext/torchscript/module.py (1123:1130) duplicated block id: 315 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/output_layer_base.py (88:95) - pytext/models/output_layers/word_tagging_output_layer.py (275:282) duplicated block id: 316 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (541:550) - pytext/torchscript/module.py (586:595) duplicated block id: 317 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (747:754) - pytext/torchscript/module.py (1123:1130) duplicated block id: 318 size: 8 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (510:517) - pytext/data/tensorizers.py (2495:2502) duplicated block id: 319 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (936:943) - pytext/torchscript/module.py (1063:1070) duplicated block id: 320 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (655:663) - pytext/torchscript/module.py (1786:1794) duplicated block id: 321 size: 8 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_seq2seq_topk.py (173:180) - pytext/metric_reporters/seq2seq_compositional.py (155:163) duplicated block id: 322 size: 8 cleaned lines of code in 2 files: - pytext/optimizer/fp16_optimizer.py (255:262) - pytext/optimizer/fp16_optimizer.py (344:351) duplicated block id: 323 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1493:1502) - pytext/torchscript/module.py (1691:1700) duplicated block id: 324 size: 8 cleaned lines of code in 2 files: - pytext/torchscript/module.py (541:550) - pytext/torchscript/module.py (663:672) duplicated block id: 325 size: 8 cleaned lines of code in 2 files: - pytext/models/output_layers/doc_classification_output_layer.py (218:225) - pytext/models/output_layers/output_layer_base.py (88:95) duplicated block id: 326 size: 8 cleaned lines of code in 2 files: - pytext/models/embeddings/word_embedding.py (161:169) - pytext/models/embeddings/word_seq_embedding.py (180:188) duplicated block id: 327 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1525:1532) - pytext/torchscript/module.py (1937:1944) duplicated block id: 328 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (185:191) - pytext/models/doc_model.py (346:352) duplicated block id: 329 size: 7 cleaned lines of code in 2 files: - pytext/models/representations/traced_transformer_encoder.py (81:87) - pytext/models/representations/traced_transformer_encoder.py (113:119) duplicated block id: 330 size: 7 cleaned lines of code in 2 files: - pytext/models/representations/augmented_lstm.py (488:494) - pytext/models/representations/augmented_lstm.py (528:534) duplicated block id: 331 size: 7 cleaned lines of code in 2 files: - pytext/workflow.py (102:108) - pytext/workflow.py (123:129) duplicated block id: 332 size: 7 cleaned lines of code in 2 files: - pytext/models/bert_classification_models.py (94:101) - pytext/models/two_tower_classification_model.py (172:179) duplicated block id: 333 size: 7 cleaned lines of code in 2 files: - pytext/data/data_structures/node.py (32:38) - pytext/metrics/intent_slot_metrics.py (50:56) duplicated block id: 334 size: 7 cleaned lines of code in 2 files: - pytext/loss/regularizer.py (59:66) - pytext/loss/regularizer.py (141:148) duplicated block id: 335 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (194:202) - pytext/torchscript/module.py (588:596) duplicated block id: 336 size: 7 cleaned lines of code in 2 files: - pytext/models/bert_classification_models.py (30:41) - pytext/models/qna/bert_squad_qa.py (11:27) duplicated block id: 337 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (386:392) - pytext/models/word_model.py (145:151) duplicated block id: 338 size: 7 cleaned lines of code in 2 files: - pytext/models/seq_models/conv_decoder.py (222:228) - pytext/models/seq_models/conv_encoder.py (157:164) duplicated block id: 339 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (143:149) - pytext/models/doc_model.py (185:191) duplicated block id: 340 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1442:1449) - pytext/torchscript/module.py (1796:1803) duplicated block id: 341 size: 7 cleaned lines of code in 2 files: - pytext/data/sources/tsv.py (144:150) - pytext/data/sources/tsv.py (155:161) duplicated block id: 342 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (156:162) - pytext/models/doc_model.py (403:409) duplicated block id: 343 size: 7 cleaned lines of code in 2 files: - pytext/main.py (350:356) - pytext/main.py (583:589) duplicated block id: 344 size: 7 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (262:268) - pytext/data/squad_tensorizer.py (287:293) duplicated block id: 345 size: 7 cleaned lines of code in 2 files: - pytext/task/disjoint_multitask.py (46:53) - pytext/task/disjoint_multitask.py (183:190) duplicated block id: 346 size: 7 cleaned lines of code in 2 files: - pytext/models/representations/bilstm_doc_slot_attention.py (119:126) - pytext/models/representations/bilstm_slot_attn.py (66:73) duplicated block id: 347 size: 7 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1209:1216) - pytext/data/tensorizers.py (1532:1539) duplicated block id: 348 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (734:740) - pytext/torchscript/module.py (1962:1968) duplicated block id: 349 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (466:473) - pytext/torchscript/module.py (2179:2186) duplicated block id: 350 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1211:1217) - pytext/torchscript/module.py (1262:1268) duplicated block id: 351 size: 7 cleaned lines of code in 2 files: - pytext/models/tri_tower_classification_model.py (125:134) - pytext/models/two_tower_classification_model.py (138:147) duplicated block id: 352 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (201:207) - pytext/torchscript/module.py (588:596) duplicated block id: 353 size: 7 cleaned lines of code in 2 files: - pytext/legacy/datasets/translation.py (110:116) - pytext/legacy/datasets/translation.py (158:164) duplicated block id: 354 size: 7 cleaned lines of code in 2 files: - pytext/models/embeddings/int_single_category_embedding.py (44:51) - pytext/models/embeddings/int_weighted_multi_category_embedding.py (58:65) duplicated block id: 355 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (405:411) - pytext/torchscript/module.py (496:504) duplicated block id: 356 size: 7 cleaned lines of code in 2 files: - pytext/models/representations/bilstm.py (110:122) - pytext/models/representations/ordered_neuron_lstm.py (136:145) duplicated block id: 357 size: 7 cleaned lines of code in 2 files: - pytext/models/word_model.py (158:164) - pytext/torchscript/module.py (192:199) duplicated block id: 358 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (201:207) - pytext/torchscript/module.py (496:504) duplicated block id: 359 size: 7 cleaned lines of code in 2 files: - pytext/models/two_tower_classification_model.py (79:85) - pytext/models/two_tower_classification_model.py (88:94) duplicated block id: 360 size: 7 cleaned lines of code in 2 files: - pytext/fields/char_field.py (45:51) - pytext/legacy/data/field.py (308:314) duplicated block id: 361 size: 7 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1359:1365) - pytext/data/tensorizers.py (1520:1526) duplicated block id: 362 size: 7 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (1085:1092) - pytext/metrics/__init__.py (1170:1177) duplicated block id: 363 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (374:381) - pytext/torchscript/module.py (1937:1944) duplicated block id: 364 size: 7 cleaned lines of code in 2 files: - pytext/data/sources/tsv.py (144:150) - pytext/data/sources/tsv.py (316:322) duplicated block id: 365 size: 7 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (62:97) - pytext/data/xlm_tensorizer.py (37:44) duplicated block id: 366 size: 7 cleaned lines of code in 2 files: - pytext/optimizer/fp16_optimizer.py (166:172) - pytext/optimizer/fp16_optimizer.py (382:388) duplicated block id: 367 size: 7 cleaned lines of code in 2 files: - pytext/data/sources/tsv.py (131:137) - pytext/data/sources/tsv.py (203:209) duplicated block id: 368 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/seq2seq/export_model.py (25:31) - pytext/torchscript/seq2seq/scripted_seq2seq_generator.py (12:18) duplicated block id: 369 size: 7 cleaned lines of code in 2 files: - pytext/models/qna/bert_squad_qa.py (114:120) - pytext/models/qna/dr_qa.py (181:187) duplicated block id: 370 size: 7 cleaned lines of code in 2 files: - pytext/loss/regularizer.py (38:45) - pytext/loss/regularizer.py (141:148) duplicated block id: 371 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (403:409) - pytext/torchscript/module.py (2151:2157) duplicated block id: 372 size: 7 cleaned lines of code in 2 files: - pytext/main.py (628:634) - pytext/main.py (650:656) duplicated block id: 373 size: 7 cleaned lines of code in 2 files: - pytext/data/sources/data_source.py (366:374) - pytext/data/sources/data_source.py (385:393) duplicated block id: 374 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/utils.py (88:96) - pytext/torchscript/utils.py (111:119) duplicated block id: 375 size: 7 cleaned lines of code in 2 files: - pytext/data/decoupled_data.py (57:66) - pytext/data/decoupled_data.py (103:112) duplicated block id: 376 size: 7 cleaned lines of code in 2 files: - pytext/models/embeddings/int_single_category_embedding.py (22:43) - pytext/models/embeddings/int_weighted_multi_category_embedding.py (31:53) duplicated block id: 377 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (346:352) - pytext/models/word_model.py (145:151) duplicated block id: 378 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (185:191) - pytext/models/word_model.py (145:151) duplicated block id: 379 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (157:163) - pytext/models/word_model.py (251:257) duplicated block id: 380 size: 7 cleaned lines of code in 2 files: - pytext/models/bert_classification_models.py (140:146) - pytext/models/roberta.py (521:527) duplicated block id: 381 size: 7 cleaned lines of code in 2 files: - pytext/task/disjoint_multitask.py (9:15) - pytext/task/task.py (9:15) duplicated block id: 382 size: 7 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (708:714) - pytext/metrics/__init__.py (745:751) duplicated block id: 383 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (373:379) - pytext/models/doc_model.py (417:423) duplicated block id: 384 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (143:149) - pytext/models/doc_model.py (386:392) duplicated block id: 385 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (2146:2152) - pytext/torchscript/module.py (2157:2163) duplicated block id: 386 size: 7 cleaned lines of code in 2 files: - pytext/legacy/data/field.py (147:153) - pytext/legacy/data/field.py (454:460) duplicated block id: 387 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (2146:2152) - pytext/torchscript/module.py (2185:2191) duplicated block id: 388 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1479:1486) - pytext/torchscript/module.py (1673:1680) duplicated block id: 389 size: 7 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (99:106) - pytext/data/bert_tensorizer.py (353:360) duplicated block id: 390 size: 7 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (801:807) - pytext/metrics/__init__.py (861:867) duplicated block id: 391 size: 7 cleaned lines of code in 2 files: - pytext/loss/regularizer.py (38:45) - pytext/loss/regularizer.py (59:66) duplicated block id: 392 size: 7 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (417:424) - pytext/data/xlm_tensorizer.py (165:172) duplicated block id: 393 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1021:1027) - pytext/torchscript/module.py (2151:2157) duplicated block id: 394 size: 7 cleaned lines of code in 2 files: - pytext/optimizer/fp16_optimizer.py (166:172) - pytext/optimizer/fp16_optimizer.py (282:288) duplicated block id: 395 size: 7 cleaned lines of code in 2 files: - pytext/data/roberta_tensorizer.py (74:81) - pytext/data/xlm_tensorizer.py (165:172) duplicated block id: 396 size: 7 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1298:1304) - pytext/data/tensorizers.py (1520:1526) duplicated block id: 397 size: 7 cleaned lines of code in 2 files: - pytext/legacy/datasets/translation.py (108:115) - pytext/legacy/datasets/translation.py (258:265) duplicated block id: 398 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (929:936) - pytext/torchscript/module.py (1879:1886) duplicated block id: 399 size: 7 cleaned lines of code in 2 files: - pytext/models/word_model.py (250:256) - pytext/torchscript/module.py (192:199) duplicated block id: 400 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1525:1532) - pytext/torchscript/module.py (2179:2186) duplicated block id: 401 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (183:190) - pytext/torchscript/module.py (674:681) duplicated block id: 402 size: 7 cleaned lines of code in 2 files: - pytext/data/data_handler.py (677:683) - pytext/data/data_handler.py (701:707) duplicated block id: 403 size: 7 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (162:168) - pytext/torchscript/tensorizer/roberta.py (84:90) duplicated block id: 404 size: 7 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (764:773) - pytext/data/tensorizers.py (806:815) duplicated block id: 405 size: 7 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1653:1660) - pytext/data/tensorizers.py (2325:2332) duplicated block id: 406 size: 7 cleaned lines of code in 2 files: - pytext/models/decoders/mlp_decoder_n_tower.py (29:36) - pytext/models/decoders/mlp_decoder_tri_tower.py (33:40) duplicated block id: 407 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (363:369) - pytext/models/word_model.py (159:165) duplicated block id: 408 size: 7 cleaned lines of code in 2 files: - pytext/models/representations/augmented_lstm.py (398:405) - pytext/models/representations/bilstm.py (78:85) duplicated block id: 409 size: 7 cleaned lines of code in 2 files: - pytext/models/masked_lm.py (61:67) - pytext/models/roberta.py (509:515) duplicated block id: 410 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (803:810) - pytext/torchscript/module.py (1306:1313) duplicated block id: 411 size: 7 cleaned lines of code in 2 files: - pytext/models/bert_classification_models.py (94:101) - pytext/models/tri_tower_classification_model.py (159:166) duplicated block id: 412 size: 7 cleaned lines of code in 2 files: - pytext/optimizer/lamb.py (29:35) - pytext/optimizer/radam.py (109:115) duplicated block id: 413 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (199:205) - pytext/models/doc_model.py (362:368) duplicated block id: 414 size: 7 cleaned lines of code in 2 files: - pytext/metric_reporters/compositional_utils.py (22:29) - pytext/metric_reporters/compositional_utils.py (42:54) duplicated block id: 415 size: 7 cleaned lines of code in 2 files: - pytext/data/dense_retrieval_tensorizer.py (118:124) - pytext/data/roberta_tensorizer.py (56:62) duplicated block id: 416 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (466:473) - pytext/torchscript/module.py (1937:1944) duplicated block id: 417 size: 7 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (441:447) - pytext/data/squad_tensorizer.py (287:293) duplicated block id: 418 size: 7 cleaned lines of code in 2 files: - pytext/fields/dict_field.py (44:50) - pytext/legacy/data/field.py (308:314) duplicated block id: 419 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (467:475) - pytext/torchscript/module.py (649:657) duplicated block id: 420 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1882:1888) - pytext/torchscript/module.py (2102:2108) duplicated block id: 421 size: 7 cleaned lines of code in 2 files: - pytext/legacy/datasets/text_classification.py (98:106) - pytext/legacy/datasets/unsupervised_learning.py (153:161) duplicated block id: 422 size: 7 cleaned lines of code in 2 files: - pytext/models/decoders/mlp_decoder_tri_tower.py (82:88) - pytext/models/decoders/mlp_decoder_two_tower.py (90:96) duplicated block id: 423 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (2019:2025) - pytext/torchscript/module.py (2064:2070) duplicated block id: 424 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (861:868) - pytext/torchscript/module.py (1306:1313) duplicated block id: 425 size: 7 cleaned lines of code in 2 files: - pytext/models/tri_tower_classification_model.py (61:73) - pytext/models/two_tower_classification_model.py (62:74) duplicated block id: 426 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (346:352) - pytext/models/doc_model.py (386:392) duplicated block id: 427 size: 7 cleaned lines of code in 2 files: - pytext/models/output_layers/distance_output_layer.py (83:89) - pytext/models/output_layers/distance_output_layer.py (146:152) duplicated block id: 428 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (374:381) - pytext/torchscript/module.py (2179:2186) duplicated block id: 429 size: 7 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1199:1205) - pytext/data/tensorizers.py (1520:1526) duplicated block id: 430 size: 7 cleaned lines of code in 2 files: - pytext/models/decoders/mlp_decoder_n_tower.py (61:67) - pytext/models/decoders/mlp_decoder_two_tower.py (90:96) duplicated block id: 431 size: 7 cleaned lines of code in 2 files: - pytext/fields/char_field.py (45:51) - pytext/fields/text_field_with_special_unk.py (34:40) duplicated block id: 432 size: 7 cleaned lines of code in 2 files: - pytext/fields/dict_field.py (44:50) - pytext/fields/text_field_with_special_unk.py (34:40) duplicated block id: 433 size: 7 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (468:476) - pytext/data/tensorizers.py (1038:1046) duplicated block id: 434 size: 7 cleaned lines of code in 2 files: - pytext/models/doc_model.py (405:411) - pytext/torchscript/module.py (588:596) duplicated block id: 435 size: 7 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (1170:1177) - pytext/metrics/__init__.py (1251:1258) duplicated block id: 436 size: 7 cleaned lines of code in 2 files: - pytext/models/output_layers/lm_output_layer.py (59:66) - pytext/models/output_layers/word_tagging_output_layer.py (215:222) duplicated block id: 437 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (459:465) - pytext/torchscript/module.py (1579:1585) duplicated block id: 438 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/module.py (167:174) - pytext/torchscript/module.py (1432:1439) duplicated block id: 439 size: 7 cleaned lines of code in 2 files: - pytext/main.py (334:340) - pytext/main.py (571:577) duplicated block id: 440 size: 7 cleaned lines of code in 2 files: - pytext/task/disjoint_multitask.py (74:81) - pytext/task/task.py (98:105) duplicated block id: 441 size: 7 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (124:130) - pytext/torchscript/batchutils.py (275:281) duplicated block id: 442 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (507:512) - pytext/torchscript/module.py (597:602) duplicated block id: 443 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (466:472) - pytext/torchscript/module.py (1057:1063) duplicated block id: 444 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/utils.py (76:81) - pytext/torchscript/utils.py (100:105) duplicated block id: 445 size: 6 cleaned lines of code in 2 files: - pytext/data/data.py (50:56) - pytext/data/dynamic_pooling_batcher.py (52:58) duplicated block id: 446 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1421:1429) - pytext/data/tensorizers.py (1481:1489) duplicated block id: 447 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (194:201) - pytext/torchscript/module.py (543:550) duplicated block id: 448 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (404:409) - pytext/models/word_model.py (251:256) duplicated block id: 449 size: 6 cleaned lines of code in 2 files: - pytext/optimizer/optimizers.py (72:79) - pytext/optimizer/optimizers.py (109:116) duplicated block id: 450 size: 6 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (286:291) - pytext/data/bert_tensorizer.py (419:424) duplicated block id: 451 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (174:181) - pytext/torchscript/module.py (194:201) duplicated block id: 452 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (432:437) - pytext/data/tensorizers.py (445:450) duplicated block id: 453 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (174:180) - pytext/models/doc_model.py (370:376) duplicated block id: 454 size: 6 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (59:64) - pytext/data/squad_for_bert_tensorizer.py (323:328) duplicated block id: 455 size: 6 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (245:250) - pytext/data/squad_for_bert_tensorizer.py (258:263) duplicated block id: 456 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (157:162) - pytext/torchscript/tensorizer/tensorizer.py (95:100) duplicated block id: 457 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (762:767) - pytext/torchscript/module.py (1306:1311) duplicated block id: 458 size: 6 cleaned lines of code in 2 files: - pytext/models/seq_models/conv_decoder.py (341:346) - pytext/models/seq_models/conv_decoder.py (455:460) duplicated block id: 459 size: 6 cleaned lines of code in 2 files: - pytext/models/joint_model.py (105:111) - pytext/models/word_model.py (82:87) duplicated block id: 460 size: 6 cleaned lines of code in 2 files: - pytext/data/masked_tensorizer.py (36:42) - pytext/data/tensorizers.py (2441:2447) duplicated block id: 461 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (124:129) - pytext/torchscript/module.py (265:270) duplicated block id: 462 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (2441:2447) - pytext/data/token_tensorizer.py (213:219) duplicated block id: 463 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (734:739) - pytext/torchscript/module.py (2051:2056) duplicated block id: 464 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (632:637) - pytext/torchscript/module.py (1765:1771) duplicated block id: 465 size: 6 cleaned lines of code in 2 files: - pytext/metrics/intent_slot_metrics.py (185:190) - pytext/metrics/mask_metrics.py (74:79) duplicated block id: 466 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (393:398) - pytext/torchscript/module.py (1009:1014) duplicated block id: 467 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (275:280) - pytext/torchscript/module.py (265:270) duplicated block id: 468 size: 6 cleaned lines of code in 2 files: - pytext/metric_reporters/compositional_metric_reporter.py (126:131) - pytext/metric_reporters/seq2seq_compositional.py (114:119) duplicated block id: 469 size: 6 cleaned lines of code in 2 files: - pytext/models/representations/bilstm_doc_attention.py (65:70) - pytext/models/representations/bilstm_doc_slot_attention.py (71:76) duplicated block id: 470 size: 6 cleaned lines of code in 2 files: - pytext/models/seq_models/conv_decoder.py (341:346) - pytext/models/seq_models/conv_decoder.py (511:516) duplicated block id: 471 size: 6 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (39:45) - pytext/data/squad_for_bert_tensorizer.py (305:311) duplicated block id: 472 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (460:465) - pytext/data/tensorizers.py (1030:1035) duplicated block id: 473 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1646:1651) - pytext/data/tensorizers.py (2318:2323) duplicated block id: 474 size: 6 cleaned lines of code in 2 files: - pytext/optimizer/fp16_optimizer.py (520:540) - pytext/optimizer/fp16_optimizer.py (788:804) duplicated block id: 475 size: 6 cleaned lines of code in 2 files: - pytext/models/tri_tower_classification_model.py (85:92) - pytext/models/two_tower_classification_model.py (93:100) duplicated block id: 476 size: 6 cleaned lines of code in 2 files: - pytext/utils/mobile_onnx.py (42:47) - pytext/utils/onnx.py (44:49) duplicated block id: 477 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1766:1772) - pytext/data/tensorizers.py (1880:1888) duplicated block id: 478 size: 6 cleaned lines of code in 2 files: - pytext/models/qna/bert_squad_qa.py (73:80) - pytext/models/qna/dr_qa.py (89:94) duplicated block id: 479 size: 6 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (410:415) - pytext/data/roberta_tensorizer.py (121:126) duplicated block id: 480 size: 6 cleaned lines of code in 2 files: - pytext/optimizer/fp16_optimizer.py (801:806) - pytext/optimizer/fp16_optimizer.py (857:862) duplicated block id: 481 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (830:835) - pytext/torchscript/module.py (1962:1967) duplicated block id: 482 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (258:264) - pytext/torchscript/module.py (1479:1485) duplicated block id: 483 size: 6 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (410:415) - pytext/data/roberta_tensorizer.py (66:71) duplicated block id: 484 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (739:744) - pytext/torchscript/module.py (1217:1222) duplicated block id: 485 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1068:1073) - pytext/data/token_tensorizer.py (284:289) duplicated block id: 486 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (201:206) - pytext/torchscript/module.py (543:550) duplicated block id: 487 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (194:201) - pytext/torchscript/module.py (665:672) duplicated block id: 488 size: 6 cleaned lines of code in 2 files: - pytext/task/disjoint_multitask.py (105:110) - pytext/task/disjoint_multitask.py (232:237) duplicated block id: 489 size: 6 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (253:259) - pytext/data/xlm_tensorizer.py (106:112) duplicated block id: 490 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (43:54) - pytext/models/word_model.py (12:29) duplicated block id: 491 size: 6 cleaned lines of code in 2 files: - pytext/models/representations/transformer/luna_sentence_encoder.py (327:332) - pytext/models/representations/transformer/luna_sentence_encoder.py (403:408) duplicated block id: 492 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/seq2seq/beam_decode.py (24:29) - pytext/torchscript/seq2seq/beam_decode.py (195:200) duplicated block id: 493 size: 6 cleaned lines of code in 2 files: - pytext/data/decoupled_data.py (144:149) - pytext/data/packed_lm_data.py (27:32) duplicated block id: 494 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (157:162) - pytext/torchscript/module.py (193:199) duplicated block id: 495 size: 6 cleaned lines of code in 2 files: - pytext/models/representations/lightconv.py (122:127) - pytext/models/seq_models/conv_encoder.py (257:262) duplicated block id: 496 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (734:739) - pytext/torchscript/module.py (830:835) duplicated block id: 497 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (431:437) - pytext/torchscript/module.py (1525:1531) duplicated block id: 498 size: 6 cleaned lines of code in 2 files: - pytext/data/data.py (308:313) - pytext/data/decoupled_data.py (193:198) duplicated block id: 499 size: 6 cleaned lines of code in 2 files: - pytext/data/squad_tensorizer.py (271:276) - pytext/data/squad_tensorizer.py (283:288) duplicated block id: 500 size: 6 cleaned lines of code in 2 files: - pytext/trainers/trainer.py (151:156) - pytext/trainers/trainer.py (169:174) duplicated block id: 501 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/tensorizer/roberta.py (15:20) - pytext/torchscript/tensorizer/roberta.py (29:34) duplicated block id: 502 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (773:778) - pytext/torchscript/module.py (1962:1967) duplicated block id: 503 size: 6 cleaned lines of code in 2 files: - pytext/data/sources/tsv.py (22:27) - pytext/data/sources/tsv.py (259:264) duplicated block id: 504 size: 6 cleaned lines of code in 2 files: - pytext/data/dense_retrieval_tensorizer.py (125:130) - pytext/data/roberta_tensorizer.py (66:71) duplicated block id: 505 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1564:1569) - pytext/torchscript/module.py (1733:1738) duplicated block id: 506 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (370:376) - pytext/models/word_model.py (176:182) duplicated block id: 507 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1481:1486) - pytext/torchscript/module.py (2102:2107) duplicated block id: 508 size: 6 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (286:291) - pytext/data/roberta_tensorizer.py (76:81) duplicated block id: 509 size: 6 cleaned lines of code in 2 files: - pytext/models/embeddings/embedding_list.py (76:81) - pytext/models/embeddings/scriptable_embedding_list.py (101:106) duplicated block id: 510 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1421:1429) - pytext/data/tensorizers.py (1880:1888) duplicated block id: 511 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (383:388) - pytext/data/tensorizers.py (656:661) duplicated block id: 512 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1803:1808) - pytext/torchscript/module.py (1882:1887) duplicated block id: 513 size: 6 cleaned lines of code in 2 files: - pytext/models/model.py (148:165) - pytext/models/r3f_models.py (174:186) duplicated block id: 514 size: 6 cleaned lines of code in 2 files: - pytext/data/sources/conllu.py (113:118) - pytext/data/sources/tsv.py (40:45) duplicated block id: 515 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1481:1489) - pytext/data/tensorizers.py (1880:1888) duplicated block id: 516 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1247:1255) - pytext/data/tensorizers.py (1481:1489) duplicated block id: 517 size: 6 cleaned lines of code in 2 files: - pytext/legacy/datasets/translation.py (158:163) - pytext/legacy/datasets/translation.py (260:265) duplicated block id: 518 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (206:213) - pytext/torchscript/batchutils.py (221:228) duplicated block id: 519 size: 6 cleaned lines of code in 2 files: - pytext/models/representations/huggingface_bert_sentence_encoder.py (27:33) - pytext/models/representations/huggingface_electra_sentence_encoder.py (27:33) duplicated block id: 520 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1675:1680) - pytext/torchscript/module.py (2102:2107) duplicated block id: 521 size: 6 cleaned lines of code in 2 files: - pytext/data/roberta_tensorizer.py (66:71) - pytext/data/roberta_tensorizer.py (121:126) duplicated block id: 522 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (128:133) - pytext/models/word_model.py (130:135) duplicated block id: 523 size: 6 cleaned lines of code in 2 files: - pytext/legacy/datasets/nli.py (168:173) - pytext/legacy/datasets/nli.py (195:200) duplicated block id: 524 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/utils.py (218:223) - pytext/torchscript/utils.py (261:266) duplicated block id: 525 size: 6 cleaned lines of code in 2 files: - pytext/models/r3f_models.py (204:209) - pytext/models/seq_models/nar_seq2seq_model.py (191:196) duplicated block id: 526 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (401:406) - pytext/torchscript/module.py (1678:1683) duplicated block id: 527 size: 6 cleaned lines of code in 2 files: - pytext/task/disjoint_multitask.py (191:196) - pytext/task/tasks.py (210:215) duplicated block id: 528 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (264:269) - pytext/torchscript/module.py (397:402) duplicated block id: 529 size: 6 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_seq2seq_topk.py (147:152) - pytext/metric_reporters/seq2seq_compositional.py (152:158) duplicated block id: 530 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (656:661) - pytext/data/tensorizers.py (978:983) duplicated block id: 531 size: 6 cleaned lines of code in 2 files: - pytext/models/seq_models/conv_decoder.py (282:287) - pytext/models/seq_models/conv_decoder.py (549:554) duplicated block id: 532 size: 6 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (318:323) - pytext/metric_reporters/mask_compositional.py (329:334) duplicated block id: 533 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1247:1255) - pytext/data/tensorizers.py (1421:1429) duplicated block id: 534 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (579:584) - pytext/data/tensorizers.py (678:683) duplicated block id: 535 size: 6 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (10:15) - pytext/metrics/intent_slot_metrics.py (11:16) duplicated block id: 536 size: 6 cleaned lines of code in 2 files: - pytext/loss/loss.py (77:82) - pytext/loss/loss.py (618:623) duplicated block id: 537 size: 6 cleaned lines of code in 2 files: - pytext/models/seq_models/conv_decoder.py (182:187) - pytext/models/seq_models/conv_encoder.py (136:141) duplicated block id: 538 size: 6 cleaned lines of code in 2 files: - pytext/task/new_task.py (472:477) - pytext/task/tasks.py (278:283) duplicated block id: 539 size: 6 cleaned lines of code in 2 files: - pytext/trainers/trainer.py (187:192) - pytext/trainers/trainer.py (200:205) duplicated block id: 540 size: 6 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (308:313) - pytext/metrics/__init__.py (334:339) duplicated block id: 541 size: 6 cleaned lines of code in 2 files: - pytext/metric_reporters/seq2seq_compositional.py (126:132) - pytext/metric_reporters/seq2seq_compositional.py (152:158) duplicated block id: 542 size: 6 cleaned lines of code in 2 files: - pytext/metric_reporters/classification_metric_reporter.py (142:162) - pytext/metric_reporters/metric_reporter.py (83:103) duplicated block id: 543 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1962:1967) - pytext/torchscript/module.py (2051:2056) duplicated block id: 544 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1421:1429) - pytext/data/tensorizers.py (1766:1772) duplicated block id: 545 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (395:401) - pytext/data/tensorizers.py (668:674) duplicated block id: 546 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1441:1446) - pytext/torchscript/module.py (1623:1629) duplicated block id: 547 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1481:1489) - pytext/data/tensorizers.py (1766:1772) duplicated block id: 548 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (374:380) - pytext/torchscript/module.py (1057:1063) duplicated block id: 549 size: 6 cleaned lines of code in 2 files: - pytext/legacy/datasets/sst.py (64:69) - pytext/legacy/datasets/trec.py (49:54) duplicated block id: 550 size: 6 cleaned lines of code in 2 files: - pytext/metrics/__init__.py (772:793) - pytext/metrics/__init__.py (823:844) duplicated block id: 551 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (734:739) - pytext/torchscript/module.py (773:778) duplicated block id: 552 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1889:1896) - pytext/torchscript/module.py (2111:2118) duplicated block id: 553 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (405:410) - pytext/torchscript/module.py (665:672) duplicated block id: 554 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1470:1477) - pytext/torchscript/module.py (1663:1670) duplicated block id: 555 size: 6 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (410:415) - pytext/data/dense_retrieval_tensorizer.py (125:130) duplicated block id: 556 size: 6 cleaned lines of code in 2 files: - pytext/task/new_task.py (378:384) - pytext/task/tasks.py (254:260) duplicated block id: 557 size: 6 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (258:263) - pytext/data/squad_for_bert_tensorizer.py (424:429) duplicated block id: 558 size: 6 cleaned lines of code in 2 files: - pytext/models/seq_models/nar_seq2seq_model.py (43:48) - pytext/models/seq_models/seq2seq_model.py (209:214) duplicated block id: 559 size: 6 cleaned lines of code in 2 files: - pytext/data/data.py (268:273) - pytext/data/packed_lm_data.py (27:32) duplicated block id: 560 size: 6 cleaned lines of code in 2 files: - pytext/models/representations/traced_transformer_encoder.py (25:30) - pytext/models/representations/traced_transformer_encoder.py (113:118) duplicated block id: 561 size: 6 cleaned lines of code in 2 files: - pytext/data/roberta_tensorizer.py (66:71) - pytext/data/xlm_tensorizer.py (155:160) duplicated block id: 562 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (264:269) - pytext/torchscript/module.py (409:414) duplicated block id: 563 size: 6 cleaned lines of code in 2 files: - pytext/data/sources/tsv.py (131:136) - pytext/data/sources/tsv.py (352:357) duplicated block id: 564 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (374:380) - pytext/torchscript/module.py (431:437) duplicated block id: 565 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (762:767) - pytext/torchscript/module.py (1249:1254) duplicated block id: 566 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (264:269) - pytext/torchscript/module.py (437:442) duplicated block id: 567 size: 6 cleaned lines of code in 2 files: - pytext/models/output_layers/intent_slot_output_layer.py (160:165) - pytext/models/output_layers/multi_label_classification_layer.py (144:149) duplicated block id: 568 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1338:1346) - pytext/data/tensorizers.py (1411:1419) duplicated block id: 569 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (861:866) - pytext/torchscript/module.py (1249:1254) duplicated block id: 570 size: 6 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (286:291) - pytext/data/xlm_tensorizer.py (167:172) duplicated block id: 571 size: 6 cleaned lines of code in 2 files: - pytext/models/qna/bert_squad_qa.py (60:65) - pytext/models/roberta.py (509:514) duplicated block id: 572 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1247:1255) - pytext/data/tensorizers.py (1880:1888) duplicated block id: 573 size: 6 cleaned lines of code in 2 files: - pytext/data/bert_tensorizer.py (410:415) - pytext/data/xlm_tensorizer.py (155:160) duplicated block id: 574 size: 6 cleaned lines of code in 2 files: - pytext/fields/char_field.py (19:25) - pytext/fields/dict_field.py (20:26) duplicated block id: 575 size: 6 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (102:107) - pytext/metric_reporters/mask_compositional.py (329:334) duplicated block id: 576 size: 6 cleaned lines of code in 2 files: - pytext/data/sources/tsv.py (203:208) - pytext/data/sources/tsv.py (352:357) duplicated block id: 577 size: 6 cleaned lines of code in 2 files: - pytext/models/language_models/lmlstm.py (118:123) - pytext/models/model.py (315:320) duplicated block id: 578 size: 6 cleaned lines of code in 2 files: - pytext/models/masked_lm.py (61:66) - pytext/models/qna/bert_squad_qa.py (60:65) duplicated block id: 579 size: 6 cleaned lines of code in 2 files: - pytext/data/data_structures/annotation.py (433:439) - pytext/data/data_structures/annotation.py (491:497) duplicated block id: 580 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (405:410) - pytext/torchscript/module.py (174:181) duplicated block id: 581 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (68:73) - pytext/data/tensorizers.py (100:105) duplicated block id: 582 size: 6 cleaned lines of code in 2 files: - pytext/data/squad_tensorizer.py (179:184) - pytext/data/squad_tensorizer.py (283:288) duplicated block id: 583 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (505:511) - pytext/torchscript/module.py (674:680) duplicated block id: 584 size: 6 cleaned lines of code in 2 files: - pytext/models/seq_models/conv_decoder.py (141:146) - pytext/models/seq_models/conv_encoder.py (106:111) duplicated block id: 585 size: 6 cleaned lines of code in 2 files: - pytext/models/representations/bilstm_doc_attention.py (87:93) - pytext/models/representations/bilstm_doc_slot_attention.py (119:125) duplicated block id: 586 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (212:217) - pytext/torchscript/module.py (228:233) duplicated block id: 587 size: 6 cleaned lines of code in 2 files: - pytext/metric_reporters/squad_metric_reporter.py (327:332) - pytext/metric_reporters/squad_metric_reporter.py (355:360) duplicated block id: 588 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1481:1486) - pytext/torchscript/module.py (1882:1887) duplicated block id: 589 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (200:205) - pytext/models/word_model.py (159:164) duplicated block id: 590 size: 6 cleaned lines of code in 2 files: - pytext/models/joint_model.py (174:179) - pytext/models/language_models/lmlstm.py (162:167) duplicated block id: 591 size: 6 cleaned lines of code in 2 files: - pytext/metric_reporters/mask_compositional.py (255:261) - pytext/metric_reporters/seq2seq_compositional.py (165:172) duplicated block id: 592 size: 6 cleaned lines of code in 2 files: - pytext/models/seq_models/rnn_decoder.py (276:281) - pytext/models/seq_models/rnn_decoder.py (355:360) duplicated block id: 593 size: 6 cleaned lines of code in 2 files: - pytext/metrics/seq2seq_metrics.py (35:40) - pytext/metrics/seq2seq_metrics.py (75:80) duplicated block id: 594 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (201:206) - pytext/torchscript/module.py (174:181) duplicated block id: 595 size: 6 cleaned lines of code in 2 files: - pytext/data/sources/tsv.py (28:33) - pytext/data/sources/tsv.py (267:272) duplicated block id: 596 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (363:368) - pytext/torchscript/module.py (193:199) duplicated block id: 597 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1057:1063) - pytext/torchscript/module.py (1525:1531) duplicated block id: 598 size: 6 cleaned lines of code in 2 files: - pytext/task/serialize.py (61:70) - pytext/task/serialize.py (90:99) duplicated block id: 599 size: 6 cleaned lines of code in 2 files: - pytext/legacy/datasets/nli.py (54:59) - pytext/legacy/datasets/nli.py (195:200) duplicated block id: 600 size: 6 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (424:429) - pytext/data/squad_for_bert_tensorizer.py (437:442) duplicated block id: 601 size: 6 cleaned lines of code in 2 files: - pytext/optimizer/sparsifiers/blockwise_sparsifier.py (82:87) - pytext/optimizer/sparsifiers/sparsifier.py (96:101) duplicated block id: 602 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1609:1615) - pytext/torchscript/module.py (1763:1770) duplicated block id: 603 size: 6 cleaned lines of code in 2 files: - pytext/models/representations/pooling.py (57:63) - pytext/models/representations/pooling.py (77:83) duplicated block id: 604 size: 6 cleaned lines of code in 2 files: - pytext/legacy/datasets/nli.py (54:59) - pytext/legacy/datasets/nli.py (168:173) duplicated block id: 605 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/batchutils.py (466:472) - pytext/torchscript/module.py (431:437) duplicated block id: 606 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1675:1680) - pytext/torchscript/module.py (1803:1808) duplicated block id: 607 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (460:465) - pytext/data/token_tensorizer.py (252:257) duplicated block id: 608 size: 6 cleaned lines of code in 2 files: - pytext/metric_reporters/multi_span_qa_metric_reporter.py (120:125) - pytext/metric_reporters/squad_metric_reporter.py (186:191) duplicated block id: 609 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (656:661) - pytext/data/token_tensorizer.py (203:208) duplicated block id: 610 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (492:498) - pytext/data/tensorizers.py (1057:1063) duplicated block id: 611 size: 6 cleaned lines of code in 2 files: - pytext/data/squad_for_bert_tensorizer.py (245:250) - pytext/data/squad_for_bert_tensorizer.py (437:442) duplicated block id: 612 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (393:399) - pytext/data/tensorizers.py (2441:2447) duplicated block id: 613 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1675:1680) - pytext/torchscript/module.py (1882:1887) duplicated block id: 614 size: 6 cleaned lines of code in 2 files: - pytext/task/disjoint_multitask.py (191:196) - pytext/task/new_task.py (140:145) duplicated block id: 615 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (115:120) - pytext/models/language_models/lmlstm.py (162:167) duplicated block id: 616 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (201:206) - pytext/torchscript/module.py (665:672) duplicated block id: 617 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (183:189) - pytext/torchscript/module.py (505:511) duplicated block id: 618 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1331:1336) - pytext/data/tensorizers.py (1402:1407) duplicated block id: 619 size: 6 cleaned lines of code in 2 files: - pytext/data/data.py (50:56) - pytext/data/data.py (153:159) duplicated block id: 620 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (405:410) - pytext/torchscript/module.py (543:550) duplicated block id: 621 size: 6 cleaned lines of code in 2 files: - pytext/data/data.py (306:312) - pytext/data/packed_lm_data.py (47:53) duplicated block id: 622 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (511:516) - pytext/models/model.py (309:314) duplicated block id: 623 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (1803:1808) - pytext/torchscript/module.py (2102:2107) duplicated block id: 624 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (668:674) - pytext/data/token_tensorizer.py (215:221) duplicated block id: 625 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (803:808) - pytext/torchscript/module.py (1249:1254) duplicated block id: 626 size: 6 cleaned lines of code in 2 files: - pytext/optimizer/sparsifiers/sparsifier.py (86:91) - pytext/optimizer/sparsifiers/sparsifier.py (316:321) duplicated block id: 627 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (404:409) - pytext/models/word_model.py (159:164) duplicated block id: 628 size: 6 cleaned lines of code in 2 files: - pytext/main.py (341:346) - pytext/main.py (579:584) duplicated block id: 629 size: 6 cleaned lines of code in 2 files: - pytext/metric_reporters/classification_metric_reporter.py (200:207) - pytext/metric_reporters/classification_metric_reporter.py (261:267) duplicated block id: 630 size: 6 cleaned lines of code in 2 files: - pytext/optimizer/adabelief.py (29:62) - pytext/optimizer/madgrad.py (29:47) duplicated block id: 631 size: 6 cleaned lines of code in 2 files: - pytext/legacy/datasets/text_classification.py (436:441) - pytext/legacy/datasets/text_classification.py (456:461) duplicated block id: 632 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (260:265) - pytext/torchscript/module.py (932:937) duplicated block id: 633 size: 6 cleaned lines of code in 2 files: - pytext/optimizer/adabelief.py (70:76) - pytext/optimizer/lamb.py (37:43) duplicated block id: 634 size: 6 cleaned lines of code in 2 files: - pytext/data/tensorizers.py (1247:1255) - pytext/data/tensorizers.py (1766:1772) duplicated block id: 635 size: 6 cleaned lines of code in 2 files: - pytext/models/doc_model.py (200:205) - pytext/models/word_model.py (251:256) duplicated block id: 636 size: 6 cleaned lines of code in 2 files: - pytext/torchscript/module.py (258:264) - pytext/torchscript/module.py (1673:1679)