duplicated block id: 1 size: 35 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (208:276) - finetune/TensorFlow/run_classifier.py (393:460) duplicated block id: 2 size: 23 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (130:181) - finetune/run_classifier_azureml.py (160:211) duplicated block id: 3 size: 18 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (239:267) - finetune/run_classifier_azureml.py (262:290) duplicated block id: 4 size: 17 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (47:87) - finetune/TensorFlow/run_classifier.py (130:170) duplicated block id: 5 size: 17 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (479:500) - finetune/run_classifier_azureml.py (516:537) duplicated block id: 6 size: 17 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (428:453) - finetune/run_classifier_azureml.py (542:567) duplicated block id: 7 size: 17 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (47:87) - finetune/run_classifier_azureml.py (160:200) duplicated block id: 8 size: 16 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (355:379) - finetune/run_classifier_azureml.py (542:566) duplicated block id: 9 size: 16 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (283:307) - finetune/run_classifier_azureml.py (428:452) duplicated block id: 10 size: 16 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (355:379) - finetune/run_classifier_azureml.py (428:452) duplicated block id: 11 size: 16 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (230:253) - finetune/run_classifier_azureml.py (357:380) duplicated block id: 12 size: 16 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (283:307) - finetune/run_classifier_azureml.py (355:379) duplicated block id: 13 size: 16 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (283:307) - finetune/run_classifier_azureml.py (542:566) duplicated block id: 14 size: 15 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (320:345) - finetune/run_classifier_azureml.py (316:341) duplicated block id: 15 size: 15 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (287:309) - finetune/run_classifier_azureml.py (662:684) duplicated block id: 16 size: 15 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (285:307) - finetune/run_classifier_azureml.py (230:252) duplicated block id: 17 size: 15 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (230:252) - finetune/run_classifier_azureml.py (544:566) duplicated block id: 18 size: 15 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (230:252) - finetune/run_classifier_azureml.py (430:452) duplicated block id: 19 size: 14 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (283:305) - finetune/run_classifier_azureml.py (319:341) duplicated block id: 20 size: 14 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (283:305) - finetune/TensorFlow/run_classifier.py (323:345) duplicated block id: 21 size: 14 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (323:345) - finetune/run_classifier_azureml.py (355:377) duplicated block id: 22 size: 14 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (924:940) - finetune/run_squad_azureml.py (804:820) duplicated block id: 23 size: 14 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (323:345) - finetune/run_classifier_azureml.py (542:564) duplicated block id: 24 size: 14 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (382:395) - finetune/run_classifier_azureml.py (792:805) duplicated block id: 25 size: 14 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (323:345) - finetune/run_classifier_azureml.py (428:450) duplicated block id: 26 size: 14 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (319:341) - finetune/run_classifier_azureml.py (542:564) duplicated block id: 27 size: 14 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (319:341) - finetune/run_classifier_azureml.py (355:377) duplicated block id: 28 size: 14 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (319:341) - finetune/run_classifier_azureml.py (428:450) duplicated block id: 29 size: 13 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (315:334) - finetune/run_squad_azureml.py (690:709) duplicated block id: 30 size: 13 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (325:345) - finetune/run_classifier_azureml.py (230:250) duplicated block id: 31 size: 13 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (230:250) - finetune/run_classifier_azureml.py (321:341) duplicated block id: 32 size: 13 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (525:537) - finetune/run_squad_azureml.py (904:916) duplicated block id: 33 size: 12 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (1006:1021) - finetune/run_squad_azureml.py (866:882) duplicated block id: 34 size: 12 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (255:273) - finetune/run_squad_azureml.py (264:282) duplicated block id: 35 size: 12 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (394:405) - finetune/run_classifier_azureml.py (812:823) duplicated block id: 36 size: 12 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (439:457) - finetune/run_squad_azureml.py (264:282) duplicated block id: 37 size: 11 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (823:833) - finetune/run_squad_azureml.py (764:774) duplicated block id: 38 size: 11 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (132:149) - finetune/run_classifier_azureml.py (257:274) duplicated block id: 39 size: 11 cleaned lines of code in 2 files: - pretrain/PyTorch/dataset.py (74:88) - pretrain/PyTorch/sources.py (10:24) duplicated block id: 40 size: 11 cleaned lines of code in 2 files: - pretrain/PyTorch/sources.py (59:72) - pretrain/PyTorch/sources.py (236:248) duplicated block id: 41 size: 10 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (355:370) - finetune/run_classifier_azureml.py (391:406) duplicated block id: 42 size: 10 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (391:406) - finetune/run_classifier_azureml.py (506:521) duplicated block id: 43 size: 10 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (391:406) - finetune/run_classifier_azureml.py (542:557) duplicated block id: 44 size: 10 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (319:334) - finetune/run_classifier_azureml.py (506:521) duplicated block id: 45 size: 10 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (391:406) - finetune/run_classifier_azureml.py (428:443) duplicated block id: 46 size: 10 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (428:443) - finetune/run_classifier_azureml.py (506:521) duplicated block id: 47 size: 10 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (506:521) - finetune/run_classifier_azureml.py (542:557) duplicated block id: 48 size: 10 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (323:338) - finetune/run_classifier_azureml.py (506:521) duplicated block id: 49 size: 10 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (355:370) - finetune/run_classifier_azureml.py (506:521) duplicated block id: 50 size: 10 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (165:181) - finetune/TensorFlow/run_classifier.py (315:331) duplicated block id: 51 size: 10 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (110:125) - finetune/PyTorch/run_classifier_azureml.py (175:190) duplicated block id: 52 size: 10 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (323:338) - finetune/run_classifier_azureml.py (391:406) duplicated block id: 53 size: 10 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (319:334) - finetune/run_classifier_azureml.py (391:406) duplicated block id: 54 size: 10 cleaned lines of code in 2 files: - pretrain/PyTorch/sources.py (179:189) - pretrain/PyTorch/sources.py (216:226) duplicated block id: 55 size: 10 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (283:298) - finetune/run_classifier_azureml.py (391:406) duplicated block id: 56 size: 10 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (283:298) - finetune/run_classifier_azureml.py (506:521) duplicated block id: 57 size: 9 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (552:566) - finetune/run_classifier_azureml.py (670:684) duplicated block id: 58 size: 9 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (230:243) - finetune/run_classifier_azureml.py (393:406) duplicated block id: 59 size: 9 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (242:250) - pretrain/PyTorch/dataset.py (124:133) duplicated block id: 60 size: 9 cleaned lines of code in 2 files: - pretrain/PyTorch/sources.py (63:72) - pretrain/PyTorch/sources.py (204:213) duplicated block id: 61 size: 9 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (230:243) - finetune/run_classifier_azureml.py (508:521) duplicated block id: 62 size: 9 cleaned lines of code in 2 files: - finetune/TensorFlow/run_classifier.py (426:434) - pretrain/PyTorch/dataset.py (124:133) duplicated block id: 63 size: 9 cleaned lines of code in 2 files: - pretrain/PyTorch/sources.py (204:213) - pretrain/PyTorch/sources.py (239:248) duplicated block id: 64 size: 9 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (295:309) - finetune/TensorFlow/run_classifier.py (552:566) duplicated block id: 65 size: 9 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (336:346) - finetune/run_squad_azureml.py (712:722) duplicated block id: 66 size: 8 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (834:841) - finetune/run_squad_azureml.py (778:785) duplicated block id: 67 size: 8 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (413:420) - finetune/run_squad_azureml.py (767:774) duplicated block id: 68 size: 8 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (413:420) - finetune/run_classifier_azureml.py (826:833) duplicated block id: 69 size: 8 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (525:533) - finetune/run_classifier_azureml.py (561:569) duplicated block id: 70 size: 8 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (1118:1126) - finetune/run_squad_azureml.py (966:973) duplicated block id: 71 size: 8 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (137:149) - finetune/TensorFlow/run_classifier.py (239:251) duplicated block id: 72 size: 8 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (346:355) - finetune/run_classifier_azureml.py (739:748) duplicated block id: 73 size: 8 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (488:496) - finetune/run_classifier_azureml.py (561:569) duplicated block id: 74 size: 8 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (118:128) - finetune/TensorFlow/run_classifier.py (298:308) duplicated block id: 75 size: 7 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (525:531) - finetune/run_classifier_azureml.py (1037:1043) duplicated block id: 76 size: 7 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (151:160) - finetune/TensorFlow/run_classifier.py (258:267) duplicated block id: 77 size: 7 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (505:515) - finetune/run_squad_azureml.py (882:892) duplicated block id: 78 size: 7 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (151:160) - finetune/run_classifier_azureml.py (281:290) duplicated block id: 79 size: 7 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (118:127) - finetune/run_classifier_azureml.py (243:252) duplicated block id: 80 size: 7 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (118:127) - finetune/run_classifier_azureml.py (443:452) duplicated block id: 81 size: 7 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (170:181) - finetune/run_classifier_azureml.py (316:327) duplicated block id: 82 size: 7 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (118:127) - finetune/run_classifier_azureml.py (370:379) duplicated block id: 83 size: 7 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (118:127) - finetune/run_classifier_azureml.py (557:566) duplicated block id: 84 size: 7 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (1037:1043) - finetune/run_squad_azureml.py (904:910) duplicated block id: 85 size: 7 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (366:372) - finetune/run_classifier_azureml.py (776:782) duplicated block id: 86 size: 7 cleaned lines of code in 2 files: - pretrain/PyTorch/sources.py (194:201) - pretrain/PyTorch/sources.py (231:238) duplicated block id: 87 size: 7 cleaned lines of code in 2 files: - finetune/PyTorch/azureml_bert_util.py (8:16) - pretrain/PyTorch/distributed_apex.py (5:13) duplicated block id: 88 size: 6 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (173:181) - finetune/run_classifier_azureml.py (506:514) duplicated block id: 89 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (410:416) - finetune/run_classifier_azureml.py (525:531) duplicated block id: 90 size: 6 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (173:181) - finetune/TensorFlow/run_classifier.py (283:291) duplicated block id: 91 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (410:416) - finetune/run_classifier_azureml.py (561:567) duplicated block id: 92 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (285:291) - finetune/run_classifier_azureml.py (525:531) duplicated block id: 93 size: 6 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (173:181) - finetune/run_classifier_azureml.py (391:399) duplicated block id: 94 size: 6 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (173:181) - finetune/run_classifier_azureml.py (355:363) duplicated block id: 95 size: 6 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (173:181) - finetune/run_classifier_azureml.py (542:550) duplicated block id: 96 size: 6 cleaned lines of code in 2 files: - pretrain/PyTorch/sources.py (39:45) - pretrain/PyTorch/sources.py (217:223) duplicated block id: 97 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (895:905) - finetune/run_squad_azureml.py (793:802) duplicated block id: 98 size: 6 cleaned lines of code in 2 files: - pretrain/PyTorch/sources.py (39:45) - pretrain/PyTorch/sources.py (180:186) duplicated block id: 99 size: 6 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (173:181) - finetune/run_classifier_azureml.py (428:436) duplicated block id: 100 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (447:453) - finetune/run_classifier_azureml.py (525:531) duplicated block id: 101 size: 6 cleaned lines of code in 2 files: - finetune/run_squad_azureml.py (886:892) - pretrain/PyTorch/train.py (439:444) duplicated block id: 102 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (447:453) - finetune/run_classifier_azureml.py (488:494) duplicated block id: 103 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (410:416) - finetune/run_classifier_azureml.py (447:453) duplicated block id: 104 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (285:291) - finetune/run_classifier_azureml.py (410:416) duplicated block id: 105 size: 6 cleaned lines of code in 2 files: - finetune/PyTorch/run_classifier_azureml.py (509:515) - pretrain/PyTorch/train.py (439:444) duplicated block id: 106 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (285:291) - finetune/run_classifier_azureml.py (561:567) duplicated block id: 107 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (410:416) - finetune/run_classifier_azureml.py (488:494) duplicated block id: 108 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (285:291) - finetune/run_classifier_azureml.py (488:494) duplicated block id: 109 size: 6 cleaned lines of code in 2 files: - finetune/run_classifier_azureml.py (285:291) - finetune/run_classifier_azureml.py (447:453)