duplicated block id: 1
size: 62 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_openai.py (108:184)
 - pytorch_transformers/tokenization_xlm.py (144:220)

duplicated block id: 2
size: 62 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (119:195)
 - pytorch_transformers/tokenization_roberta.py (88:164)

duplicated block id: 3
size: 33 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_utils.py (758:809)
 - pytorch_transformers/modeling_xlnet.py (1244:1295)

duplicated block id: 4
size: 26 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (142:168)
 - pytorch_transformers/tokenization_openai.py (126:152)

duplicated block id: 5
size: 26 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (189:221)
 - pytorch_transformers/modeling_openai.py (206:237)

duplicated block id: 6
size: 26 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_openai.py (126:152)
 - pytorch_transformers/tokenization_roberta.py (111:137)

duplicated block id: 7
size: 26 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_roberta.py (111:137)
 - pytorch_transformers/tokenization_xlm.py (162:188)

duplicated block id: 8
size: 26 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (142:168)
 - pytorch_transformers/tokenization_xlm.py (162:188)

duplicated block id: 9
size: 23 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (152:175)
 - pytorch_transformers/modeling_xlnet.py (153:176)

duplicated block id: 10
size: 21 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (232:256)
 - pytorch_transformers/modeling_openai.py (248:272)

duplicated block id: 11
size: 20 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl_utilities.py (121:144)
 - pytorch_transformers/modeling_transfo_xl_utilities.py (215:237)

duplicated block id: 12
size: 19 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_openai.py (186:208)
 - pytorch_transformers/tokenization_roberta.py (182:204)

duplicated block id: 13
size: 19 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (261:284)
 - pytorch_transformers/modeling_openai.py (278:301)

duplicated block id: 14
size: 19 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (197:219)
 - pytorch_transformers/tokenization_roberta.py (182:204)

duplicated block id: 15
size: 19 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (197:219)
 - pytorch_transformers/tokenization_openai.py (186:208)

duplicated block id: 16
size: 18 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_openai.py (48:75)
 - pytorch_transformers/tokenization_xlm.py (69:96)

duplicated block id: 17
size: 17 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (708:727)
 - pytorch_transformers/modeling_openai.py (701:720)

duplicated block id: 18
size: 16 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (598:626)
 - pytorch_transformers/modeling_transfo_xl.py (690:717)

duplicated block id: 19
size: 15 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (294:312)
 - pytorch_transformers/modeling_xlnet.py (315:333)

duplicated block id: 20
size: 15 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_distilbert.py (178:194)
 - pytorch_transformers/modeling_xlm.py (269:285)

duplicated block id: 21
size: 13 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (170:182)
 - pytorch_transformers/modeling_openai.py (185:197)

duplicated block id: 22
size: 13 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (17:45)
 - pytorch_transformers/tokenization_roberta.py (17:46)

duplicated block id: 23
size: 13 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (477:495)
 - pytorch_transformers/modeling_openai.py (483:501)

duplicated block id: 24
size: 12 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_xlm.py (840:856)
 - pytorch_transformers/modeling_xlnet.py (1141:1157)

duplicated block id: 25
size: 12 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (596:614)
 - pytorch_transformers/modeling_openai.py (589:606)

duplicated block id: 26
size: 12 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (386:401)
 - pytorch_transformers/modeling_transfo_xl.py (475:490)

duplicated block id: 27
size: 11 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (983:997)
 - pytorch_transformers/modeling_xlnet.py (1143:1157)

duplicated block id: 28
size: 11 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (85:95)
 - pytorch_transformers/modeling_openai.py (98:108)

duplicated block id: 29
size: 11 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (983:997)
 - pytorch_transformers/modeling_xlm.py (842:856)

duplicated block id: 30
size: 10 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_openai.py (186:198)
 - pytorch_transformers/tokenization_xlm.py (238:250)

duplicated block id: 31
size: 10 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (91:102)
 - pytorch_transformers/modeling_openai.py (109:120)

duplicated block id: 32
size: 10 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (425:438)
 - pytorch_transformers/modeling_transfo_xl.py (680:694)

duplicated block id: 33
size: 10 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_openai.py (93:105)
 - pytorch_transformers/tokenization_xlm.py (129:141)

duplicated block id: 34
size: 10 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (197:209)
 - pytorch_transformers/tokenization_xlm.py (238:250)

duplicated block id: 35
size: 10 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_roberta.py (182:194)
 - pytorch_transformers/tokenization_xlm.py (238:250)

duplicated block id: 36
size: 10 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (981:993)
 - pytorch_transformers/modeling_roberta.py (323:334)

duplicated block id: 37
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_roberta.py (324:334)
 - pytorch_transformers/modeling_xlm.py (842:852)

duplicated block id: 38
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (126:136)
 - pytorch_transformers/modeling_openai.py (109:119)

duplicated block id: 39
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (126:136)
 - pytorch_transformers/modeling_gpt2.py (91:101)

duplicated block id: 40
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (316:327)
 - pytorch_transformers/modeling_openai.py (328:339)

duplicated block id: 41
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/convert_gpt2_checkpoint_to_pytorch.py (45:55)
 - pytorch_transformers/convert_openai_checkpoint_to_pytorch.py (45:55)

duplicated block id: 42
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_openai.py (17:37)
 - pytorch_transformers/tokenization_xlm.py (17:37)

duplicated block id: 43
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/convert_gpt2_checkpoint_to_pytorch.py (58:66)
 - pytorch_transformers/convert_openai_checkpoint_to_pytorch.py (58:66)

duplicated block id: 44
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/convert_roberta_checkpoint_to_pytorch.py (163:171)
 - pytorch_transformers/convert_xlm_checkpoint_to_pytorch.py (65:73)

duplicated block id: 45
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (1123:1131)
 - pytorch_transformers/modeling_xlnet.py (948:956)

duplicated block id: 46
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_distilbert.py (114:122)
 - pytorch_transformers/modeling_xlm.py (204:212)

duplicated block id: 47
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_roberta.py (324:334)
 - pytorch_transformers/modeling_xlnet.py (1143:1153)

duplicated block id: 48
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (708:716)
 - pytorch_transformers/modeling_distilbert.py (527:535)

duplicated block id: 49
size: 9 cleaned lines of code
in 2 files:
 - pytorch_transformers/convert_transfo_xl_checkpoint_to_pytorch.py (84:94)
 - pytorch_transformers/convert_xlnet_checkpoint_to_pytorch.py (66:76)

duplicated block id: 50
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (81:89)
 - pytorch_transformers/modeling_gpt2.py (59:67)

duplicated block id: 51
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_roberta.py (196:204)
 - pytorch_transformers/tokenization_xlm.py (251:259)

duplicated block id: 52
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (248:255)
 - pytorch_transformers/modeling_xlnet.py (271:278)

duplicated block id: 53
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (211:219)
 - pytorch_transformers/tokenization_xlm.py (251:259)

duplicated block id: 54
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_openai.py (28:37)
 - pytorch_transformers/tokenization_roberta.py (37:46)

duplicated block id: 55
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (665:678)
 - pytorch_transformers/modeling_distilbert.py (500:513)

duplicated block id: 56
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_roberta.py (37:46)
 - pytorch_transformers/tokenization_xlm.py (28:37)

duplicated block id: 57
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (357:368)
 - pytorch_transformers/modeling_openai.py (369:380)

duplicated block id: 58
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_openai.py (200:208)
 - pytorch_transformers/tokenization_xlm.py (251:259)

duplicated block id: 59
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (36:45)
 - pytorch_transformers/tokenization_xlm.py (28:37)

duplicated block id: 60
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (36:45)
 - pytorch_transformers/tokenization_openai.py (28:37)

duplicated block id: 61
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (141:148)
 - pytorch_transformers/modeling_openai.py (173:180)

duplicated block id: 62
size: 8 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (198:205)
 - pytorch_transformers/modeling_distilbert.py (73:80)

duplicated block id: 63
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (91:97)
 - pytorch_transformers/modeling_xlnet.py (164:170)

duplicated block id: 64
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_bert.py (170:186)
 - pytorch_transformers/tokenization_xlm.py (220:236)

duplicated block id: 65
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (126:132)
 - pytorch_transformers/modeling_transfo_xl.py (163:169)

duplicated block id: 66
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_openai.py (109:115)
 - pytorch_transformers/modeling_xlnet.py (164:170)

duplicated block id: 67
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (557:563)
 - pytorch_transformers/modeling_transfo_xl.py (645:652)

duplicated block id: 68
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (126:132)
 - pytorch_transformers/modeling_xlnet.py (164:170)

duplicated block id: 69
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_distilbert.py (73:79)
 - pytorch_transformers/modeling_xlnet.py (271:277)

duplicated block id: 70
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (198:204)
 - pytorch_transformers/modeling_xlnet.py (271:277)

duplicated block id: 71
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/convert_tf_checkpoint_to_pytorch.py (43:50)
 - pytorch_transformers/convert_xlnet_checkpoint_to_pytorch.py (75:82)

duplicated block id: 72
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (72:78)
 - pytorch_transformers/modeling_openai.py (86:92)

duplicated block id: 73
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (338:345)
 - pytorch_transformers/modeling_bert.py (397:404)

duplicated block id: 74
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (87:97)
 - pytorch_transformers/tokenization_openai.py (50:60)

duplicated block id: 75
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_distilbert.py (73:79)
 - pytorch_transformers/modeling_xlm.py (142:148)

duplicated block id: 76
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (306:314)
 - pytorch_transformers/modeling_openai.py (318:326)

duplicated block id: 77
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_openai.py (109:115)
 - pytorch_transformers/modeling_transfo_xl.py (163:169)

duplicated block id: 78
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (248:254)
 - pytorch_transformers/modeling_xlm.py (142:148)

duplicated block id: 79
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (198:204)
 - pytorch_transformers/modeling_transfo_xl.py (248:254)

duplicated block id: 80
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_distilbert.py (73:79)
 - pytorch_transformers/modeling_transfo_xl.py (248:254)

duplicated block id: 81
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_xlm.py (142:148)
 - pytorch_transformers/modeling_xlnet.py (271:277)

duplicated block id: 82
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/__main__.py (47:54)
 - pytorch_transformers/__main__.py (71:79)

duplicated block id: 83
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_xlnet.py (1058:1064)
 - pytorch_transformers/modeling_xlnet.py (1129:1135)

duplicated block id: 84
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (1017:1023)
 - pytorch_transformers/modeling_transfo_xl.py (1028:1034)

duplicated block id: 85
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (198:204)
 - pytorch_transformers/modeling_xlm.py (142:148)

duplicated block id: 86
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/tokenization_gpt2.py (87:97)
 - pytorch_transformers/tokenization_xlm.py (71:81)

duplicated block id: 87
size: 7 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (91:97)
 - pytorch_transformers/modeling_transfo_xl.py (163:169)

duplicated block id: 88
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_xlm.py (177:183)
 - pytorch_transformers/modeling_xlnet.py (305:311)

duplicated block id: 89
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (776:786)
 - pytorch_transformers/modeling_bert.py (844:854)

duplicated block id: 90
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (862:868)
 - pytorch_transformers/modeling_roberta.py (239:246)

duplicated block id: 91
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_openai.py (226:232)
 - pytorch_transformers/modeling_xlnet.py (327:333)

duplicated block id: 92
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_openai.py (226:232)
 - pytorch_transformers/modeling_transfo_xl.py (306:312)

duplicated block id: 93
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (549:554)
 - pytorch_transformers/modeling_transfo_xl.py (639:644)

duplicated block id: 94
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_transfo_xl.py (136:141)
 - pytorch_transformers/modeling_xlnet.py (130:135)

duplicated block id: 95
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/__main__.py (15:21)
 - pytorch_transformers/__main__.py (47:53)

duplicated block id: 96
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/__main__.py (15:21)
 - pytorch_transformers/__main__.py (71:77)

duplicated block id: 97
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/__main__.py (15:21)
 - pytorch_transformers/__main__.py (91:97)

duplicated block id: 98
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (209:215)
 - pytorch_transformers/modeling_xlnet.py (327:333)

duplicated block id: 99
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_xlm.py (775:781)
 - pytorch_transformers/modeling_xlm.py (831:837)

duplicated block id: 100
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (224:230)
 - pytorch_transformers/modeling_openai.py (238:244)

duplicated block id: 101
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/__main__.py (71:77)
 - pytorch_transformers/__main__.py (91:97)

duplicated block id: 102
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_bert.py (234:240)
 - pytorch_transformers/modeling_xlnet.py (347:353)

duplicated block id: 103
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/__main__.py (47:53)
 - pytorch_transformers/__main__.py (91:97)

duplicated block id: 104
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_utils.py (174:179)
 - pytorch_transformers/modeling_utils.py (480:485)

duplicated block id: 105
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_gpt2.py (209:215)
 - pytorch_transformers/modeling_transfo_xl.py (306:312)

duplicated block id: 106
size: 6 cleaned lines of code
in 2 files:
 - pytorch_transformers/modeling_distilbert.py (101:107)
 - pytorch_transformers/modeling_xlm.py (195:201)