duplicated block id: 1
size: 21 cleaned lines of code
in 2 files:
 - learning/batchifier.py (201:224)
 - learning/batchifier.py (372:395)

duplicated block id: 2
size: 20 cleaned lines of code
in 2 files:
 - extraction/TypeSystemToNeuralTypeSystem.ipynb (233:252)
 - learning/SentencePredictions.ipynb (277:296)

duplicated block id: 3
size: 19 cleaned lines of code
in 2 files:
 - extraction/evaluate_type_system.py (326:346)
 - extraction/produce_wikidata_tsv.py (261:280)

duplicated block id: 4
size: 16 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (423:439)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (615:631)

duplicated block id: 5
size: 15 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (289:303)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (615:629)

duplicated block id: 6
size: 15 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (289:303)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (423:437)

duplicated block id: 7
size: 12 cleaned lines of code
in 2 files:
 - learning/train_type.py (2396:2407)
 - learning/train_type.py (2414:2425)

duplicated block id: 8
size: 11 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (644:654)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (663:673)

duplicated block id: 9
size: 10 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (954:963)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (1039:1048)

duplicated block id: 10
size: 9 cleaned lines of code
in 2 files:
 - extraction/TypeSystemToNeuralTypeSystem.ipynb (186:194)
 - extraction/TypeSystemToNeuralTypeSystem.ipynb (225:233)

duplicated block id: 11
size: 9 cleaned lines of code
in 2 files:
 - extraction/get_redirection_category_links.py (37:46)
 - extraction/get_redirection_category_links.py (60:69)

duplicated block id: 12
size: 9 cleaned lines of code
in 2 files:
 - learning/dataset.py (102:110)
 - learning/dataset.py (158:166)

duplicated block id: 13
size: 9 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (920:929)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (1004:1013)

duplicated block id: 14
size: 9 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (234:242)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (480:488)

duplicated block id: 15
size: 9 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (966:974)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (1054:1062)

duplicated block id: 16
size: 8 cleaned lines of code
in 2 files:
 - extraction/evaluate_type_system.py (444:453)
 - extraction/project_graph.py (173:183)

duplicated block id: 17
size: 8 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (127:134)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (255:262)

duplicated block id: 18
size: 8 cleaned lines of code
in 2 files:
 - extraction/classifiers/country_classifier.py (32:39)
 - extraction/classifiers/location_classifier.py (62:69)

duplicated block id: 19
size: 8 cleaned lines of code
in 2 files:
 - extraction/produce_wikidata_tsv.py (116:123)
 - extraction/produce_wikidata_tsv.py (198:205)

duplicated block id: 20
size: 8 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (945:952)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (1030:1037)

duplicated block id: 21
size: 8 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (347:354)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (711:721)

duplicated block id: 22
size: 7 cleaned lines of code
in 2 files:
 - extraction/produce_wikidata_tsv.py (198:204)
 - extraction/produce_wikidata_tsv.py (218:224)

duplicated block id: 23
size: 7 cleaned lines of code
in 2 files:
 - extraction/classifiers/location_classifier.py (6:22)
 - extraction/classifiers/time_classifier.py (6:22)

duplicated block id: 24
size: 7 cleaned lines of code
in 2 files:
 - learning/batchifier.py (409:415)
 - learning/batchifier.py (530:536)

duplicated block id: 25
size: 7 cleaned lines of code
in 2 files:
 - extraction/produce_wikidata_tsv.py (116:122)
 - extraction/produce_wikidata_tsv.py (218:224)

duplicated block id: 26
size: 7 cleaned lines of code
in 2 files:
 - learning/train_type.py (2138:2144)
 - learning/train_type.py (2306:2312)

duplicated block id: 27
size: 7 cleaned lines of code
in 2 files:
 - extraction/classifiers/country_classifier.py (6:21)
 - extraction/classifiers/location_classifier.py (6:22)

duplicated block id: 28
size: 7 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (476:482)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (584:590)

duplicated block id: 29
size: 7 cleaned lines of code
in 2 files:
 - extraction/classifiers/country_classifier.py (6:21)
 - extraction/classifiers/time_classifier.py (6:22)

duplicated block id: 30
size: 6 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (585:590)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (664:669)

duplicated block id: 31
size: 6 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (477:482)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (664:669)

duplicated block id: 32
size: 6 cleaned lines of code
in 2 files:
 - learning/batchifier.py (468:473)
 - learning/batchifier.py (503:508)

duplicated block id: 33
size: 6 cleaned lines of code
in 2 files:
 - extraction/evaluate_type_system.py (184:189)
 - extraction/produce_wikidata_tsv.py (219:224)

duplicated block id: 34
size: 6 cleaned lines of code
in 2 files:
 - learning/train_type.py (1101:1106)
 - learning/train_type.py (1177:1182)

duplicated block id: 35
size: 6 cleaned lines of code
in 2 files:
 - extraction/TypeSystemToNeuralTypeSystem.ipynb (16:21)
 - learning/SentencePredictions.ipynb (166:171)

duplicated block id: 36
size: 6 cleaned lines of code
in 2 files:
 - extraction/evaluate_type_system.py (184:189)
 - extraction/produce_wikidata_tsv.py (117:122)

duplicated block id: 37
size: 6 cleaned lines of code
in 2 files:
 - learning/SentencePredictions.ipynb (179:184)
 - learning/SentencePredictions.ipynb (228:233)

duplicated block id: 38
size: 6 cleaned lines of code
in 2 files:
 - extraction/evaluate_type_system.py (184:189)
 - extraction/produce_wikidata_tsv.py (199:204)

duplicated block id: 39
size: 6 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (57:62)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (956:961)

duplicated block id: 40
size: 6 cleaned lines of code
in 2 files:
 - learning/batchifier.py (428:433)
 - learning/batchifier.py (489:494)

duplicated block id: 41
size: 6 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (57:62)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/successor_mask.pyx (1041:1046)

duplicated block id: 42
size: 6 cleaned lines of code
in 2 files:
 - learning/SentencePredictions.ipynb (27:32)
 - learning/SentencePredictions.ipynb (191:196)

duplicated block id: 43
size: 6 cleaned lines of code
in 2 files:
 - learning/train_type.py (2418:2423)
 - learning/train_type.py (2468:2473)

duplicated block id: 44
size: 6 cleaned lines of code
in 2 files:
 - extraction/TypeSystemToNeuralTypeSystem.ipynb (16:21)
 - learning/SentencePredictions.ipynb (191:196)

duplicated block id: 45
size: 6 cleaned lines of code
in 2 files:
 - extraction/TypeSystemToNeuralTypeSystem.ipynb (16:21)
 - learning/SentencePredictions.ipynb (27:32)

duplicated block id: 46
size: 6 cleaned lines of code
in 2 files:
 - learning/train_type.py (2400:2405)
 - learning/train_type.py (2468:2473)

duplicated block id: 47
size: 6 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (251:256)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (495:500)

duplicated block id: 48
size: 6 cleaned lines of code
in 2 files:
 - learning/train_type.py (645:650)
 - learning/train_type.py (655:660)

duplicated block id: 49
size: 6 cleaned lines of code
in 2 files:
 - learning/SentencePredictions.ipynb (166:171)
 - learning/SentencePredictions.ipynb (191:196)

duplicated block id: 50
size: 6 cleaned lines of code
in 2 files:
 - extraction/TypeSystemToNeuralTypeSystem.ipynb (205:210)
 - learning/SentencePredictions.ipynb (228:233)

duplicated block id: 51
size: 6 cleaned lines of code
in 2 files:
 - learning/SentencePredictions.ipynb (27:32)
 - learning/SentencePredictions.ipynb (166:171)

duplicated block id: 52
size: 6 cleaned lines of code
in 2 files:
 - extraction/evolve_type_system.py (61:66)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (57:62)

duplicated block id: 53
size: 6 cleaned lines of code
in 2 files:
 - extraction/evolve_type_system.py (203:208)
 - extraction/evolve_type_system.py (214:219)

duplicated block id: 54
size: 6 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (477:482)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (645:650)

duplicated block id: 55
size: 6 cleaned lines of code
in 2 files:
 - extraction/TypeSystemToNeuralTypeSystem.ipynb (56:61)
 - extraction/TypeSystemToNeuralTypeSystem.ipynb (123:128)

duplicated block id: 56
size: 6 cleaned lines of code
in 2 files:
 - extraction/TypeSystemToNeuralTypeSystem.ipynb (205:210)
 - learning/SentencePredictions.ipynb (179:184)

duplicated block id: 57
size: 6 cleaned lines of code
in 2 files:
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (585:590)
 - wikidata_linker_utils_src/src/cython/wikidata_linker_utils/fast_disambiguate.pyx (645:650)