duplicated block id: 1 size: 139 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 2 size: 96 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 3 size: 102 cleaned lines of code in 2 files: - xlm/slurm.py (0:0) - src/slurm.py (0:0) duplicated block id: 4 size: 81 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 5 size: 87 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 6 size: 86 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 7 size: 82 cleaned lines of code in 2 files: - xlm/data/loader.py (0:0) - src/data/loader.py (0:0) duplicated block id: 8 size: 67 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 9 size: 81 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 10 size: 68 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 11 size: 61 cleaned lines of code in 2 files: - xlm/evaluation/glue.py (0:0) - src/evaluation/glue.py (0:0) duplicated block id: 12 size: 58 cleaned lines of code in 2 files: - xlm/data/dictionary.py (0:0) - src/data/dictionary.py (0:0) duplicated block id: 13 size: 56 cleaned lines of code in 2 files: - xlm/optim.py (0:0) - src/optim.py (0:0) duplicated block id: 14 size: 63 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 15 size: 59 cleaned lines of code in 2 files: - xlm/model/__init__.py (0:0) - src/model/__init__.py (0:0) duplicated block id: 16 size: 66 cleaned lines of code in 2 files: - xlm/model/__init__.py (0:0) - src/model/__init__.py (0:0) duplicated block id: 17 size: 58 cleaned lines of code in 2 files: - xlm/evaluation/glue.py (0:0) - src/evaluation/glue.py (0:0) duplicated block id: 18 size: 58 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 19 size: 71 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 20 size: 54 cleaned lines of code in 2 files: - xlm/evaluation/xnli.py (0:0) - src/evaluation/xnli.py (0:0) duplicated block id: 21 size: 55 cleaned lines of code in 2 files: - xlm/evaluation/glue.py (0:0) - src/evaluation/glue.py (0:0) duplicated block id: 22 size: 54 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 23 size: 46 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 24 size: 45 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 25 size: 51 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 26 size: 39 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 27 size: 45 cleaned lines of code in 2 files: - xlm/data/loader.py (0:0) - src/data/loader.py (0:0) duplicated block id: 28 size: 38 cleaned lines of code in 2 files: - xlm/data/dictionary.py (0:0) - src/data/dictionary.py (0:0) duplicated block id: 29 size: 39 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 30 size: 43 cleaned lines of code in 2 files: - xlm/data/loader.py (0:0) - src/data/loader.py (0:0) duplicated block id: 31 size: 39 cleaned lines of code in 2 files: - xlm/evaluation/xnli.py (0:0) - src/evaluation/xnli.py (0:0) duplicated block id: 32 size: 43 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 33 size: 35 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 34 size: 33 cleaned lines of code in 2 files: - xlm/model/pretrain.py (0:0) - src/model/pretrain.py (0:0) duplicated block id: 35 size: 35 cleaned lines of code in 2 files: - xlm/model/embedder.py (0:0) - src/model/embedder.py (0:0) duplicated block id: 36 size: 35 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 37 size: 31 cleaned lines of code in 2 files: - xlm/data/loader.py (0:0) - src/data/loader.py (0:0) duplicated block id: 38 size: 41 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 39 size: 40 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 40 size: 38 cleaned lines of code in 2 files: - xlm/evaluation/glue.py (0:0) - src/evaluation/glue.py (0:0) duplicated block id: 41 size: 37 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 42 size: 35 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 43 size: 33 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 44 size: 32 cleaned lines of code in 2 files: - xlm/evaluation/xnli.py (0:0) - src/evaluation/xnli.py (0:0) duplicated block id: 45 size: 31 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 46 size: 33 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 47 size: 27 cleaned lines of code in 2 files: - xlm/data/loader.py (0:0) - src/data/loader.py (0:0) duplicated block id: 48 size: 31 cleaned lines of code in 2 files: - xlm/optim.py (0:0) - src/optim.py (0:0) duplicated block id: 49 size: 26 cleaned lines of code in 2 files: - xlm/model/memory/query.py (0:0) - src/model/memory/query.py (0:0) duplicated block id: 50 size: 29 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 51 size: 34 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 52 size: 30 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 53 size: 28 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 54 size: 28 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 55 size: 33 cleaned lines of code in 2 files: - xlm/evaluation/xnli.py (0:0) - src/evaluation/xnli.py (0:0) duplicated block id: 56 size: 32 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 57 size: 25 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 58 size: 30 cleaned lines of code in 2 files: - xlm/logger.py (0:0) - src/logger.py (0:0) duplicated block id: 59 size: 31 cleaned lines of code in 2 files: - xlm/model/memory/utils.py (0:0) - src/model/memory/utils.py (0:0) duplicated block id: 60 size: 28 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 61 size: 24 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 62 size: 27 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 63 size: 24 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 64 size: 23 cleaned lines of code in 2 files: - xlm/optim.py (0:0) - src/optim.py (0:0) duplicated block id: 65 size: 23 cleaned lines of code in 2 files: - xlm/model/memory/utils.py (0:0) - src/model/memory/utils.py (0:0) duplicated block id: 66 size: 25 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 67 size: 28 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 68 size: 23 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 69 size: 23 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 70 size: 20 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 71 size: 25 cleaned lines of code in 2 files: - xlm/model/embedder.py (0:0) - src/model/embedder.py (0:0) duplicated block id: 72 size: 23 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 73 size: 21 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 74 size: 20 cleaned lines of code in 2 files: - xlm/optim.py (0:0) - src/optim.py (0:0) duplicated block id: 75 size: 20 cleaned lines of code in 2 files: - xlm/model/memory/query.py (0:0) - src/model/memory/query.py (0:0) duplicated block id: 76 size: 19 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 77 size: 16 cleaned lines of code in 2 files: - xlm/optim.py (0:0) - src/optim.py (0:0) duplicated block id: 78 size: 16 cleaned lines of code in 2 files: - xlm/optim.py (0:0) - src/optim.py (0:0) duplicated block id: 79 size: 15 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 80 size: 18 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 81 size: 18 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 82 size: 18 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 83 size: 21 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 84 size: 14 cleaned lines of code in 2 files: - xlm/model/memory/query.py (0:0) - src/model/memory/query.py (0:0) duplicated block id: 85 size: 17 cleaned lines of code in 2 files: - xlm/data/dictionary.py (0:0) - src/data/dictionary.py (0:0) duplicated block id: 86 size: 19 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 87 size: 16 cleaned lines of code in 2 files: - xlm/model/memory/query.py (0:0) - src/model/memory/query.py (0:0) duplicated block id: 88 size: 16 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 89 size: 16 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 90 size: 13 cleaned lines of code in 2 files: - xlm/evaluation/multi-bleu.perl (42:55) - src/evaluation/multi-bleu.perl (42:55) duplicated block id: 91 size: 16 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 92 size: 16 cleaned lines of code in 2 files: - xlm/data/loader.py (0:0) - src/data/loader.py (0:0) duplicated block id: 93 size: 18 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 94 size: 15 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 95 size: 23 cleaned lines of code in 2 files: - xlm/data/loader.py (0:0) - src/data/loader.py (0:0) duplicated block id: 96 size: 14 cleaned lines of code in 2 files: - xlm/model/__init__.py (0:0) - src/model/__init__.py (0:0) duplicated block id: 97 size: 16 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 98 size: 15 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 99 size: 17 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 100 size: 14 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 101 size: 14 cleaned lines of code in 2 files: - xlm/model/pretrain.py (0:0) - src/model/pretrain.py (0:0) duplicated block id: 102 size: 13 cleaned lines of code in 2 files: - xlm/model/memory/query.py (0:0) - src/model/memory/query.py (0:0) duplicated block id: 103 size: 10 cleaned lines of code in 2 files: - xlm/model/memory/query.py (0:0) - src/model/memory/query.py (0:0) duplicated block id: 104 size: 10 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 105 size: 14 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 106 size: 13 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 107 size: 13 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 108 size: 13 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 109 size: 9 cleaned lines of code in 2 files: - xlm/slurm.py (0:0) - src/slurm.py (0:0) duplicated block id: 110 size: 9 cleaned lines of code in 2 files: - xlm/logger.py (0:0) - src/logger.py (0:0) duplicated block id: 111 size: 12 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 112 size: 9 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 113 size: 12 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 114 size: 13 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 115 size: 15 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 116 size: 12 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 117 size: 9 cleaned lines of code in 2 files: - xlm/data/dictionary.py (0:0) - src/data/dictionary.py (0:0) duplicated block id: 118 size: 11 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 119 size: 8 cleaned lines of code in 2 files: - xlm/model/memory/query.py (0:0) - src/model/memory/query.py (0:0) duplicated block id: 120 size: 8 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 121 size: 11 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 122 size: 12 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 123 size: 14 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 124 size: 11 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 125 size: 11 cleaned lines of code in 2 files: - xlm/data/dictionary.py (0:0) - src/data/dictionary.py (0:0) duplicated block id: 126 size: 11 cleaned lines of code in 2 files: - xlm/data/dictionary.py (0:0) - src/data/dictionary.py (0:0) duplicated block id: 127 size: 7 cleaned lines of code in 2 files: - xlm/model/memory/query.py (0:0) - src/model/memory/query.py (0:0) duplicated block id: 128 size: 7 cleaned lines of code in 2 files: - xlm/model/memory/query.py (0:0) - src/model/memory/query.py (0:0) duplicated block id: 129 size: 14 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 130 size: 12 cleaned lines of code in 2 files: - xlm/model/memory/utils.py (0:0) - src/model/memory/utils.py (0:0) duplicated block id: 131 size: 15 cleaned lines of code in 2 files: - xlm/model/memory/utils.py (0:0) - src/model/memory/utils.py (0:0) duplicated block id: 132 size: 10 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 133 size: 9 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 134 size: 9 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 135 size: 9 cleaned lines of code in 2 files: - xlm/model/pretrain.py (0:0) - src/model/pretrain.py (0:0) duplicated block id: 136 size: 9 cleaned lines of code in 2 files: - xlm/model/memory/utils.py (0:0) - src/model/memory/utils.py (0:0) duplicated block id: 137 size: 10 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 138 size: 9 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 139 size: 10 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 140 size: 10 cleaned lines of code in 2 files: - xlm/model/embedder.py (0:0) - src/model/embedder.py (0:0) duplicated block id: 141 size: 9 cleaned lines of code in 2 files: - xlm/evaluation/xnli.py (0:0) - src/evaluation/xnli.py (0:0) duplicated block id: 142 size: 12 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 143 size: 7 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 144 size: 9 cleaned lines of code in 2 files: - xlm/model/memory/memory.py (0:0) - src/model/memory/memory.py (0:0) duplicated block id: 145 size: 8 cleaned lines of code in 2 files: - xlm/model/memory/utils.py (0:0) - src/model/memory/utils.py (0:0) duplicated block id: 146 size: 15 cleaned lines of code in 2 files: - xlm/model/embedder.py (0:0) - src/model/embedder.py (0:0) duplicated block id: 147 size: 8 cleaned lines of code in 2 files: - xlm/evaluation/glue.py (0:0) - src/evaluation/glue.py (0:0) duplicated block id: 148 size: 6 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 149 size: 8 cleaned lines of code in 2 files: - xlm/data/dataset.py (0:0) - src/data/dataset.py (0:0) duplicated block id: 150 size: 8 cleaned lines of code in 2 files: - xlm/data/dictionary.py (0:0) - src/data/dictionary.py (0:0) duplicated block id: 151 size: 7 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 152 size: 7 cleaned lines of code in 2 files: - xlm/model/pretrain.py (0:0) - src/model/pretrain.py (0:0) duplicated block id: 153 size: 7 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 154 size: 7 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 155 size: 7 cleaned lines of code in 2 files: - xlm/trainer.py (0:0) - src/trainer.py (0:0) duplicated block id: 156 size: 7 cleaned lines of code in 2 files: - xlm/data/dictionary.py (0:0) - src/data/dictionary.py (0:0) duplicated block id: 157 size: 6 cleaned lines of code in 2 files: - xlm/slurm.py (0:0) - src/slurm.py (0:0) duplicated block id: 158 size: 6 cleaned lines of code in 2 files: - xlm/utils.py (0:0) - src/utils.py (0:0) duplicated block id: 159 size: 10 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0) duplicated block id: 160 size: 7 cleaned lines of code in 2 files: - xlm/evaluation/xnli.py (0:0) - src/evaluation/xnli.py (0:0) duplicated block id: 161 size: 7 cleaned lines of code in 2 files: - xlm/evaluation/glue.py (0:0) - src/evaluation/glue.py (0:0) duplicated block id: 162 size: 6 cleaned lines of code in 2 files: - xlm/evaluation/evaluator.py (0:0) - src/evaluation/evaluator.py (0:0) duplicated block id: 163 size: 8 cleaned lines of code in 2 files: - xlm/model/transformer.py (0:0) - src/model/transformer.py (0:0)