duplicated block id: 1
size: 101 cleaned lines of code
in 2 files:
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 2
size: 50 cleaned lines of code
in 2 files:
 - code/run_squad.py (0:0)
 - code/run_mrqa.py (0:0)

duplicated block id: 3
size: 56 cleaned lines of code
in 2 files:
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 4
size: 19 cleaned lines of code
in 2 files:
 - pretraining/fairseq/data/no_nsp_span_bert_dataset.py (0:0)
 - pretraining/fairseq/data/span_bert_dataset.py (0:0)

duplicated block id: 5
size: 18 cleaned lines of code
in 2 files:
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 6
size: 17 cleaned lines of code
in 2 files:
 - code/run_squad.py (0:0)
 - code/run_mrqa.py (0:0)

duplicated block id: 7
size: 16 cleaned lines of code
in 2 files:
 - code/run_squad.py (0:0)
 - code/run_mrqa.py (0:0)

duplicated block id: 8
size: 14 cleaned lines of code
in 2 files:
 - code/run_squad.py (0:0)
 - code/run_mrqa.py (0:0)

duplicated block id: 9
size: 14 cleaned lines of code
in 2 files:
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 10
size: 14 cleaned lines of code
in 2 files:
 - pretraining/fairseq/data/masking.py (0:0)
 - pretraining/fairseq/data/masking.py (0:0)

duplicated block id: 11
size: 13 cleaned lines of code
in 2 files:
 - code/pytorch_pretrained_bert/optimization.py (0:0)
 - pretraining/fairseq/optim/bert_adam.py (0:0)

duplicated block id: 12
size: 13 cleaned lines of code
in 2 files:
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 13
size: 12 cleaned lines of code
in 2 files:
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 14
size: 12 cleaned lines of code
in 2 files:
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 15
size: 11 cleaned lines of code
in 2 files:
 - code/run_glue.py (0:0)
 - code/run_glue.py (0:0)

duplicated block id: 16
size: 11 cleaned lines of code
in 2 files:
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 17
size: 11 cleaned lines of code
in 2 files:
 - pretraining/fairseq/modules/multihead_attention.py (0:0)
 - pretraining/fairseq/modules/bidirectional_multihead_attention.py (0:0)

duplicated block id: 18
size: 11 cleaned lines of code
in 2 files:
 - pretraining/fairseq/modules/adaptive_input.py (0:0)
 - pretraining/fairseq/modules/adaptive_inputs.py (0:0)

duplicated block id: 19
size: 11 cleaned lines of code
in 2 files:
 - pretraining/fairseq/data/no_nsp_span_bert_dataset.py (0:0)
 - pretraining/fairseq/data/span_bert_dataset.py (0:0)

duplicated block id: 20
size: 9 cleaned lines of code
in 2 files:
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 21
size: 8 cleaned lines of code
in 3 files:
 - code/pytorch_pretrained_bert/modeling.py (0:0)
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 22
size: 9 cleaned lines of code
in 2 files:
 - code/run_squad.py (0:0)
 - code/run_mrqa.py (0:0)

duplicated block id: 23
size: 9 cleaned lines of code
in 3 files:
 - code/pytorch_pretrained_bert/modeling.py (0:0)
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 24
size: 8 cleaned lines of code
in 2 files:
 - code/run_squad.py (0:0)
 - code/run_mrqa.py (0:0)

duplicated block id: 25
size: 11 cleaned lines of code
in 2 files:
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 26
size: 7 cleaned lines of code
in 2 files:
 - pretraining/fairseq/modules/adaptive_input.py (0:0)
 - pretraining/fairseq/modules/adaptive_inputs.py (0:0)

duplicated block id: 27
size: 11 cleaned lines of code
in 2 files:
 - pretraining/fairseq/optim/nag.py (0:0)
 - pretraining/fairseq/optim/sgd.py (0:0)

duplicated block id: 28
size: 7 cleaned lines of code
in 2 files:
 - pretraining/fairseq/data/no_nsp_span_bert_dataset.py (0:0)
 - pretraining/fairseq/data/span_bert_dataset.py (0:0)

duplicated block id: 29
size: 6 cleaned lines of code
in 3 files:
 - code/pytorch_pretrained_bert/modeling.py (0:0)
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 30
size: 6 cleaned lines of code
in 2 files:
 - pretraining/fairseq/models/hf_bert.py (0:0)
 - pretraining/fairseq/models/pair_bert.py (0:0)

duplicated block id: 31
size: 7 cleaned lines of code
in 2 files:
 - pretraining/fairseq/data/no_nsp_span_bert_dataset.py (0:0)
 - pretraining/fairseq/data/span_bert_dataset.py (0:0)