duplicated block id: 1 size: 1324 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (37:1920) - visual_bert/modeling_frcnn.py (37:1920) duplicated block id: 2 size: 440 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (33:500) - visual_bert/visualizing_image.py (33:500) duplicated block id: 3 size: 399 cleaned lines of code in 2 files: - lxmert/utils.py (47:554) - visual_bert/utils.py (47:554) duplicated block id: 4 size: 261 cleaned lines of code in 2 files: - rag-end2end-retriever/eval_rag.py (17:320) - rag/eval_rag.py (17:320) duplicated block id: 5 size: 212 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (122:386) - tapex/run_wikitablequestions_with_tapex.py (120:384) duplicated block id: 6 size: 171 cleaned lines of code in 2 files: - rag-end2end-retriever/utils_rag.py (21:244) - rag/utils_rag.py (21:244) duplicated block id: 7 size: 127 cleaned lines of code in 2 files: - rag/lightning_base.py (11:168) - seq2seq-distillation/lightning_base.py (11:168) duplicated block id: 8 size: 109 cleaned lines of code in 2 files: - lxmert/extracting_data.py (24:147) - visual_bert/extracting_data.py (24:147) duplicated block id: 9 size: 103 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (426:550) - tapex/run_wikitablequestions_with_tapex.py (402:526) duplicated block id: 10 size: 100 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (11:134) - seq2seq-distillation/lightning_base.py (11:134) duplicated block id: 11 size: 100 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (11:134) - rag/lightning_base.py (11:134) duplicated block id: 12 size: 95 cleaned lines of code in 2 files: - lxmert/processing_image.py (31:151) - visual_bert/processing_image.py (31:151) duplicated block id: 13 size: 88 cleaned lines of code in 2 files: - rag/lightning_base.py (172:266) - seq2seq-distillation/lightning_base.py (172:266) duplicated block id: 14 size: 79 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (59:155) - robust-speech-event/run_speech_recognition_ctc_streaming.py (58:154) duplicated block id: 15 size: 77 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (652:735) - movement-pruning/masked_run_squad.py (770:853) duplicated block id: 16 size: 75 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (554:649) - tapex/run_wikitablequestions_with_tapex.py (530:625) duplicated block id: 17 size: 75 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (539:617) - movement-pruning/masked_run_squad.py (682:760) duplicated block id: 18 size: 75 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (138:227) - rag/lightning_base.py (136:225) duplicated block id: 19 size: 73 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (502:574) - rag/finetune_rag.py (378:450) duplicated block id: 20 size: 73 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (106:196) - movement-pruning/masked_run_squad.py (113:203) duplicated block id: 21 size: 67 cleaned lines of code in 2 files: - seq2seq-distillation/_test_seq2seq_examples.py (29:97) - seq2seq-distillation/_test_seq2seq_examples_multi_gpu.py (16:84) duplicated block id: 22 size: 66 cleaned lines of code in 2 files: - rag/lightning_base.py (278:354) - seq2seq-distillation/lightning_base.py (269:345) duplicated block id: 23 size: 61 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (414:487) - rag/finetune_rag.py (301:374) duplicated block id: 24 size: 61 cleaned lines of code in 2 files: - bertology/run_bertology.py (304:376) - bertology/run_prune_gpt.py (279:351) duplicated block id: 25 size: 61 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (40:120) - tapex/run_wikitablequestions_with_tapex.py (38:118) duplicated block id: 26 size: 59 cleaned lines of code in 2 files: - rag-end2end-retriever/callbacks_rag.py (43:117) - rag/callbacks_rag.py (41:114) duplicated block id: 27 size: 58 cleaned lines of code in 2 files: - wav2vec2/run_asr.py (223:343) - wav2vec2/run_common_voice.py (142:262) duplicated block id: 28 size: 57 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (283:363) - wav2vec2/run_pretrain.py (287:367) duplicated block id: 29 size: 57 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (114:177) - performer/run_mlm_performer.py (124:187) duplicated block id: 30 size: 56 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (109:170) - performer/run_mlm_performer.py (124:185) duplicated block id: 31 size: 56 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (109:170) - mlm_wwm/run_mlm_wwm.py (114:175) duplicated block id: 32 size: 53 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (208:260) - xtreme-s/run_xtreme_s.py (264:316) duplicated block id: 33 size: 52 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (642:698) - rag/finetune_rag.py (487:544) duplicated block id: 34 size: 52 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (587:652) - deebert/run_glue_deebert.py (540:605) duplicated block id: 35 size: 50 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (67:128) - jax-projects/model_parallel/run_clm_mp.py (60:121) duplicated block id: 36 size: 50 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (81:130) - xtreme-s/run_xtreme_s.py (94:143) duplicated block id: 37 size: 50 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (82:131) - xtreme-s/run_xtreme_s.py (94:143) duplicated block id: 38 size: 50 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (337:397) - deebert/src/modeling_highway_roberta.py (95:154) duplicated block id: 39 size: 49 cleaned lines of code in 2 files: - rag-end2end-retriever/callbacks_rag.py (58:117) - seq2seq-distillation/callbacks.py (22:81) duplicated block id: 40 size: 49 cleaned lines of code in 2 files: - rag/callbacks_rag.py (55:114) - seq2seq-distillation/callbacks.py (22:81) duplicated block id: 41 size: 49 cleaned lines of code in 2 files: - rag-end2end-retriever/use_own_knowledge_dataset.py (16:102) - rag/use_own_knowledge_dataset.py (23:110) duplicated block id: 42 size: 49 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (198:254) - rag/finetune_rag.py (197:254) duplicated block id: 43 size: 48 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (458:508) - movement-pruning/masked_run_glue.py (599:648) duplicated block id: 44 size: 47 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (174:227) - seq2seq-distillation/lightning_base.py (172:225) duplicated block id: 45 size: 47 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (459:516) - movement-pruning/masked_run_squad.py (628:685) duplicated block id: 46 size: 46 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (229:278) - rag/lightning_base.py (227:275) duplicated block id: 47 size: 45 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (398:447) - deebert/run_glue_deebert.py (385:434) duplicated block id: 48 size: 45 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (707:766) - mm-imdb/run_mmimdb.py (435:494) duplicated block id: 49 size: 44 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (280:331) - self-training-text-classification/finetuning.py (342:393) duplicated block id: 50 size: 42 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (517:567) - mm-imdb/run_mmimdb.py (410:460) duplicated block id: 51 size: 42 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (736:786) - rag/finetune_rag.py (569:619) duplicated block id: 52 size: 40 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (229:268) - seq2seq-distillation/lightning_base.py (227:266) duplicated block id: 53 size: 40 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (58:103) - movement-pruning/masked_run_squad.py (61:106) duplicated block id: 54 size: 38 cleaned lines of code in 2 files: - rag-end2end-retriever/use_own_knowledge_dataset.py (131:175) - rag/use_own_knowledge_dataset.py (164:208) duplicated block id: 55 size: 37 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (709:754) - movement-pruning/masked_run_squad.py (969:1014) duplicated block id: 56 size: 37 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (386:430) - movement-pruning/masked_run_glue.py (539:583) duplicated block id: 57 size: 37 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (437:483) - movement-pruning/masked_run_squad.py (969:1014) duplicated block id: 58 size: 36 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (192:242) - tapex/run_tabfact_with_tapex.py (185:235) duplicated block id: 59 size: 36 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (75:124) - distillation/run_squad_w_distillation.py (95:144) duplicated block id: 60 size: 36 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (96:143) - movement-pruning/masked_run_glue.py (146:193) duplicated block id: 61 size: 36 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (277:323) - jax-projects/model_parallel/run_clm_mp.py (208:258) duplicated block id: 62 size: 36 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (96:143) - movement-pruning/masked_run_squad.py (153:200) duplicated block id: 63 size: 35 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (452:486) - visual_bert/visualizing_image.py (433:467) duplicated block id: 64 size: 35 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (433:467) - lxmert/visualizing_image.py (452:486) duplicated block id: 65 size: 35 cleaned lines of code in 2 files: - wav2vec2/run_asr.py (60:106) - wav2vec2/run_pretrain.py (65:111) duplicated block id: 66 size: 35 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (163:197) - robust-speech-event/run_speech_recognition_ctc_streaming.py (165:199) duplicated block id: 67 size: 35 cleaned lines of code in 2 files: - visual_bert/visualizing_image.py (433:467) - visual_bert/visualizing_image.py (452:486) duplicated block id: 68 size: 35 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (433:467) - visual_bert/visualizing_image.py (452:486) duplicated block id: 69 size: 35 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (245:297) - tapex/run_tabfact_with_tapex.py (199:252) duplicated block id: 70 size: 34 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (226:263) - movement-pruning/masked_run_squad.py (231:270) duplicated block id: 71 size: 33 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (364:411) - robust-speech-event/run_speech_recognition_ctc_streaming.py (319:366) duplicated block id: 72 size: 32 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (344:388) - movement-pruning/masked_run_squad.py (497:542) duplicated block id: 73 size: 32 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (674:707) - movement-pruning/masked_run_squad.py (923:956) duplicated block id: 74 size: 32 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (737:769) - movement-pruning/masked_run_squad.py (855:887) duplicated block id: 75 size: 32 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (370:414) - xtreme-s/run_xtreme_s.py (426:470) duplicated block id: 76 size: 31 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (549:580) - movement-pruning/masked_run_glue.py (773:804) duplicated block id: 77 size: 31 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (196:239) - wav2vec2/run_common_voice.py (257:300) duplicated block id: 78 size: 31 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (325:366) - xtreme-s/run_xtreme_s.py (426:467) duplicated block id: 79 size: 31 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (640:670) - movement-pruning/masked_run_squad.py (880:910) duplicated block id: 80 size: 30 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (135:164) - quantization-qdqbert/run_quant_qa.py (143:172) duplicated block id: 81 size: 30 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (135:164) - tapex/run_tabfact_with_tapex.py (95:124) duplicated block id: 82 size: 30 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (125:162) - mm-imdb/run_mmimdb.py (94:132) duplicated block id: 83 size: 30 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (135:164) - tapex/run_wikitablequestions_with_tapex.py (184:213) duplicated block id: 84 size: 30 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (95:124) - tapex/run_wikitablequestions_with_tapex.py (184:213) duplicated block id: 85 size: 30 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (323:353) - seq2seq-distillation/lightning_base.py (303:333) duplicated block id: 86 size: 30 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (135:164) - tapex/run_wikisql_with_tapex.py (186:215) duplicated block id: 87 size: 30 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (206:242) - quantization-qdqbert/run_quant_qa.py (245:281) duplicated block id: 88 size: 30 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (143:172) - tapex/run_wikitablequestions_with_tapex.py (184:213) duplicated block id: 89 size: 30 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (143:172) - tapex/run_tabfact_with_tapex.py (95:124) duplicated block id: 90 size: 30 cleaned lines of code in 2 files: - movement-pruning/Saving_PruneBERT.ipynb (309:338) - movement-pruning/Saving_PruneBERT.ipynb (372:401) duplicated block id: 91 size: 30 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (323:353) - rag/lightning_base.py (312:342) duplicated block id: 92 size: 30 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (285:330) - movement-pruning/masked_run_squad.py (413:457) duplicated block id: 93 size: 30 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (95:124) - tapex/run_wikisql_with_tapex.py (186:215) duplicated block id: 94 size: 30 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (143:172) - tapex/run_wikisql_with_tapex.py (186:215) duplicated block id: 95 size: 29 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (84:119) - rag/finetune_rag.py (97:132) duplicated block id: 96 size: 29 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (161:194) - rag/finetune_rag.py (159:193) duplicated block id: 97 size: 29 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (350:383) - movement-pruning/masked_run_glue.py (503:536) duplicated block id: 98 size: 29 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (76:112) - wav2vec2/run_pretrain.py (83:119) duplicated block id: 99 size: 28 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (365:401) - rag/lightning_base.py (356:394) duplicated block id: 100 size: 28 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (81:108) - tapex/run_tabfact_with_tapex.py (155:182) duplicated block id: 101 size: 28 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (289:320) - bert-loses-patience/pabee/modeling_pabee_bert.py (314:345) duplicated block id: 102 size: 28 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (385:417) - movement-pruning/masked_run_glue.py (551:583) duplicated block id: 103 size: 27 cleaned lines of code in 2 files: - quantization-qdqbert/utils_qa.py (214:244) - quantization-qdqbert/utils_qa.py (403:433) duplicated block id: 104 size: 27 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (540:572) - robust-speech-event/run_speech_recognition_ctc_streaming.py (485:517) duplicated block id: 105 size: 27 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (720:748) - quantization-qdqbert/evaluate-hf-trt-qa.py (73:101) duplicated block id: 106 size: 27 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (163:197) - movement-pruning/masked_run_squad.py (209:243) duplicated block id: 107 size: 27 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (325:356) - movement-pruning/masked_run_glue.py (496:527) duplicated block id: 108 size: 27 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (577:605) - quantization-qdqbert/evaluate-hf-trt-qa.py (73:101) duplicated block id: 109 size: 26 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (190:220) - bert-loses-patience/pabee/modeling_pabee_bert.py (213:243) duplicated block id: 110 size: 26 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (196:233) - robust-speech-event/run_speech_recognition_ctc_streaming.py (319:356) duplicated block id: 111 size: 26 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (174:199) - xtreme-s/run_xtreme_s.py (223:248) duplicated block id: 112 size: 26 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (138:170) - seq2seq-distillation/lightning_base.py (136:168) duplicated block id: 113 size: 26 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (364:401) - wav2vec2/run_common_voice.py (257:294) duplicated block id: 114 size: 26 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (319:356) - wav2vec2/run_common_voice.py (257:294) duplicated block id: 115 size: 26 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (356:389) - seq2seq-distillation/lightning_base.py (337:371) duplicated block id: 116 size: 26 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (196:233) - robust-speech-event/run_speech_recognition_ctc_bnb.py (364:401) duplicated block id: 117 size: 26 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (242:280) - performer/run_mlm_performer.py (489:527) duplicated block id: 118 size: 26 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (881:910) - movement-pruning/masked_run_squad.py (1037:1067) duplicated block id: 119 size: 26 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (172:197) - xtreme-s/run_xtreme_s.py (223:248) duplicated block id: 120 size: 25 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (445:469) - movement-pruning/masked_run_glue.py (606:630) duplicated block id: 121 size: 25 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (97:123) - jax-projects/model_parallel/run_clm_mp.py (80:106) duplicated block id: 122 size: 25 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (401:430) - movement-pruning/masked_run_squad.py (557:586) duplicated block id: 123 size: 25 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (466:490) - deebert/run_glue_deebert.py (445:469) duplicated block id: 124 size: 25 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (87:113) - jax-projects/hybrid_clip/run_hybrid_clip.py (97:123) duplicated block id: 125 size: 24 cleaned lines of code in 2 files: - wav2vec2/run_common_voice.py (263:294) - xtreme-s/run_xtreme_s.py (426:457) duplicated block id: 126 size: 24 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (202:233) - xtreme-s/run_xtreme_s.py (426:457) duplicated block id: 127 size: 24 cleaned lines of code in 2 files: - wav2vec2/run_common_voice.py (271:299) - zero-shot-distillation/distill_classifier.py (232:260) duplicated block id: 128 size: 24 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (616:643) - mm-imdb/run_mmimdb.py (462:490) duplicated block id: 129 size: 24 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (277:308) - movement-pruning/masked_run_glue.py (384:415) duplicated block id: 130 size: 24 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (569:596) - mm-imdb/run_mmimdb.py (462:490) duplicated block id: 131 size: 24 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (569:596) - distillation/run_squad_w_distillation.py (734:761) duplicated block id: 132 size: 24 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (210:238) - zero-shot-distillation/distill_classifier.py (232:260) duplicated block id: 133 size: 24 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (191:218) - mm-imdb/run_mmimdb.py (154:181) duplicated block id: 134 size: 24 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (616:643) - distillation/run_squad_w_distillation.py (734:761) duplicated block id: 135 size: 24 cleaned lines of code in 2 files: - bertology/run_bertology.py (277:302) - bertology/run_prune_gpt.py (252:277) duplicated block id: 136 size: 23 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (647:678) - robust-speech-event/run_speech_recognition_ctc_streaming.py (564:595) duplicated block id: 137 size: 23 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (290:320) - seq2seq-distillation/lightning_base.py (269:299) duplicated block id: 138 size: 23 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (130:159) - distillation/run_squad_w_distillation.py (130:160) duplicated block id: 139 size: 23 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (130:160) - mm-imdb/run_mmimdb.py (100:129) duplicated block id: 140 size: 23 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (825:851) - movement-pruning/masked_run_squad.py (991:1017) duplicated block id: 141 size: 23 cleaned lines of code in 2 files: - wav2vec2/run_asr.py (25:60) - wav2vec2/run_pretrain.py (20:56) duplicated block id: 142 size: 23 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (672:722) - movement-pruning/emmental/modeling_bert_masked.py (847:895) duplicated block id: 143 size: 23 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (290:320) - rag/lightning_base.py (278:308) duplicated block id: 144 size: 22 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (752:779) - robust-speech-event/run_speech_recognition_ctc_streaming.py (652:679) duplicated block id: 145 size: 22 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (144:165) - jax-projects/model_parallel/run_clm_mp.py (121:142) duplicated block id: 146 size: 22 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (459:483) - movement-pruning/masked_run_glue.py (825:848) duplicated block id: 147 size: 22 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (188:214) - deebert/run_glue_deebert.py (177:203) duplicated block id: 148 size: 22 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (731:754) - movement-pruning/masked_run_glue.py (825:848) duplicated block id: 149 size: 22 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (141:162) - layoutlmv3/run_funsd_cord.py (134:155) duplicated block id: 150 size: 21 cleaned lines of code in 2 files: - bertology/run_bertology.py (55:88) - bertology/run_prune_gpt.py (44:77) duplicated block id: 151 size: 21 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (350:374) - deebert/run_glue_deebert.py (332:356) duplicated block id: 152 size: 21 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (217:237) - robust-speech-event/run_speech_recognition_ctc_streaming.py (220:240) duplicated block id: 153 size: 21 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (713:743) - xtreme-s/run_xtreme_s.py (859:889) duplicated block id: 154 size: 21 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (142:162) - tapex/run_tabfact_with_tapex.py (95:115) duplicated block id: 155 size: 21 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (142:162) - tapex/run_wikitablequestions_with_tapex.py (184:204) duplicated block id: 156 size: 21 cleaned lines of code in 2 files: - rag-end2end-retriever/distributed_ray_retriever.py (144:167) - rag/distributed_ray_retriever.py (131:152) duplicated block id: 157 size: 21 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (658:679) - deebert/run_glue_deebert.py (608:629) duplicated block id: 158 size: 21 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (220:240) - xtreme-s/run_xtreme_s.py (273:293) duplicated block id: 159 size: 21 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (76:104) - wav2vec2/run_asr.py (78:106) duplicated block id: 160 size: 21 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (142:162) - tapex/run_wikisql_with_tapex.py (186:206) duplicated block id: 161 size: 21 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (142:162) - quantization-qdqbert/run_quant_qa.py (143:163) duplicated block id: 162 size: 20 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (180:203) - mm-imdb/run_mmimdb.py (154:177) duplicated block id: 163 size: 20 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (587:614) - mm-imdb/run_mmimdb.py (433:460) duplicated block id: 164 size: 20 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (180:203) - distillation/run_squad_w_distillation.py (243:267) duplicated block id: 165 size: 20 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (385:405) - jax-projects/model_parallel/run_clm_mp.py (308:328) duplicated block id: 166 size: 20 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (378:401) - zero-shot-distillation/distill_classifier.py (232:255) duplicated block id: 167 size: 20 cleaned lines of code in 2 files: - rag-end2end-retriever/use_own_knowledge_dataset.py (110:129) - rag/use_own_knowledge_dataset.py (143:162) duplicated block id: 168 size: 20 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (333:356) - zero-shot-distillation/distill_classifier.py (232:255) duplicated block id: 169 size: 20 cleaned lines of code in 2 files: - xtreme-s/run_xtreme_s.py (434:457) - zero-shot-distillation/distill_classifier.py (232:255) duplicated block id: 170 size: 20 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (191:214) - distillation/run_squad_w_distillation.py (243:267) duplicated block id: 171 size: 20 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (243:267) - mm-imdb/run_mmimdb.py (154:177) duplicated block id: 172 size: 19 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (121:139) - tapex/run_wikitablequestions_with_tapex.py (186:204) duplicated block id: 173 size: 19 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (121:139) - tapex/run_tabfact_with_tapex.py (97:115) duplicated block id: 174 size: 19 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (116:144) - movement-pruning/masked_run_squad.py (153:181) duplicated block id: 175 size: 19 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (121:139) - layoutlmv3/run_funsd_cord.py (137:155) duplicated block id: 176 size: 19 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (121:139) - tapex/run_wikisql_with_tapex.py (188:206) duplicated block id: 177 size: 19 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (68:91) - bert-loses-patience/pabee/modeling_pabee_bert.py (72:95) duplicated block id: 178 size: 19 cleaned lines of code in 2 files: - rag/lightning_base.py (356:381) - seq2seq-distillation/lightning_base.py (346:371) duplicated block id: 179 size: 19 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (616:636) - movement-pruning/masked_run_squad.py (994:1014) duplicated block id: 180 size: 19 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (569:589) - movement-pruning/masked_run_squad.py (994:1014) duplicated block id: 181 size: 19 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (797:829) - movement-pruning/masked_run_squad.py (1056:1088) duplicated block id: 182 size: 19 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (36:58) - wav2vec2/run_pretrain.py (38:60) duplicated block id: 183 size: 19 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (121:139) - quantization-qdqbert/run_quant_qa.py (145:163) duplicated block id: 184 size: 19 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (381:403) - rag/finetune_rag.py (275:297) duplicated block id: 185 size: 19 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (116:144) - movement-pruning/masked_run_glue.py (146:174) duplicated block id: 186 size: 19 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (492:516) - xtreme-s/run_xtreme_s.py (607:631) duplicated block id: 187 size: 19 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (237:260) - distillation/run_squad_w_distillation.py (282:305) duplicated block id: 188 size: 19 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (569:589) - movement-pruning/masked_run_glue.py (828:848) duplicated block id: 189 size: 19 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (616:636) - movement-pruning/masked_run_glue.py (828:848) duplicated block id: 190 size: 19 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (237:260) - movement-pruning/masked_run_glue.py (389:412) duplicated block id: 191 size: 18 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (713:731) - rag/finetune_rag.py (546:564) duplicated block id: 192 size: 18 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (91:108) - tapex/run_wikisql_with_tapex.py (94:111) duplicated block id: 193 size: 18 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (319:340) - xtreme-s/run_xtreme_s.py (373:394) duplicated block id: 194 size: 18 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (91:108) - tapex/run_wikitablequestions_with_tapex.py (92:109) duplicated block id: 195 size: 18 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (165:182) - tapex/run_wikitablequestions_with_tapex.py (92:109) duplicated block id: 196 size: 18 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (377:397) - deebert/run_glue_deebert.py (359:379) duplicated block id: 197 size: 18 cleaned lines of code in 2 files: - seq2seq-distillation/_test_seq2seq_examples.py (240:258) - seq2seq-distillation/_test_seq2seq_examples_multi_gpu.py (111:128) duplicated block id: 198 size: 18 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (165:182) - tapex/run_wikisql_with_tapex.py (94:111) duplicated block id: 199 size: 18 cleaned lines of code in 2 files: - wav2vec2/run_common_voice.py (109:126) - xtreme-s/run_xtreme_s.py (222:239) duplicated block id: 200 size: 18 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (542:567) - distillation/run_squad_w_distillation.py (707:732) duplicated block id: 201 size: 18 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (102:147) - bert-loses-patience/pabee/modeling_pabee_bert.py (108:153) duplicated block id: 202 size: 18 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (589:614) - distillation/run_squad_w_distillation.py (707:732) duplicated block id: 203 size: 17 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (174:190) - wav2vec2/run_common_voice.py (110:126) duplicated block id: 204 size: 17 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (236:265) - performer/run_mlm_performer.py (251:280) duplicated block id: 205 size: 17 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (522:539) - movement-pruning/masked_run_glue.py (788:805) duplicated block id: 206 size: 17 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (82:101) - mm-imdb/run_mmimdb.py (80:99) duplicated block id: 207 size: 17 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (596:617) - movement-pruning/masked_run_glue.py (851:872) duplicated block id: 208 size: 17 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (524:540) - movement-pruning/masked_run_squad.py (871:887) duplicated block id: 209 size: 17 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (415:432) - movement-pruning/masked_run_glue.py (788:805) duplicated block id: 210 size: 17 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (330:351) - jax-projects/model_parallel/run_clm_mp.py (231:252) duplicated block id: 211 size: 17 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (102:120) - mm-imdb/run_mmimdb.py (80:99) duplicated block id: 212 size: 17 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (163:181) - movement-pruning/masked_run_glue.py (219:237) duplicated block id: 213 size: 17 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (483:499) - mm-imdb/run_mmimdb.py (375:391) duplicated block id: 214 size: 17 cleaned lines of code in 2 files: - bertology/run_bertology.py (254:271) - bertology/run_prune_gpt.py (236:253) duplicated block id: 215 size: 17 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (513:531) - movement-pruning/masked_run_squad.py (838:856) duplicated block id: 216 size: 17 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (440:458) - movement-pruning/masked_run_squad.py (705:722) duplicated block id: 217 size: 17 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (440:458) - distillation/run_squad_w_distillation.py (562:579) duplicated block id: 218 size: 17 cleaned lines of code in 2 files: - longform-qa/eli5_utils.py (237:254) - longform-qa/eli5_utils.py (439:456) duplicated block id: 219 size: 17 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (330:351) - jax-projects/hybrid_clip/run_hybrid_clip.py (296:317) duplicated block id: 220 size: 17 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (172:188) - wav2vec2/run_common_voice.py (110:126) duplicated block id: 221 size: 17 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (591:614) - movement-pruning/masked_run_squad.py (969:992) duplicated block id: 222 size: 17 cleaned lines of code in 2 files: - rag-end2end-retriever/distributed_ray_retriever.py (42:87) - rag/distributed_ray_retriever.py (36:79) duplicated block id: 223 size: 17 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (544:567) - movement-pruning/masked_run_squad.py (969:992) duplicated block id: 224 size: 17 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (524:540) - movement-pruning/masked_run_glue.py (753:769) duplicated block id: 225 size: 17 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (392:415) - movement-pruning/masked_run_squad.py (413:436) duplicated block id: 226 size: 17 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (279:302) - movement-pruning/masked_run_glue.py (420:443) duplicated block id: 227 size: 16 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (564:580) - deebert/run_glue_deebert.py (522:538) duplicated block id: 228 size: 16 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (433:448) - lxmert/visualizing_image.py (471:486) duplicated block id: 229 size: 16 cleaned lines of code in 2 files: - visual_bert/visualizing_image.py (433:448) - visual_bert/visualizing_image.py (471:486) duplicated block id: 230 size: 16 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (419:434) - movement-pruning/masked_run_glue.py (585:601) duplicated block id: 231 size: 16 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (471:486) - visual_bert/visualizing_image.py (433:448) duplicated block id: 232 size: 16 cleaned lines of code in 2 files: - tapex/run_wikitablequestions_with_tapex.py (267:287) - wav2vec2/run_common_voice.py (280:300) duplicated block id: 233 size: 16 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (433:448) - visual_bert/visualizing_image.py (471:486) duplicated block id: 234 size: 16 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (249:290) - robust-speech-event/run_speech_recognition_ctc_streaming.py (240:281) duplicated block id: 235 size: 16 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (432:447) - movement-pruning/masked_run_glue.py (585:601) duplicated block id: 236 size: 16 cleaned lines of code in 2 files: - rag-end2end-retriever/distributed_ray_retriever.py (10:29) - rag/distributed_ray_retriever.py (10:29) duplicated block id: 237 size: 16 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (75:92) - tapex/run_wikisql_with_tapex.py (98:115) duplicated block id: 238 size: 16 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (219:239) - tapex/run_wikisql_with_tapex.py (269:289) duplicated block id: 239 size: 16 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (564:580) - mm-imdb/run_mmimdb.py (415:431) duplicated block id: 240 size: 16 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (269:289) - wav2vec2/run_common_voice.py (280:300) duplicated block id: 241 size: 16 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (219:239) - tapex/run_wikitablequestions_with_tapex.py (267:287) duplicated block id: 242 size: 16 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (75:92) - tapex/run_wikitablequestions_with_tapex.py (96:113) duplicated block id: 243 size: 16 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (245:262) - mm-imdb/run_mmimdb.py (322:339) duplicated block id: 244 size: 16 cleaned lines of code in 2 files: - rag-end2end-retriever/distributed_ray_retriever.py (90:135) - rag/distributed_ray_retriever.py (80:125) duplicated block id: 245 size: 16 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (240:260) - movement-pruning/masked_run_squad.py (413:433) duplicated block id: 246 size: 15 cleaned lines of code in 2 files: - pplm/run_pplm.py (397:411) - pplm/run_pplm.py (668:682) duplicated block id: 247 size: 15 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (105:147) - movement-pruning/emmental/modeling_bert_masked.py (512:557) duplicated block id: 248 size: 15 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (180:196) - movement-pruning/masked_run_squad.py (326:342) duplicated block id: 249 size: 15 cleaned lines of code in 2 files: - tapex/run_wikitablequestions_with_tapex.py (267:286) - zero-shot-distillation/distill_classifier.py (241:260) duplicated block id: 250 size: 15 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (154:170) - movement-pruning/masked_run_squad.py (326:342) duplicated block id: 251 size: 15 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (243:259) - movement-pruning/masked_run_squad.py (326:342) duplicated block id: 252 size: 15 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (564:589) - xtreme-s/run_xtreme_s.py (710:735) duplicated block id: 253 size: 15 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (36:54) - wav2vec2/run_asr.py (42:60) duplicated block id: 254 size: 15 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (111:153) - movement-pruning/emmental/modeling_bert_masked.py (512:557) duplicated block id: 255 size: 15 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (493:507) - movement-pruning/masked_run_glue.py (572:586) duplicated block id: 256 size: 15 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (67:87) - mlm_wwm/run_mlm_wwm.py (52:72) duplicated block id: 257 size: 15 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (293:335) - deebert/src/modeling_highway_roberta.py (51:93) duplicated block id: 258 size: 15 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (269:288) - zero-shot-distillation/distill_classifier.py (241:260) duplicated block id: 259 size: 15 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (430:444) - luke/run_luke_ner_no_trainer.py (635:649) duplicated block id: 260 size: 15 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (393:408) - movement-pruning/masked_run_glue.py (763:778) duplicated block id: 261 size: 15 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (60:80) - mlm_wwm/run_mlm_wwm.py (52:72) duplicated block id: 262 size: 15 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (572:586) - movement-pruning/masked_run_squad.py (662:676) duplicated block id: 263 size: 15 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (191:207) - movement-pruning/masked_run_squad.py (326:342) duplicated block id: 264 size: 15 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (300:319) - robust-speech-event/run_speech_recognition_ctc_streaming.py (297:316) duplicated block id: 265 size: 15 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (824:848) - movement-pruning/masked_run_glue.py (915:939) duplicated block id: 266 size: 15 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (422:440) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (383:401) duplicated block id: 267 size: 15 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (648:662) - quantization-qdqbert/evaluate-hf-trt-qa.py (105:119) duplicated block id: 268 size: 15 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (888:902) - quantization-qdqbert/evaluate-hf-trt-qa.py (105:119) duplicated block id: 269 size: 14 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (689:702) - movement-pruning/masked_run_glue.py (791:804) duplicated block id: 270 size: 14 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (757:771) - movement-pruning/emmental/modeling_bert_masked.py (847:861) duplicated block id: 271 size: 14 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (525:538) - distillation/train.py (202:215) duplicated block id: 272 size: 14 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (145:158) - robust-speech-event/run_speech_recognition_ctc_streaming.py (181:194) duplicated block id: 273 size: 14 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (525:538) - distillation/run_squad_w_distillation.py (689:702) duplicated block id: 274 size: 14 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (129:145) - deebert/run_glue_deebert.py (145:161) duplicated block id: 275 size: 14 cleaned lines of code in 2 files: - tapex/run_wikitablequestions_with_tapex.py (186:199) - xtreme-s/run_xtreme_s.py (230:243) duplicated block id: 276 size: 14 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (606:619) - movement-pruning/masked_run_squad.py (708:722) duplicated block id: 277 size: 14 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (75:88) - tapex/run_tabfact_with_tapex.py (169:182) duplicated block id: 278 size: 14 cleaned lines of code in 2 files: - performer/modeling_flax_performer_utils.py (360:373) - performer/modeling_flax_performer_utils.py (512:525) duplicated block id: 279 size: 14 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (208:223) - distillation/run_squad_w_distillation.py (270:285) duplicated block id: 280 size: 14 cleaned lines of code in 2 files: - distillation/train.py (202:215) - movement-pruning/masked_run_squad.py (938:951) duplicated block id: 281 size: 14 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (525:538) - movement-pruning/masked_run_squad.py (938:951) duplicated block id: 282 size: 14 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (137:150) - xtreme-s/run_xtreme_s.py (230:243) duplicated block id: 283 size: 14 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (689:702) - mm-imdb/run_mmimdb.py (418:431) duplicated block id: 284 size: 14 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (78:91) - tapex/run_tabfact_with_tapex.py (169:182) duplicated block id: 285 size: 14 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (567:580) - distillation/train.py (202:215) duplicated block id: 286 size: 14 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (75:88) - mlm_wwm/run_mlm_wwm.py (95:108) duplicated block id: 287 size: 14 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (209:224) - movement-pruning/masked_run_glue.py (339:354) duplicated block id: 288 size: 14 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (188:201) - xtreme-s/run_xtreme_s.py (230:243) duplicated block id: 289 size: 14 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (144:157) - xtreme-s/run_xtreme_s.py (230:243) duplicated block id: 290 size: 14 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (144:157) - robust-speech-event/run_speech_recognition_ctc_bnb.py (179:192) duplicated block id: 291 size: 14 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (121:134) - xtreme-s/run_xtreme_s.py (230:243) duplicated block id: 292 size: 14 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (137:150) - robust-speech-event/run_speech_recognition_ctc_streaming.py (181:194) duplicated block id: 293 size: 14 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (418:431) - movement-pruning/masked_run_squad.py (938:951) duplicated block id: 294 size: 14 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (75:88) - quantization-qdqbert/run_quant_qa.py (78:91) duplicated block id: 295 size: 14 cleaned lines of code in 2 files: - adversarial/run_hans.py (41:60) - quantization-qdqbert/run_quant_qa.py (57:76) duplicated block id: 296 size: 14 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (179:192) - tapex/run_wikisql_with_tapex.py (188:201) duplicated block id: 297 size: 14 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (293:311) - movement-pruning/masked_run_squad.py (319:337) duplicated block id: 298 size: 14 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (689:702) - distillation/train.py (202:215) duplicated block id: 299 size: 14 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (121:134) - robust-speech-event/run_speech_recognition_ctc_streaming.py (181:194) duplicated block id: 300 size: 14 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (179:192) - tapex/run_tabfact_with_tapex.py (97:110) duplicated block id: 301 size: 14 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (246:267) - xtreme-s/run_xtreme_s.py (420:441) duplicated block id: 302 size: 14 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (145:158) - xtreme-s/run_xtreme_s.py (230:243) duplicated block id: 303 size: 14 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (181:194) - tapex/run_wikisql_with_tapex.py (188:201) duplicated block id: 304 size: 14 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (78:91) - tapex/run_wikisql_with_tapex.py (98:111) duplicated block id: 305 size: 14 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (567:580) - movement-pruning/masked_run_squad.py (938:951) duplicated block id: 306 size: 14 cleaned lines of code in 2 files: - tapex/run_wikitablequestions_with_tapex.py (244:265) - xtreme-s/run_xtreme_s.py (420:441) duplicated block id: 307 size: 14 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (144:157) - robust-speech-event/run_speech_recognition_ctc_streaming.py (181:194) duplicated block id: 308 size: 14 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (137:150) - robust-speech-event/run_speech_recognition_ctc_bnb.py (179:192) duplicated block id: 309 size: 14 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (95:108) - quantization-qdqbert/run_quant_qa.py (78:91) duplicated block id: 310 size: 14 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (316:330) - performer/run_mlm_performer.py (553:569) duplicated block id: 311 size: 14 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (171:184) - seq2seq-distillation/finetune.py (81:95) duplicated block id: 312 size: 14 cleaned lines of code in 2 files: - distillation/train.py (202:215) - movement-pruning/masked_run_glue.py (791:804) duplicated block id: 313 size: 14 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (78:91) - tapex/run_wikitablequestions_with_tapex.py (96:109) duplicated block id: 314 size: 14 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (102:121) - mlm_wwm/run_mlm_wwm.py (114:133) duplicated block id: 315 size: 14 cleaned lines of code in 2 files: - distillation/train.py (202:215) - mm-imdb/run_mmimdb.py (418:431) duplicated block id: 316 size: 14 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (773:787) - movement-pruning/masked_run_squad.py (1032:1046) duplicated block id: 317 size: 14 cleaned lines of code in 2 files: - rag/finetune_rag.py (169:183) - seq2seq-distillation/finetune.py (81:95) duplicated block id: 318 size: 14 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (466:479) - distillation/run_squad_w_distillation.py (565:579) duplicated block id: 319 size: 14 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (179:192) - tapex/run_wikitablequestions_with_tapex.py (186:199) duplicated block id: 320 size: 14 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (466:479) - movement-pruning/masked_run_squad.py (708:722) duplicated block id: 321 size: 14 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (181:194) - tapex/run_wikitablequestions_with_tapex.py (186:199) duplicated block id: 322 size: 14 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (120:133) - onnx/summarization/run_onnx_exporter.py (65:78) duplicated block id: 323 size: 14 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (145:158) - robust-speech-event/run_speech_recognition_ctc_bnb.py (179:192) duplicated block id: 324 size: 14 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (565:579) - movement-pruning/masked_run_glue.py (606:619) duplicated block id: 325 size: 14 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (102:121) - performer/run_mlm_performer.py (124:143) duplicated block id: 326 size: 14 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (181:194) - tapex/run_tabfact_with_tapex.py (97:110) duplicated block id: 327 size: 14 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (129:145) - mm-imdb/run_mmimdb.py (115:131) duplicated block id: 328 size: 14 cleaned lines of code in 2 files: - pplm/run_pplm.py (332:345) - pplm/run_pplm.py (434:447) duplicated block id: 329 size: 14 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (121:134) - robust-speech-event/run_speech_recognition_ctc_bnb.py (179:192) duplicated block id: 330 size: 14 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (97:110) - xtreme-s/run_xtreme_s.py (230:243) duplicated block id: 331 size: 14 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (672:686) - movement-pruning/emmental/modeling_bert_masked.py (757:771) duplicated block id: 332 size: 14 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (791:804) - movement-pruning/masked_run_squad.py (938:951) duplicated block id: 333 size: 14 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (567:580) - distillation/run_squad_w_distillation.py (689:702) duplicated block id: 334 size: 14 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (680:697) - movement-pruning/masked_run_glue.py (935:952) duplicated block id: 335 size: 14 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (513:528) - movement-pruning/masked_run_glue.py (720:735) duplicated block id: 336 size: 13 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (160:172) - xtreme-s/run_xtreme_s.py (245:257) duplicated block id: 337 size: 13 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (112:128) - quantization-qdqbert/run_quant_qa.py (100:116) duplicated block id: 338 size: 13 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (859:897) - movement-pruning/emmental/modeling_bert_masked.py (946:991) duplicated block id: 339 size: 13 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (145:159) - movement-pruning/masked_run_glue.py (179:193) duplicated block id: 340 size: 13 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (614:627) - mm-imdb/run_mmimdb.py (365:378) duplicated block id: 341 size: 13 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (266:278) - tapex/run_wikisql_with_tapex.py (260:272) duplicated block id: 342 size: 13 cleaned lines of code in 2 files: - wav2vec2/run_common_voice.py (238:252) - wav2vec2/run_pretrain.py (257:271) duplicated block id: 343 size: 13 cleaned lines of code in 2 files: - performer/modeling_flax_performer_utils.py (61:76) - performer/modeling_flax_performer_utils.py (111:126) duplicated block id: 344 size: 13 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (236:251) - self-training-text-classification/selftraining.py (169:186) duplicated block id: 345 size: 13 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (112:124) - xtreme-s/run_xtreme_s.py (245:257) duplicated block id: 346 size: 13 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (111:151) - deebert/src/modeling_highway_bert.py (148:190) duplicated block id: 347 size: 13 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (227:239) - tapex/run_wikisql_with_tapex.py (260:272) duplicated block id: 348 size: 13 cleaned lines of code in 2 files: - tapex/run_wikitablequestions_with_tapex.py (201:213) - xtreme-s/run_xtreme_s.py (245:257) duplicated block id: 349 size: 13 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (330:344) - movement-pruning/masked_run_squad.py (355:370) duplicated block id: 350 size: 13 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (365:377) - rag/finetune_rag.py (259:271) duplicated block id: 351 size: 13 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (245:257) - distillation/run_squad_w_distillation.py (499:511) duplicated block id: 352 size: 13 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (146:160) - movement-pruning/masked_run_squad.py (186:200) duplicated block id: 353 size: 13 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (129:143) - distillation/run_squad_w_distillation.py (146:160) duplicated block id: 354 size: 13 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (458:470) - movement-pruning/masked_run_squad.py (485:497) duplicated block id: 355 size: 13 cleaned lines of code in 2 files: - pplm/run_pplm.py (434:446) - pplm/run_pplm.py (597:609) duplicated block id: 356 size: 13 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (835:853) - movement-pruning/masked_run_squad.py (1093:1111) duplicated block id: 357 size: 13 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (494:506) - distillation/run_squad_w_distillation.py (635:647) duplicated block id: 358 size: 13 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (145:159) - movement-pruning/masked_run_squad.py (186:200) duplicated block id: 359 size: 13 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (227:239) - tapex/run_wikitablequestions_with_tapex.py (258:270) duplicated block id: 360 size: 13 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (115:129) - movement-pruning/masked_run_squad.py (186:200) duplicated block id: 361 size: 13 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (195:207) - robust-speech-event/run_speech_recognition_ctc_streaming.py (206:218) duplicated block id: 362 size: 13 cleaned lines of code in 2 files: - bertology/run_bertology.py (263:275) - movement-pruning/masked_run_glue.py (578:590) duplicated block id: 363 size: 13 cleaned lines of code in 2 files: - wav2vec2/run_asr.py (319:333) - wav2vec2/run_pretrain.py (257:271) duplicated block id: 364 size: 13 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (152:164) - xtreme-s/run_xtreme_s.py (245:257) duplicated block id: 365 size: 13 cleaned lines of code in 2 files: - quantization-qdqbert/evaluate-hf-trt-qa.py (318:344) - quantization-qdqbert/run_quant_qa.py (483:509) duplicated block id: 366 size: 13 cleaned lines of code in 2 files: - tapex/run_wikitablequestions_with_tapex.py (561:577) - wav2vec2/run_common_voice.py (485:501) duplicated block id: 367 size: 13 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (292:307) - mm-imdb/run_mmimdb.py (250:265) duplicated block id: 368 size: 13 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (393:405) - performer/run_mlm_performer.py (553:565) duplicated block id: 369 size: 13 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (105:121) - quantization-qdqbert/run_quant_qa.py (100:116) duplicated block id: 370 size: 13 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (203:215) - xtreme-s/run_xtreme_s.py (245:257) duplicated block id: 371 size: 13 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (117:133) - quantization-qdqbert/run_quant_qa.py (100:116) duplicated block id: 372 size: 13 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (322:334) - movement-pruning/masked_run_squad.py (668:680) duplicated block id: 373 size: 13 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (667:679) - distillation/run_squad_w_distillation.py (772:784) duplicated block id: 374 size: 13 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (220:232) - tapex/run_wikisql_with_tapex.py (260:272) duplicated block id: 375 size: 13 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (105:145) - deebert/src/modeling_highway_bert.py (148:190) duplicated block id: 376 size: 13 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (316:329) - movement-pruning/masked_run_squad.py (339:352) duplicated block id: 377 size: 13 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (266:278) - tapex/run_wikitablequestions_with_tapex.py (258:270) duplicated block id: 378 size: 13 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (220:232) - tapex/run_wikitablequestions_with_tapex.py (258:270) duplicated block id: 379 size: 13 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (499:511) - mm-imdb/run_mmimdb.py (322:334) duplicated block id: 380 size: 13 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (585:601) - wav2vec2/run_common_voice.py (485:501) duplicated block id: 381 size: 13 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (148:190) - movement-pruning/emmental/modeling_bert_masked.py (512:555) duplicated block id: 382 size: 13 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (617:629) - distillation/run_squad_w_distillation.py (772:784) duplicated block id: 383 size: 13 cleaned lines of code in 2 files: - performer/run_mlm_performer.py (127:143) - quantization-qdqbert/run_quant_qa.py (100:116) duplicated block id: 384 size: 13 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (146:160) - movement-pruning/masked_run_glue.py (179:193) duplicated block id: 385 size: 13 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (115:129) - movement-pruning/masked_run_glue.py (179:193) duplicated block id: 386 size: 13 cleaned lines of code in 2 files: - pplm/run_pplm.py (332:344) - pplm/run_pplm.py (597:609) duplicated block id: 387 size: 13 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (456:476) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (412:429) duplicated block id: 388 size: 13 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (220:236) - mm-imdb/run_mmimdb.py (183:199) duplicated block id: 389 size: 13 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (245:257) - movement-pruning/masked_run_squad.py (668:680) duplicated block id: 390 size: 12 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (351:362) - movement-pruning/masked_run_glue.py (616:627) duplicated block id: 391 size: 12 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (138:150) - rag/finetune_rag.py (141:153) duplicated block id: 392 size: 12 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (543:554) - xtreme-s/run_xtreme_s.py (664:675) duplicated block id: 393 size: 12 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (338:351) - performer/run_mlm_performer.py (463:476) duplicated block id: 394 size: 12 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (370:385) - tapex/run_wikitablequestions_with_tapex.py (250:265) duplicated block id: 395 size: 12 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (314:327) - movement-pruning/masked_run_glue.py (470:483) duplicated block id: 396 size: 12 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (202:217) - tapex/run_wikisql_with_tapex.py (252:267) duplicated block id: 397 size: 12 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (239:252) - performer/run_mlm_performer.py (463:476) duplicated block id: 398 size: 12 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (240:251) - xtreme-s/run_xtreme_s.py (305:316) duplicated block id: 399 size: 12 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (561:572) - self-training-text-classification/finetuning.py (741:752) duplicated block id: 400 size: 12 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (801:815) - rag/finetune_rag.py (634:649) duplicated block id: 401 size: 12 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (51:73) - movement-pruning/masked_run_squad.py (39:59) duplicated block id: 402 size: 12 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (179:191) - movement-pruning/emmental/modeling_bert_masked.py (272:284) duplicated block id: 403 size: 12 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (455:466) - mm-imdb/run_mmimdb.py (351:362) duplicated block id: 404 size: 12 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (440:453) - mm-imdb/run_mmimdb.py (336:349) duplicated block id: 405 size: 12 cleaned lines of code in 2 files: - pplm/run_pplm_discrim_train.py (310:323) - pplm/run_pplm_discrim_train.py (350:363) duplicated block id: 406 size: 12 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (476:487) - mm-imdb/run_mmimdb.py (351:362) duplicated block id: 407 size: 12 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (325:340) - tapex/run_wikitablequestions_with_tapex.py (250:265) duplicated block id: 408 size: 12 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (419:430) - distillation/run_squad_w_distillation.py (493:504) duplicated block id: 409 size: 12 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (668:679) - movement-pruning/masked_run_squad.py (1032:1043) duplicated block id: 410 size: 12 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (406:417) - distillation/run_squad_w_distillation.py (493:504) duplicated block id: 411 size: 12 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (684:722) - movement-pruning/emmental/modeling_bert_masked.py (946:989) duplicated block id: 412 size: 12 cleaned lines of code in 2 files: - rag-end2end-retriever/callbacks_rag.py (12:28) - rag/callbacks_rag.py (12:28) duplicated block id: 413 size: 12 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (562:573) - mm-imdb/run_mmimdb.py (336:349) duplicated block id: 414 size: 12 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (705:724) - deebert/run_glue_deebert.py (665:684) duplicated block id: 415 size: 12 cleaned lines of code in 2 files: - pplm/run_pplm_discrim_train.py (352:365) - pplm/run_pplm_discrim_train.py (411:424) duplicated block id: 416 size: 12 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (618:629) - movement-pruning/masked_run_squad.py (1032:1043) duplicated block id: 417 size: 12 cleaned lines of code in 2 files: - rag/utils_rag.py (139:159) - seq2seq-distillation/utils.py (439:459) duplicated block id: 418 size: 12 cleaned lines of code in 2 files: - rag-end2end-retriever/utils_rag.py (139:159) - seq2seq-distillation/utils.py (439:459) duplicated block id: 419 size: 12 cleaned lines of code in 2 files: - bertology/run_bertology.py (277:290) - movement-pruning/masked_run_glue.py (592:604) duplicated block id: 420 size: 12 cleaned lines of code in 2 files: - tapex/run_wikitablequestions_with_tapex.py (250:265) - wav2vec2/run_common_voice.py (263:278) duplicated block id: 421 size: 12 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (406:417) - movement-pruning/masked_run_squad.py (662:673) duplicated block id: 422 size: 12 cleaned lines of code in 2 files: - wav2vec2/run_common_voice.py (47:62) - wav2vec2/run_pretrain.py (37:52) duplicated block id: 423 size: 12 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (726:740) - movement-pruning/masked_run_glue.py (940:953) duplicated block id: 424 size: 12 cleaned lines of code in 2 files: - bertology/run_bertology.py (193:213) - bertology/run_prune_gpt.py (169:189) duplicated block id: 425 size: 12 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (202:217) - tapex/run_wikitablequestions_with_tapex.py (250:265) duplicated block id: 426 size: 12 cleaned lines of code in 2 files: - seq2seq-distillation/_test_bash_script.py (109:123) - seq2seq-distillation/_test_bash_script.py (189:203) duplicated block id: 427 size: 12 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (714:727) - movement-pruning/emmental/modeling_bert_masked.py (807:820) duplicated block id: 428 size: 12 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (419:430) - movement-pruning/masked_run_squad.py (662:673) duplicated block id: 429 size: 12 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (304:317) - performer/run_mlm_performer.py (463:476) duplicated block id: 430 size: 12 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (252:267) - wav2vec2/run_common_voice.py (263:278) duplicated block id: 431 size: 12 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (252:265) - movement-pruning/masked_run_glue.py (592:604) duplicated block id: 432 size: 12 cleaned lines of code in 2 files: - wav2vec2/run_asr.py (41:56) - wav2vec2/run_common_voice.py (47:62) duplicated block id: 433 size: 12 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (325:340) - tapex/run_wikisql_with_tapex.py (252:267) duplicated block id: 434 size: 12 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (488:499) - xtreme-s/run_xtreme_s.py (664:675) duplicated block id: 435 size: 12 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (370:385) - tapex/run_wikisql_with_tapex.py (252:267) duplicated block id: 436 size: 12 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (336:349) - movement-pruning/masked_run_squad.py (705:716) duplicated block id: 437 size: 11 cleaned lines of code in 2 files: - tapex/run_wikitablequestions_with_tapex.py (267:281) - xtreme-s/run_xtreme_s.py (443:457) duplicated block id: 438 size: 11 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (387:401) - tapex/run_wikitablequestions_with_tapex.py (267:281) duplicated block id: 439 size: 11 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (378:391) - quantization-qdqbert/run_quant_qa.py (474:487) duplicated block id: 440 size: 11 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (98:111) - movement-pruning/masked_run_glue.py (111:124) duplicated block id: 441 size: 11 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (75:89) - deebert/run_glue_deebert.py (75:89) duplicated block id: 442 size: 11 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (269:283) - xtreme-s/run_xtreme_s.py (443:457) duplicated block id: 443 size: 11 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (114:124) - wav2vec2/run_pretrain.py (121:131) duplicated block id: 444 size: 11 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (237:247) - bert-loses-patience/pabee/modeling_pabee_bert.py (260:270) duplicated block id: 445 size: 11 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (292:302) - mlm_wwm/run_mlm_wwm.py (269:279) duplicated block id: 446 size: 11 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (65:79) - xtreme-s/run_xtreme_s.py (76:90) duplicated block id: 447 size: 11 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (726:739) - deebert/run_glue_deebert.py (685:697) duplicated block id: 448 size: 11 cleaned lines of code in 2 files: - performer/modeling_flax_performer_utils.py (229:240) - performer/modeling_flax_performer_utils.py (273:284) duplicated block id: 449 size: 11 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (619:636) - xtreme-s/run_xtreme_s.py (859:876) duplicated block id: 450 size: 11 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (387:401) - tapex/run_wikisql_with_tapex.py (269:283) duplicated block id: 451 size: 11 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (78:91) - movement-pruning/masked_run_glue.py (111:124) duplicated block id: 452 size: 11 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (342:356) - tapex/run_wikisql_with_tapex.py (269:283) duplicated block id: 453 size: 11 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (297:308) - tapex/run_wikisql_with_tapex.py (306:316) duplicated block id: 454 size: 11 cleaned lines of code in 2 files: - onnx/summarization/bart_onnx/generation_onnx.py (312:327) - onnx/summarization/bart_onnx/generation_onnx.py (707:722) duplicated block id: 455 size: 11 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (141:151) - mm-imdb/run_mmimdb.py (266:276) duplicated block id: 456 size: 11 cleaned lines of code in 2 files: - adversarial/run_hans.py (52:62) - mlm_wwm/run_mlm_wwm.py (81:91) duplicated block id: 457 size: 11 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (177:188) - tapex/run_wikitablequestions_with_tapex.py (228:239) duplicated block id: 458 size: 11 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (162:173) - performer/run_mlm_performer.py (185:196) duplicated block id: 459 size: 11 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (36:50) - wav2vec2/run_common_voice.py (48:62) duplicated block id: 460 size: 11 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (713:730) - robust-speech-event/run_speech_recognition_ctc_streaming.py (619:636) duplicated block id: 461 size: 11 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (593:611) - robust-speech-event/run_speech_recognition_ctc_streaming.py (523:541) duplicated block id: 462 size: 11 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (97:107) - deebert/src/modeling_highway_bert.py (137:147) duplicated block id: 463 size: 11 cleaned lines of code in 2 files: - bertabs/configuration_bertabs.py (70:80) - bertabs/convert_bertabs_original_pytorch_checkpoint.py (77:87) duplicated block id: 464 size: 11 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (191:204) - movement-pruning/masked_run_glue.py (378:391) duplicated block id: 465 size: 11 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (98:111) - movement-pruning/masked_run_squad.py (118:131) duplicated block id: 466 size: 11 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (209:219) - self-training-text-classification/selftraining.py (87:97) duplicated block id: 467 size: 11 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (66:80) - xtreme-s/run_xtreme_s.py (76:90) duplicated block id: 468 size: 11 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (456:468) - robust-speech-event/run_speech_recognition_ctc_streaming.py (447:459) duplicated block id: 469 size: 11 cleaned lines of code in 2 files: - adversarial/run_hans.py (52:62) - tapex/run_tabfact_with_tapex.py (155:165) duplicated block id: 470 size: 11 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (342:356) - tapex/run_wikitablequestions_with_tapex.py (267:281) duplicated block id: 471 size: 11 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (297:308) - tapex/run_wikitablequestions_with_tapex.py (304:314) duplicated block id: 472 size: 11 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (292:302) - performer/run_mlm_performer.py (516:526) duplicated block id: 473 size: 11 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (257:268) - deebert/src/modeling_highway_bert.py (290:301) duplicated block id: 474 size: 11 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (57:69) - performer/run_mlm_performer.py (59:71) duplicated block id: 475 size: 11 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (345:364) - xtreme-s/run_xtreme_s.py (401:420) duplicated block id: 476 size: 11 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (177:188) - tapex/run_wikisql_with_tapex.py (230:241) duplicated block id: 477 size: 11 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (78:91) - movement-pruning/masked_run_squad.py (118:131) duplicated block id: 478 size: 11 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (75:89) - distillation/run_squad_w_distillation.py (95:109) duplicated block id: 479 size: 10 cleaned lines of code in 2 files: - rag-end2end-retriever/utils_rag.py (116:125) - rag/finetune_rag.py (259:268) duplicated block id: 480 size: 10 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (757:767) - movement-pruning/emmental/modeling_bert_masked.py (933:943) duplicated block id: 481 size: 10 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (63:76) - performer/run_mlm_performer.py (93:106) duplicated block id: 482 size: 10 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (470:479) - rag/lightning_base.py (221:230) duplicated block id: 483 size: 10 cleaned lines of code in 2 files: - seq2seq-distillation/_test_seq2seq_examples.py (344:353) - seq2seq-distillation/_test_seq2seq_examples.py (399:408) duplicated block id: 484 size: 10 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (145:154) - wav2vec2/run_common_voice.py (117:126) duplicated block id: 485 size: 10 cleaned lines of code in 2 files: - bertology/run_bertology.py (420:431) - bertology/run_prune_gpt.py (356:367) duplicated block id: 486 size: 10 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (585:595) - self-training-text-classification/selftraining.py (215:225) duplicated block id: 487 size: 10 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (191:202) - movement-pruning/masked_run_glue.py (300:311) duplicated block id: 488 size: 10 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (154:165) - movement-pruning/masked_run_glue.py (300:311) duplicated block id: 489 size: 10 cleaned lines of code in 2 files: - bertology/run_bertology.py (254:264) - movement-pruning/masked_run_glue.py (561:572) duplicated block id: 490 size: 10 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (619:629) - movement-pruning/masked_run_squad.py (762:774) duplicated block id: 491 size: 10 cleaned lines of code in 2 files: - pplm/run_pplm_discrim_train.py (312:323) - pplm/run_pplm_discrim_train.py (411:422) duplicated block id: 492 size: 10 cleaned lines of code in 2 files: - pplm/run_pplm_discrim_train.py (298:308) - pplm/run_pplm_discrim_train.py (338:348) duplicated block id: 493 size: 10 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (553:562) - seq2seq-distillation/finetune.py (359:368) duplicated block id: 494 size: 10 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (610:619) - seq2seq-distillation/lightning_base.py (221:230) duplicated block id: 495 size: 10 cleaned lines of code in 2 files: - rag/finetune_rag.py (259:268) - rag/utils_rag.py (116:125) duplicated block id: 496 size: 10 cleaned lines of code in 2 files: - rag-end2end-retriever/callbacks_rag.py (31:41) - rag/callbacks_rag.py (29:39) duplicated block id: 497 size: 10 cleaned lines of code in 2 files: - tapex/run_wikitablequestions_with_tapex.py (186:195) - wav2vec2/run_common_voice.py (117:126) duplicated block id: 498 size: 10 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (626:637) - wav2vec2/run_common_voice.py (485:496) duplicated block id: 499 size: 10 cleaned lines of code in 2 files: - rag/utils_rag.py (35:45) - seq2seq-distillation/utils.py (95:105) duplicated block id: 500 size: 10 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (465:474) - distillation/run_squad_w_distillation.py (613:622) duplicated block id: 501 size: 10 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (610:619) - rag/lightning_base.py (221:230) duplicated block id: 502 size: 10 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (470:479) - seq2seq-distillation/lightning_base.py (221:230) duplicated block id: 503 size: 10 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (629:638) - movement-pruning/masked_run_glue.py (748:757) duplicated block id: 504 size: 10 cleaned lines of code in 2 files: - wav2vec2/run_asr.py (129:138) - xtreme-s/run_xtreme_s.py (221:230) duplicated block id: 505 size: 10 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (110:119) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (63:72) duplicated block id: 506 size: 10 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (243:254) - movement-pruning/masked_run_glue.py (300:311) duplicated block id: 507 size: 10 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (449:458) - rag/lightning_base.py (221:230) duplicated block id: 508 size: 10 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (136:145) - jax-projects/model_parallel/run_clm_mp.py (139:148) duplicated block id: 509 size: 10 cleaned lines of code in 2 files: - adversarial/utils_hans.py (121:131) - adversarial/utils_hans.py (183:193) duplicated block id: 510 size: 10 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (712:722) - seq2seq-distillation/lightning_base.py (221:230) duplicated block id: 511 size: 10 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (93:102) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (63:72) duplicated block id: 512 size: 10 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (100:109) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (63:72) duplicated block id: 513 size: 10 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (569:579) - seq2seq-distillation/lightning_base.py (221:230) duplicated block id: 514 size: 10 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (121:130) - wav2vec2/run_common_voice.py (117:126) duplicated block id: 515 size: 10 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (310:322) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (225:237) duplicated block id: 516 size: 10 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (478:491) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (434:447) duplicated block id: 517 size: 10 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (188:197) - wav2vec2/run_common_voice.py (117:126) duplicated block id: 518 size: 10 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (449:458) - seq2seq-distillation/lightning_base.py (221:230) duplicated block id: 519 size: 10 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (98:107) - movement-pruning/emmental/modeling_bert_masked.py (501:510) duplicated block id: 520 size: 10 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (475:485) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (509:519) duplicated block id: 521 size: 10 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (701:718) - movement-pruning/masked_run_glue.py (916:933) duplicated block id: 522 size: 10 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (180:191) - movement-pruning/masked_run_glue.py (300:311) duplicated block id: 523 size: 10 cleaned lines of code in 2 files: - bertology/run_bertology.py (254:264) - deebert/run_glue_deebert.py (395:406) duplicated block id: 524 size: 10 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (236:246) - deebert/run_glue_deebert.py (395:406) duplicated block id: 525 size: 10 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (144:153) - wav2vec2/run_common_voice.py (117:126) duplicated block id: 526 size: 10 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (184:193) - jax-projects/model_parallel/run_clm_mp.py (164:173) duplicated block id: 527 size: 10 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (847:857) - movement-pruning/emmental/modeling_bert_masked.py (933:943) duplicated block id: 528 size: 10 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (166:175) - tapex/run_tabfact_with_tapex.py (88:97) duplicated block id: 529 size: 10 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (161:170) - tapex/run_tabfact_with_tapex.py (88:97) duplicated block id: 530 size: 10 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (97:106) - wav2vec2/run_common_voice.py (117:126) duplicated block id: 531 size: 10 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (408:419) - bertology/run_prune_gpt.py (236:246) duplicated block id: 532 size: 10 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (569:579) - rag/lightning_base.py (221:230) duplicated block id: 533 size: 10 cleaned lines of code in 2 files: - performer/run_mlm_performer.py (176:185) - tapex/run_tabfact_with_tapex.py (88:97) duplicated block id: 534 size: 10 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (137:146) - wav2vec2/run_common_voice.py (117:126) duplicated block id: 535 size: 10 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (138:147) - movement-pruning/emmental/modeling_bert_masked.py (501:510) duplicated block id: 536 size: 10 cleaned lines of code in 2 files: - rag/finetune_rag.py (429:438) - seq2seq-distillation/finetune.py (359:368) duplicated block id: 537 size: 10 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (365:374) - rag/utils_rag.py (116:125) duplicated block id: 538 size: 10 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (701:718) - distillation/run_squad_w_distillation.py (825:842) duplicated block id: 539 size: 10 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (139:148) - performer/run_mlm_performer.py (151:160) duplicated block id: 540 size: 10 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (55:68) - performer/run_mlm_performer.py (93:106) duplicated block id: 541 size: 10 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (626:637) - tapex/run_wikisql_with_tapex.py (585:596) duplicated block id: 542 size: 10 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (70:83) - performer/run_mlm_performer.py (93:106) duplicated block id: 543 size: 10 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (626:637) - tapex/run_wikitablequestions_with_tapex.py (561:572) duplicated block id: 544 size: 10 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (365:374) - rag-end2end-retriever/utils_rag.py (116:125) duplicated block id: 545 size: 10 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (408:419) - bertology/run_bertology.py (254:264) duplicated block id: 546 size: 10 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (712:722) - rag/lightning_base.py (221:230) duplicated block id: 547 size: 10 cleaned lines of code in 2 files: - rag-end2end-retriever/utils_rag.py (35:45) - seq2seq-distillation/utils.py (95:105) duplicated block id: 548 size: 10 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (170:181) - movement-pruning/masked_run_squad.py (231:244) duplicated block id: 549 size: 10 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (672:682) - movement-pruning/emmental/modeling_bert_masked.py (933:943) duplicated block id: 550 size: 10 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (236:246) - movement-pruning/masked_run_glue.py (561:572) duplicated block id: 551 size: 10 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (139:148) - mlm_wwm/run_mlm_wwm.py (141:150) duplicated block id: 552 size: 10 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (629:638) - movement-pruning/masked_run_squad.py (866:875) duplicated block id: 553 size: 10 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (184:193) - performer/run_mlm_performer.py (187:196) duplicated block id: 554 size: 9 cleaned lines of code in 2 files: - visual_bert/modeling_frcnn.py (1171:1179) - visual_bert/modeling_frcnn.py (1227:1235) duplicated block id: 555 size: 9 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (121:129) - quantization-qdqbert/run_quant_qa.py (120:128) duplicated block id: 556 size: 9 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (100:113) - movement-pruning/masked_run_glue.py (161:174) duplicated block id: 557 size: 9 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (284:295) - luke/run_luke_ner_no_trainer.py (323:332) duplicated block id: 558 size: 9 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (499:507) - information-gain-filtration/run_clm_igf.py (278:286) duplicated block id: 559 size: 9 cleaned lines of code in 2 files: - bertology/run_bertology.py (263:271) - movement-pruning/masked_run_squad.py (668:676) duplicated block id: 560 size: 9 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (137:145) - deebert/src/modeling_highway_bert.py (292:300) duplicated block id: 561 size: 9 cleaned lines of code in 2 files: - rag/finetune_rag.py (341:350) - seq2seq-distillation/finetune.py (244:253) duplicated block id: 562 size: 9 cleaned lines of code in 2 files: - rag/callbacks_rag.py (42:52) - seq2seq-distillation/callbacks.py (106:116) duplicated block id: 563 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (509:517) - movement-pruning/masked_run_glue.py (771:779) duplicated block id: 564 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (227:237) - distillation/run_squad_w_distillation.py (295:305) duplicated block id: 565 size: 9 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (63:71) - quantization-qdqbert/evaluate-hf-trt-qa.py (128:136) duplicated block id: 566 size: 9 cleaned lines of code in 2 files: - deebert/src/modeling_highway_roberta.py (51:59) - movement-pruning/emmental/modeling_bert_masked.py (850:858) duplicated block id: 567 size: 9 cleaned lines of code in 2 files: - rag-end2end-retriever/callbacks_rag.py (44:55) - seq2seq-distillation/callbacks.py (106:116) duplicated block id: 568 size: 9 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (468:479) - quantization-qdqbert/run_quant_qa.py (630:641) duplicated block id: 569 size: 9 cleaned lines of code in 2 files: - deebert/src/modeling_highway_roberta.py (51:59) - movement-pruning/emmental/modeling_bert_masked.py (675:683) duplicated block id: 570 size: 9 cleaned lines of code in 2 files: - deebert/src/modeling_highway_roberta.py (51:59) - movement-pruning/emmental/modeling_bert_masked.py (760:768) duplicated block id: 571 size: 9 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (455:465) - tapex/run_tabfact_with_tapex.py (407:417) duplicated block id: 572 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (260:268) - deebert/src/modeling_highway_roberta.py (51:59) duplicated block id: 573 size: 9 cleaned lines of code in 2 files: - quantization-qdqbert/utils_qa.py (144:156) - quantization-qdqbert/utils_qa.py (355:366) duplicated block id: 574 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (130:143) - movement-pruning/masked_run_squad.py (168:181) duplicated block id: 575 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (93:101) - bert-loses-patience/pabee/modeling_pabee_albert.py (236:244) duplicated block id: 576 size: 9 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (278:286) - mm-imdb/run_mmimdb.py (322:330) duplicated block id: 577 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (297:305) - movement-pruning/emmental/modeling_bert_masked.py (330:338) duplicated block id: 578 size: 9 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (250:260) - movement-pruning/masked_run_glue.py (433:443) duplicated block id: 579 size: 9 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (245:253) - movement-pruning/masked_run_glue.py (578:586) duplicated block id: 580 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (259:267) - deebert/src/modeling_highway_bert.py (137:145) duplicated block id: 581 size: 9 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (329:339) - movement-pruning/masked_run_glue.py (592:601) duplicated block id: 582 size: 9 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (219:227) - movement-pruning/emmental/modeling_bert_masked.py (637:645) duplicated block id: 583 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (439:447) - bertology/run_bertology.py (277:287) duplicated block id: 584 size: 9 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (252:262) - deebert/run_glue_deebert.py (426:434) duplicated block id: 585 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (466:474) - mm-imdb/run_mmimdb.py (365:373) duplicated block id: 586 size: 9 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (292:300) - quantization-qdqbert/run_quant_qa.py (296:305) duplicated block id: 587 size: 9 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (278:286) - movement-pruning/masked_run_squad.py (668:676) duplicated block id: 588 size: 9 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (554:563) - movement-pruning/masked_run_glue.py (941:950) duplicated block id: 589 size: 9 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (778:787) - movement-pruning/masked_run_glue.py (881:890) duplicated block id: 590 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (97:105) - bert-loses-patience/pabee/modeling_pabee_bert.py (259:267) duplicated block id: 591 size: 9 cleaned lines of code in 2 files: - bertology/run_bertology.py (263:271) - distillation/run_squad_w_distillation.py (499:507) duplicated block id: 592 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (466:474) - mm-imdb/run_mmimdb.py (341:349) duplicated block id: 593 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (237:245) - movement-pruning/emmental/modeling_bert_masked.py (850:858) duplicated block id: 594 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (237:245) - deebert/src/modeling_highway_bert.py (293:301) duplicated block id: 595 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (111:124) - mm-imdb/run_mmimdb.py (100:113) duplicated block id: 596 size: 9 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (68:76) - tapex/run_tabfact_with_tapex.py (155:163) duplicated block id: 597 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (227:237) - movement-pruning/masked_run_squad.py (423:433) duplicated block id: 598 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (368:379) - movement-pruning/masked_run_glue.py (539:550) duplicated block id: 599 size: 9 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (293:301) - movement-pruning/emmental/modeling_bert_masked.py (675:683) duplicated block id: 600 size: 9 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (293:301) - movement-pruning/emmental/modeling_bert_masked.py (760:768) duplicated block id: 601 size: 9 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (293:301) - movement-pruning/emmental/modeling_bert_masked.py (850:858) duplicated block id: 602 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (120:128) - movement-pruning/emmental/modeling_bert_masked.py (297:305) duplicated block id: 603 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (120:128) - movement-pruning/emmental/modeling_bert_masked.py (330:338) duplicated block id: 604 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (807:815) - movement-pruning/emmental/modeling_bert_masked.py (981:989) duplicated block id: 605 size: 9 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (606:615) - rag/finetune_rag.py (451:460) duplicated block id: 606 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (237:245) - movement-pruning/emmental/modeling_bert_masked.py (675:683) duplicated block id: 607 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (120:128) - movement-pruning/emmental/modeling_bert_masked.py (224:232) duplicated block id: 608 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (807:815) - movement-pruning/emmental/modeling_bert_masked.py (887:895) duplicated block id: 609 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (237:245) - movement-pruning/emmental/modeling_bert_masked.py (760:768) duplicated block id: 610 size: 9 cleaned lines of code in 2 files: - bertology/run_bertology.py (277:287) - mm-imdb/run_mmimdb.py (329:339) duplicated block id: 611 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (227:237) - movement-pruning/masked_run_glue.py (402:412) duplicated block id: 612 size: 9 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (555:567) - self-training-text-classification/selftraining.py (191:203) duplicated block id: 613 size: 9 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (454:463) - seq2seq-distillation/finetune.py (244:253) duplicated block id: 614 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (727:737) - mm-imdb/run_mmimdb.py (554:563) duplicated block id: 615 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (426:434) - mm-imdb/run_mmimdb.py (329:339) duplicated block id: 616 size: 9 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (161:169) - tapex/run_wikisql_with_tapex.py (141:149) duplicated block id: 617 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (658:667) - movement-pruning/masked_run_glue.py (863:872) duplicated block id: 618 size: 9 cleaned lines of code in 2 files: - bertology/run_bertology.py (263:271) - mm-imdb/run_mmimdb.py (322:330) duplicated block id: 619 size: 9 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (506:516) - quantization-qdqbert/evaluate-hf-trt-qa.py (55:67) duplicated block id: 620 size: 9 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (161:169) - tapex/run_wikitablequestions_with_tapex.py (139:147) duplicated block id: 621 size: 9 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (81:89) - quantization-qdqbert/run_quant_qa.py (68:76) duplicated block id: 622 size: 9 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (857:871) - movement-pruning/masked_run_squad.py (1120:1134) duplicated block id: 623 size: 9 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (675:685) - quantization-qdqbert/evaluate-hf-trt-qa.py (55:67) duplicated block id: 624 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (439:447) - mm-imdb/run_mmimdb.py (329:339) duplicated block id: 625 size: 9 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (100:113) - movement-pruning/masked_run_squad.py (168:181) duplicated block id: 626 size: 9 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1227:1235) - visual_bert/modeling_frcnn.py (1171:1179) duplicated block id: 627 size: 9 cleaned lines of code in 2 files: - wav2vec2/run_asr.py (130:138) - wav2vec2/run_common_voice.py (109:117) duplicated block id: 628 size: 9 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (172:181) - movement-pruning/masked_run_glue.py (339:348) duplicated block id: 629 size: 9 cleaned lines of code in 2 files: - bertology/run_bertology.py (263:271) - information-gain-filtration/run_clm_igf.py (278:286) duplicated block id: 630 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (500:508) - movement-pruning/emmental/modeling_bert_masked.py (759:767) duplicated block id: 631 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (500:508) - movement-pruning/emmental/modeling_bert_masked.py (674:682) duplicated block id: 632 size: 9 cleaned lines of code in 2 files: - bertology/run_bertology.py (143:151) - bertology/run_prune_gpt.py (121:129) duplicated block id: 633 size: 9 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (278:286) - movement-pruning/masked_run_glue.py (578:586) duplicated block id: 634 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (97:105) - deebert/src/modeling_highway_bert.py (292:300) duplicated block id: 635 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (500:508) - movement-pruning/emmental/modeling_bert_masked.py (849:857) duplicated block id: 636 size: 9 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1171:1179) - lxmert/modeling_frcnn.py (1227:1235) duplicated block id: 637 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (500:508) - movement-pruning/emmental/modeling_bert_masked.py (935:943) duplicated block id: 638 size: 9 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (185:197) - movement-pruning/masked_run_glue.py (226:236) duplicated block id: 639 size: 9 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1171:1179) - visual_bert/modeling_frcnn.py (1227:1235) duplicated block id: 640 size: 9 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (537:551) - self-training-text-classification/finetuning.py (697:713) duplicated block id: 641 size: 9 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (213:221) - wav2vec2/run_asr.py (63:71) duplicated block id: 642 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (250:260) - deebert/run_glue_deebert.py (227:237) duplicated block id: 643 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (224:232) - movement-pruning/emmental/modeling_bert_masked.py (297:305) duplicated block id: 644 size: 9 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (224:232) - movement-pruning/emmental/modeling_bert_masked.py (330:338) duplicated block id: 645 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (78:89) - movement-pruning/masked_run_squad.py (118:129) duplicated block id: 646 size: 9 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (245:255) - quantization-qdqbert/evaluate-hf-trt-qa.py (252:262) duplicated block id: 647 size: 9 cleaned lines of code in 2 files: - synthid_text/detector_training.py (226:234) - synthid_text/utils.py (207:215) duplicated block id: 648 size: 9 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/modeling_hybrid_clip.py (178:190) - jax-projects/hybrid_clip/modeling_hybrid_clip.py (232:244) duplicated block id: 649 size: 9 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (245:253) - information-gain-filtration/run_clm_igf.py (278:286) duplicated block id: 650 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (315:324) - deebert/run_glue_deebert.py (286:295) duplicated block id: 651 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (260:268) - movement-pruning/emmental/modeling_bert_masked.py (675:683) duplicated block id: 652 size: 9 cleaned lines of code in 2 files: - bertology/run_bertology.py (277:287) - deebert/run_glue_deebert.py (426:434) duplicated block id: 653 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (260:268) - movement-pruning/emmental/modeling_bert_masked.py (760:768) duplicated block id: 654 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (130:143) - movement-pruning/masked_run_glue.py (161:174) duplicated block id: 655 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (439:447) - bertology/run_prune_gpt.py (252:262) duplicated block id: 656 size: 9 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (341:349) - movement-pruning/masked_run_glue.py (606:614) duplicated block id: 657 size: 9 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (390:398) - movement-pruning/masked_run_squad.py (546:554) duplicated block id: 658 size: 9 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (269:277) - quantization-qdqbert/run_quant_qa.py (296:305) duplicated block id: 659 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (260:268) - movement-pruning/emmental/modeling_bert_masked.py (850:858) duplicated block id: 660 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (237:245) - deebert/src/modeling_highway_roberta.py (51:59) duplicated block id: 661 size: 9 cleaned lines of code in 2 files: - performer/run_mlm_performer.py (516:524) - quantization-qdqbert/run_quant_qa.py (296:305) duplicated block id: 662 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (686:695) - mm-imdb/run_mmimdb.py (554:563) duplicated block id: 663 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (170:180) - distillation/run_squad_w_distillation.py (185:197) duplicated block id: 664 size: 9 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (632:640) - rag/finetune_rag.py (477:485) duplicated block id: 665 size: 9 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (322:330) - movement-pruning/masked_run_glue.py (578:586) duplicated block id: 666 size: 9 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (213:221) - wav2vec2/run_pretrain.py (68:76) duplicated block id: 667 size: 9 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (111:124) - deebert/run_glue_deebert.py (130:143) duplicated block id: 668 size: 9 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (261:272) - movement-pruning/masked_run_squad.py (364:375) duplicated block id: 669 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (286:295) - movement-pruning/masked_run_glue.py (471:480) duplicated block id: 670 size: 9 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (78:89) - movement-pruning/masked_run_glue.py (111:122) duplicated block id: 671 size: 8 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (110:117) - tapex/run_tabfact_with_tapex.py (90:97) duplicated block id: 672 size: 8 cleaned lines of code in 2 files: - rag/utils_rag.py (49:56) - seq2seq-distillation/utils.py (109:116) duplicated block id: 673 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (259:268) - movement-pruning/masked_run_glue.py (434:443) duplicated block id: 674 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (440:447) - seq2seq-distillation/lightning_base.py (298:305) duplicated block id: 675 size: 8 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (318:325) - self-training-text-classification/finetuning.py (408:416) duplicated block id: 676 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (80:89) - movement-pruning/masked_run_glue.py (115:124) duplicated block id: 677 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (533:540) - distillation/run_squad_w_distillation.py (640:647) duplicated block id: 678 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (356:363) - rag/finetune_rag.py (384:391) duplicated block id: 679 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (791:798) - rag/lightning_base.py (314:322) duplicated block id: 680 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (293:302) - deebert/run_glue_deebert.py (259:268) duplicated block id: 681 size: 8 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (97:104) - mlm_wwm/run_mlm_wwm.py (81:88) duplicated block id: 682 size: 8 cleaned lines of code in 2 files: - rag/finetune_rag.py (394:401) - seq2seq-distillation/finetune.py (314:321) duplicated block id: 683 size: 8 cleaned lines of code in 2 files: - bertology/run_bertology.py (242:250) - bertology/run_prune_gpt.py (223:231) duplicated block id: 684 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (669:676) - rag-end2end-retriever/lightning_base.py (210:217) duplicated block id: 685 size: 8 cleaned lines of code in 2 files: - distillation/train.py (202:209) - rag-end2end-retriever/lightning_base.py (325:333) duplicated block id: 686 size: 8 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (266:273) - wav2vec2/run_common_voice.py (271:278) duplicated block id: 687 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (418:425) - rag-end2end-retriever/lightning_base.py (325:333) duplicated block id: 688 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (472:485) - xtreme-s/run_xtreme_s.py (587:599) duplicated block id: 689 size: 8 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (270:277) - tapex/run_wikitablequestions_with_tapex.py (304:311) duplicated block id: 690 size: 8 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (87:94) - tapex/run_tabfact_with_tapex.py (155:162) duplicated block id: 691 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (58:73) - wav2vec2/run_common_voice.py (40:55) duplicated block id: 692 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (330:339) - seq2seq-distillation/lightning_base.py (298:305) duplicated block id: 693 size: 8 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (253:262) - seq2seq-distillation/lightning_base.py (298:305) duplicated block id: 694 size: 8 cleaned lines of code in 2 files: - bertology/run_bertology.py (264:271) - seq2seq-distillation/lightning_base.py (208:215) duplicated block id: 695 size: 8 cleaned lines of code in 2 files: - deebert/src/modeling_highway_roberta.py (51:58) - movement-pruning/emmental/modeling_bert_masked.py (936:943) duplicated block id: 696 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (94:101) - deebert/src/modeling_highway_roberta.py (51:58) duplicated block id: 697 size: 8 cleaned lines of code in 2 files: - bertology/run_bertology.py (126:135) - bertology/run_prune_gpt.py (105:114) duplicated block id: 698 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (370:378) - movement-pruning/masked_run_squad.py (762:770) duplicated block id: 699 size: 8 cleaned lines of code in 2 files: - performer/modeling_flax_performer_utils.py (118:126) - performer/modeling_flax_performer_utils.py (170:177) duplicated block id: 700 size: 8 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (120:127) - tapex/run_wikitablequestions_with_tapex.py (140:147) duplicated block id: 701 size: 8 cleaned lines of code in 2 files: - bertology/run_bertology.py (278:287) - rag/lightning_base.py (307:314) duplicated block id: 702 size: 8 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1007:1014) - visual_bert/modeling_frcnn.py (916:923) duplicated block id: 703 size: 8 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (78:85) - tapex/run_wikisql_with_tapex.py (151:158) duplicated block id: 704 size: 8 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (689:696) - rag/lightning_base.py (314:322) duplicated block id: 705 size: 8 cleaned lines of code in 2 files: - bertology/run_bertology.py (278:287) - seq2seq-distillation/lightning_base.py (298:305) duplicated block id: 706 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (418:425) - rag/lightning_base.py (314:322) duplicated block id: 707 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (309:320) - movement-pruning/masked_run_glue.py (558:569) duplicated block id: 708 size: 8 cleaned lines of code in 2 files: - deebert/src/modeling_highway_roberta.py (51:58) - movement-pruning/emmental/modeling_bert_masked.py (501:508) duplicated block id: 709 size: 8 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (78:85) - tapex/run_wikitablequestions_with_tapex.py (149:156) duplicated block id: 710 size: 8 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (407:416) - tapex/run_wikitablequestions_with_tapex.py (553:561) duplicated block id: 711 size: 8 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (640:647) - movement-pruning/masked_run_glue.py (762:769) duplicated block id: 712 size: 8 cleaned lines of code in 2 files: - movement-pruning/Saving_PruneBERT.ipynb (108:115) - movement-pruning/Saving_PruneBERT.ipynb (238:245) duplicated block id: 713 size: 8 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (220:227) - xtreme-s/run_xtreme_s.py (434:441) duplicated block id: 714 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (418:425) - seq2seq-distillation/lightning_base.py (305:313) duplicated block id: 715 size: 8 cleaned lines of code in 2 files: - performer/run_mlm_performer.py (184:192) - tapex/run_wikisql_with_tapex.py (229:237) duplicated block id: 716 size: 8 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (162:169) - quantization-qdqbert/run_quant_qa.py (120:127) duplicated block id: 717 size: 8 cleaned lines of code in 2 files: - rag/finetune_rag.py (393:400) - rag/finetune_rag.py (402:409) duplicated block id: 718 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (59:74) - wav2vec2/run_common_voice.py (40:55) duplicated block id: 719 size: 8 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (293:300) - tapex/run_wikitablequestions_with_tapex.py (304:311) duplicated block id: 720 size: 8 cleaned lines of code in 2 files: - distillation/train.py (202:209) - seq2seq-distillation/lightning_base.py (305:313) duplicated block id: 721 size: 8 cleaned lines of code in 2 files: - rag/finetune_rag.py (329:339) - seq2seq-distillation/finetune.py (232:242) duplicated block id: 722 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (938:945) - rag/lightning_base.py (314:322) duplicated block id: 723 size: 8 cleaned lines of code in 2 files: - wav2vec2/run_asr.py (286:312) - wav2vec2/run_pretrain.py (224:250) duplicated block id: 724 size: 8 cleaned lines of code in 2 files: - tapex/run_wikitablequestions_with_tapex.py (258:265) - zero-shot-distillation/distill_classifier.py (232:239) duplicated block id: 725 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (527:534) - seq2seq-distillation/finetune.py (323:330) duplicated block id: 726 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (276:286) - deebert/run_glue_deebert.py (242:252) duplicated block id: 727 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (356:363) - rag-end2end-retriever/finetune_rag.py (508:515) duplicated block id: 728 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (392:403) - mm-imdb/run_mmimdb.py (309:320) duplicated block id: 729 size: 8 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (270:277) - tapex/run_wikisql_with_tapex.py (306:313) duplicated block id: 730 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (533:540) - deebert/run_glue_deebert.py (499:506) duplicated block id: 731 size: 8 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (253:262) - rag/lightning_base.py (307:314) duplicated block id: 732 size: 8 cleaned lines of code in 2 files: - performer/modeling_flax_performer_utils.py (68:76) - performer/modeling_flax_performer_utils.py (170:177) duplicated block id: 733 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (787:799) - rag/finetune_rag.py (621:633) duplicated block id: 734 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (94:101) - deebert/src/modeling_highway_bert.py (293:300) duplicated block id: 735 size: 8 cleaned lines of code in 2 files: - performer/run_mlm_performer.py (517:524) - tapex/run_wikitablequestions_with_tapex.py (304:311) duplicated block id: 736 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (192:199) - wav2vec2/run_common_voice.py (128:135) duplicated block id: 737 size: 8 cleaned lines of code in 2 files: - wav2vec2/run_common_voice.py (470:479) - xtreme-s/run_xtreme_s.py (859:871) duplicated block id: 738 size: 8 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (87:94) - quantization-qdqbert/run_quant_qa.py (68:75) duplicated block id: 739 size: 8 cleaned lines of code in 2 files: - bertology/run_bertology.py (176:185) - bertology/run_prune_gpt.py (153:162) duplicated block id: 740 size: 8 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (266:273) - zero-shot-distillation/distill_classifier.py (232:239) duplicated block id: 741 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/utils_rag.py (160:167) - seq2seq-distillation/utils.py (461:468) duplicated block id: 742 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (237:244) - deebert/src/modeling_highway_bert.py (138:145) duplicated block id: 743 size: 8 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (97:104) - tapex/run_tabfact_with_tapex.py (155:162) duplicated block id: 744 size: 8 cleaned lines of code in 2 files: - visual_bert/modeling_frcnn.py (1832:1839) - visual_bert/modeling_frcnn.py (1858:1865) duplicated block id: 745 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (427:434) - seq2seq-distillation/lightning_base.py (298:305) duplicated block id: 746 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (440:447) - rag/lightning_base.py (307:314) duplicated block id: 747 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (330:339) - rag/lightning_base.py (307:314) duplicated block id: 748 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/utils_rag.py (49:56) - seq2seq-distillation/utils.py (109:116) duplicated block id: 749 size: 8 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (689:696) - rag-end2end-retriever/lightning_base.py (325:333) duplicated block id: 750 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (499:506) - movement-pruning/masked_run_squad.py (880:887) duplicated block id: 751 size: 8 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (293:300) - movement-pruning/emmental/modeling_bert_masked.py (501:508) duplicated block id: 752 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (237:244) - movement-pruning/emmental/modeling_bert_masked.py (936:943) duplicated block id: 753 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (237:244) - bert-loses-patience/pabee/modeling_pabee_bert.py (98:105) duplicated block id: 754 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (190:197) - wav2vec2/run_common_voice.py (128:135) duplicated block id: 755 size: 8 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (162:169) - layoutlmv3/run_funsd_cord.py (121:128) duplicated block id: 756 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (291:302) - wav2vec2/run_asr.py (253:264) duplicated block id: 757 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (669:676) - seq2seq-distillation/lightning_base.py (208:215) duplicated block id: 758 size: 8 cleaned lines of code in 2 files: - performer/run_mlm_performer.py (517:524) - tapex/run_wikisql_with_tapex.py (306:313) duplicated block id: 759 size: 8 cleaned lines of code in 2 files: - bertology/run_bertology.py (264:271) - rag-end2end-retriever/lightning_base.py (210:217) duplicated block id: 760 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (174:181) - wav2vec2/run_asr.py (131:138) duplicated block id: 761 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (938:945) - rag-end2end-retriever/lightning_base.py (325:333) duplicated block id: 762 size: 8 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (268:276) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (240:248) duplicated block id: 763 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (427:434) - rag/lightning_base.py (307:314) duplicated block id: 764 size: 8 cleaned lines of code in 2 files: - rag/finetune_rag.py (403:410) - seq2seq-distillation/finetune.py (323:330) duplicated block id: 765 size: 8 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (916:923) - visual_bert/modeling_frcnn.py (1007:1014) duplicated block id: 766 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (525:532) - seq2seq-distillation/lightning_base.py (305:313) duplicated block id: 767 size: 8 cleaned lines of code in 2 files: - adversarial/run_hans.py (78:85) - self-training-text-classification/finetuning.py (101:108) duplicated block id: 768 size: 8 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (293:300) - movement-pruning/emmental/modeling_bert_masked.py (936:943) duplicated block id: 769 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (237:244) - movement-pruning/emmental/modeling_bert_masked.py (501:508) duplicated block id: 770 size: 8 cleaned lines of code in 2 files: - bertology/run_bertology.py (232:239) - bertology/run_prune_gpt.py (213:220) duplicated block id: 771 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (593:601) - seq2seq-distillation/lightning_base.py (298:305) duplicated block id: 772 size: 8 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (279:286) - rag-end2end-retriever/lightning_base.py (210:217) duplicated block id: 773 size: 8 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (227:234) - xtreme-s/run_xtreme_s.py (434:441) duplicated block id: 774 size: 8 cleaned lines of code in 2 files: - quantization-qdqbert/utils_qa.py (81:92) - quantization-qdqbert/utils_qa.py (297:308) duplicated block id: 775 size: 8 cleaned lines of code in 2 files: - bertology/run_bertology.py (264:271) - rag/lightning_base.py (208:215) duplicated block id: 776 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (791:798) - rag-end2end-retriever/lightning_base.py (325:333) duplicated block id: 777 size: 8 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (293:300) - tapex/run_wikisql_with_tapex.py (306:313) duplicated block id: 778 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (791:798) - seq2seq-distillation/lightning_base.py (305:313) duplicated block id: 779 size: 8 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (266:273) - robust-speech-event/run_speech_recognition_ctc_streaming.py (333:340) duplicated block id: 780 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (525:532) - rag/lightning_base.py (314:322) duplicated block id: 781 size: 8 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (279:286) - rag/lightning_base.py (208:215) duplicated block id: 782 size: 8 cleaned lines of code in 2 files: - rag/finetune_rag.py (385:392) - seq2seq-distillation/finetune.py (305:312) duplicated block id: 783 size: 8 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (260:267) - zero-shot-distillation/distill_classifier.py (232:239) duplicated block id: 784 size: 8 cleaned lines of code in 2 files: - adversarial/run_hans.py (79:86) - tapex/run_tabfact_with_tapex.py (79:86) duplicated block id: 785 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (665:678) - distillation/run_squad_w_distillation.py (829:842) duplicated block id: 786 size: 8 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (266:273) - robust-speech-event/run_speech_recognition_ctc_bnb.py (378:385) duplicated block id: 787 size: 8 cleaned lines of code in 2 files: - wav2vec2/run_common_voice.py (205:231) - wav2vec2/run_pretrain.py (224:250) duplicated block id: 788 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (98:105) - movement-pruning/emmental/modeling_bert_masked.py (760:767) duplicated block id: 789 size: 8 cleaned lines of code in 2 files: - performer/modeling_flax_performer.py (444:454) - performer/modeling_flax_performer.py (492:502) duplicated block id: 790 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (94:101) - movement-pruning/emmental/modeling_bert_masked.py (501:508) duplicated block id: 791 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (200:209) - seq2seq-distillation/finetune.py (130:139) duplicated block id: 792 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (643:652) - movement-pruning/masked_run_glue.py (851:860) duplicated block id: 793 size: 8 cleaned lines of code in 2 files: - adversarial/run_hans.py (52:59) - jax-projects/hybrid_clip/run_hybrid_clip.py (97:104) duplicated block id: 794 size: 8 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (210:217) - tapex/run_tabfact_with_tapex.py (220:227) duplicated block id: 795 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (405:416) - mm-imdb/run_mmimdb.py (309:320) duplicated block id: 796 size: 8 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (380:387) - self-training-text-classification/finetuning.py (408:416) duplicated block id: 797 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (98:105) - movement-pruning/emmental/modeling_bert_masked.py (675:682) duplicated block id: 798 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (686:694) - distillation/run_squad_w_distillation.py (851:861) duplicated block id: 799 size: 8 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (407:416) - tapex/run_wikisql_with_tapex.py (577:585) duplicated block id: 800 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (94:101) - movement-pruning/emmental/modeling_bert_masked.py (675:682) duplicated block id: 801 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (98:105) - deebert/src/modeling_highway_roberta.py (51:58) duplicated block id: 802 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (94:101) - bert-loses-patience/pabee/modeling_pabee_bert.py (98:105) duplicated block id: 803 size: 8 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (80:87) - mlm_wwm/run_mlm_wwm.py (81:88) duplicated block id: 804 size: 8 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (455:464) - tapex/run_wikisql_with_tapex.py (577:585) duplicated block id: 805 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (94:101) - bert-loses-patience/pabee/modeling_pabee_bert.py (260:267) duplicated block id: 806 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (525:532) - rag-end2end-retriever/lightning_base.py (325:333) duplicated block id: 807 size: 8 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1832:1839) - lxmert/modeling_frcnn.py (1858:1865) duplicated block id: 808 size: 8 cleaned lines of code in 2 files: - distillation/train.py (202:209) - rag/lightning_base.py (314:322) duplicated block id: 809 size: 8 cleaned lines of code in 2 files: - performer/run_mlm_performer.py (178:185) - self-training-text-classification/finetuning.py (110:117) duplicated block id: 810 size: 8 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (500:507) - rag-end2end-retriever/lightning_base.py (210:217) duplicated block id: 811 size: 8 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (210:217) - quantization-qdqbert/run_quant_qa.py (266:273) duplicated block id: 812 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (593:601) - rag/lightning_base.py (307:314) duplicated block id: 813 size: 8 cleaned lines of code in 2 files: - adversarial/run_hans.py (106:114) - jax-projects/model_parallel/run_clm_mp.py (237:245) duplicated block id: 814 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (938:945) - seq2seq-distillation/lightning_base.py (305:313) duplicated block id: 815 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (215:223) - movement-pruning/masked_run_glue.py (384:392) duplicated block id: 816 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (291:302) - wav2vec2/run_common_voice.py (172:183) duplicated block id: 817 size: 8 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (120:127) - tapex/run_wikisql_with_tapex.py (142:149) duplicated block id: 818 size: 8 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (220:227) - zero-shot-distillation/distill_classifier.py (232:239) duplicated block id: 819 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (333:340) - tapex/run_tabfact_with_tapex.py (220:227) duplicated block id: 820 size: 8 cleaned lines of code in 2 files: - bertology/run_bertology.py (298:305) - mm-imdb/run_mmimdb.py (347:354) duplicated block id: 821 size: 8 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (87:94) - mlm_wwm/run_mlm_wwm.py (81:88) duplicated block id: 822 size: 8 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (500:507) - rag/lightning_base.py (208:215) duplicated block id: 823 size: 8 cleaned lines of code in 2 files: - performer/run_mlm_performer.py (184:192) - tapex/run_wikitablequestions_with_tapex.py (227:235) duplicated block id: 824 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (94:101) - deebert/src/modeling_highway_bert.py (138:145) duplicated block id: 825 size: 8 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (266:273) - xtreme-s/run_xtreme_s.py (434:441) duplicated block id: 826 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (567:574) - seq2seq-distillation/lightning_base.py (305:313) duplicated block id: 827 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (665:678) - movement-pruning/masked_run_glue.py (920:933) duplicated block id: 828 size: 8 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (91:98) - self-training-text-classification/selftraining.py (62:69) duplicated block id: 829 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (669:676) - rag/lightning_base.py (208:215) duplicated block id: 830 size: 8 cleaned lines of code in 2 files: - visual_bert/modeling_frcnn.py (916:923) - visual_bert/modeling_frcnn.py (1007:1014) duplicated block id: 831 size: 8 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (246:253) - seq2seq-distillation/lightning_base.py (208:215) duplicated block id: 832 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (94:101) - movement-pruning/emmental/modeling_bert_masked.py (850:857) duplicated block id: 833 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (442:452) - seq2seq-distillation/finetune.py (232:242) duplicated block id: 834 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (94:101) - movement-pruning/emmental/modeling_bert_masked.py (760:767) duplicated block id: 835 size: 8 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (121:128) - tapex/run_wikisql_with_tapex.py (142:149) duplicated block id: 836 size: 8 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (121:128) - tapex/run_wikitablequestions_with_tapex.py (140:147) duplicated block id: 837 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (323:330) - rag-end2end-retriever/lightning_base.py (210:217) duplicated block id: 838 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (579:586) - rag/lightning_base.py (208:215) duplicated block id: 839 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (378:385) - tapex/run_tabfact_with_tapex.py (220:227) duplicated block id: 840 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (518:525) - seq2seq-distillation/finetune.py (314:321) duplicated block id: 841 size: 8 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (227:234) - robust-speech-event/run_speech_recognition_ctc_streaming.py (333:340) duplicated block id: 842 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (98:105) - movement-pruning/emmental/modeling_bert_masked.py (936:943) duplicated block id: 843 size: 8 cleaned lines of code in 2 files: - adversarial/run_hans.py (52:59) - jax-projects/dataset-streaming/run_mlm_flax_stream.py (87:94) duplicated block id: 844 size: 8 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (761:772) - movement-pruning/masked_run_squad.py (1017:1028) duplicated block id: 845 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (94:101) - movement-pruning/emmental/modeling_bert_masked.py (936:943) duplicated block id: 846 size: 8 cleaned lines of code in 2 files: - wav2vec2/run_asr.py (18:25) - wav2vec2/run_common_voice.py (19:26) duplicated block id: 847 size: 8 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (851:861) - mm-imdb/run_mmimdb.py (554:562) duplicated block id: 848 size: 8 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (168:175) - self-training-text-classification/finetuning.py (110:117) duplicated block id: 849 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (98:105) - movement-pruning/emmental/modeling_bert_masked.py (850:857) duplicated block id: 850 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (163:170) - mm-imdb/run_mmimdb.py (134:141) duplicated block id: 851 size: 8 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (138:145) - deebert/src/modeling_highway_roberta.py (51:58) duplicated block id: 852 size: 8 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (80:87) - tapex/run_tabfact_with_tapex.py (155:162) duplicated block id: 853 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (499:506) - movement-pruning/masked_run_glue.py (762:769) duplicated block id: 854 size: 8 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (246:253) - rag/lightning_base.py (208:215) duplicated block id: 855 size: 8 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (797:808) - movement-pruning/masked_run_glue.py (900:910) duplicated block id: 856 size: 8 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (689:696) - seq2seq-distillation/lightning_base.py (305:313) duplicated block id: 857 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (172:179) - wav2vec2/run_asr.py (131:138) duplicated block id: 858 size: 8 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1858:1865) - visual_bert/modeling_frcnn.py (1832:1839) duplicated block id: 859 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (509:516) - seq2seq-distillation/finetune.py (305:312) duplicated block id: 860 size: 8 cleaned lines of code in 2 files: - adversarial/run_hans.py (106:114) - jax-projects/dataset-streaming/run_mlm_flax_stream.py (336:344) duplicated block id: 861 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (517:524) - rag-end2end-retriever/finetune_rag.py (526:533) duplicated block id: 862 size: 8 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (138:145) - movement-pruning/emmental/modeling_bert_masked.py (760:767) duplicated block id: 863 size: 8 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (279:286) - seq2seq-distillation/lightning_base.py (208:215) duplicated block id: 864 size: 8 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (138:145) - movement-pruning/emmental/modeling_bert_masked.py (675:682) duplicated block id: 865 size: 8 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (97:104) - quantization-qdqbert/run_quant_qa.py (68:75) duplicated block id: 866 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (80:89) - movement-pruning/masked_run_squad.py (122:131) duplicated block id: 867 size: 8 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1832:1839) - visual_bert/modeling_frcnn.py (1858:1865) duplicated block id: 868 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (509:516) - mm-imdb/run_mmimdb.py (401:408) duplicated block id: 869 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (323:330) - rag/lightning_base.py (208:215) duplicated block id: 870 size: 8 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (916:923) - lxmert/modeling_frcnn.py (1007:1014) duplicated block id: 871 size: 8 cleaned lines of code in 2 files: - rag/utils_rag.py (160:167) - seq2seq-distillation/utils.py (461:468) duplicated block id: 872 size: 8 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (80:87) - quantization-qdqbert/run_quant_qa.py (68:75) duplicated block id: 873 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (611:619) - xtreme-s/run_xtreme_s.py (762:770) duplicated block id: 874 size: 8 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (138:145) - movement-pruning/emmental/modeling_bert_masked.py (936:943) duplicated block id: 875 size: 8 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (146:153) - information-gain-filtration/run_clm_igf.py (435:442) duplicated block id: 876 size: 8 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (138:145) - movement-pruning/emmental/modeling_bert_masked.py (850:857) duplicated block id: 877 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (567:574) - rag/lightning_base.py (314:322) duplicated block id: 878 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (512:519) - luke/run_luke_ner_no_trainer.py (164:171) duplicated block id: 879 size: 8 cleaned lines of code in 2 files: - quantization-qdqbert/ort-infer-benchmark.py (27:34) - quantization-qdqbert/ort-infer-benchmark.py (42:49) duplicated block id: 880 size: 8 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (298:305) - tapex/run_wikitablequestions_with_tapex.py (340:347) duplicated block id: 881 size: 8 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (298:305) - tapex/run_wikisql_with_tapex.py (342:349) duplicated block id: 882 size: 8 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (163:170) - self-training-text-classification/finetuning.py (110:117) duplicated block id: 883 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (926:939) - movement-pruning/masked_run_squad.py (1093:1106) duplicated block id: 884 size: 8 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (500:507) - seq2seq-distillation/lightning_base.py (208:215) duplicated block id: 885 size: 8 cleaned lines of code in 2 files: - wav2vec2/run_common_voice.py (128:135) - xtreme-s/run_xtreme_s.py (241:248) duplicated block id: 886 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (579:586) - seq2seq-distillation/lightning_base.py (208:215) duplicated block id: 887 size: 8 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (579:586) - rag-end2end-retriever/lightning_base.py (210:217) duplicated block id: 888 size: 8 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (227:234) - mlm_wwm/run_mlm_wwm.py (210:217) duplicated block id: 889 size: 8 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (227:234) - zero-shot-distillation/distill_classifier.py (232:239) duplicated block id: 890 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (517:524) - rag/finetune_rag.py (402:409) duplicated block id: 891 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (727:736) - distillation/run_squad_w_distillation.py (851:861) duplicated block id: 892 size: 8 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (509:518) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (487:496) duplicated block id: 893 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (567:574) - rag-end2end-retriever/lightning_base.py (325:333) duplicated block id: 894 size: 8 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (227:234) - wav2vec2/run_common_voice.py (271:278) duplicated block id: 895 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (713:725) - wav2vec2/run_common_voice.py (470:479) duplicated block id: 896 size: 8 cleaned lines of code in 2 files: - distillation/distiller.py (409:417) - seq2seq-distillation/distillation.py (123:130) duplicated block id: 897 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (259:268) - mm-imdb/run_mmimdb.py (251:260) duplicated block id: 898 size: 8 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (455:464) - tapex/run_wikitablequestions_with_tapex.py (553:561) duplicated block id: 899 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (260:267) - movement-pruning/emmental/modeling_bert_masked.py (936:943) duplicated block id: 900 size: 8 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (224:232) - mm-imdb/run_mmimdb.py (206:214) duplicated block id: 901 size: 8 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (521:533) - tapex/run_tabfact_with_tapex.py (459:471) duplicated block id: 902 size: 8 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (228:236) - movement-pruning/emmental/modeling_bert_masked.py (647:655) duplicated block id: 903 size: 8 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (220:227) - wav2vec2/run_common_voice.py (271:278) duplicated block id: 904 size: 8 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (851:861) - movement-pruning/masked_run_glue.py (941:949) duplicated block id: 905 size: 8 cleaned lines of code in 2 files: - adversarial/run_hans.py (52:59) - jax-projects/model_parallel/run_clm_mp.py (80:87) duplicated block id: 906 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (175:182) - bert-loses-patience/pabee/modeling_pabee_bert.py (201:208) duplicated block id: 907 size: 8 cleaned lines of code in 2 files: - longform-qa/eli5_utils.py (424:432) - longform-qa/eli5_utils.py (463:471) duplicated block id: 908 size: 8 cleaned lines of code in 2 files: - adversarial/run_hans.py (106:114) - jax-projects/hybrid_clip/run_hybrid_clip.py (302:310) duplicated block id: 909 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (623:630) - rag/finetune_rag.py (468:475) duplicated block id: 910 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (533:540) - xtreme-s/run_xtreme_s.py (652:659) duplicated block id: 911 size: 8 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (246:253) - rag-end2end-retriever/lightning_base.py (210:217) duplicated block id: 912 size: 8 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (526:533) - rag/finetune_rag.py (393:400) duplicated block id: 913 size: 8 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (619:631) - wav2vec2/run_common_voice.py (470:479) duplicated block id: 914 size: 8 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (227:234) - robust-speech-event/run_speech_recognition_ctc_bnb.py (378:385) duplicated block id: 915 size: 8 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (260:267) - movement-pruning/emmental/modeling_bert_masked.py (501:508) duplicated block id: 916 size: 8 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (323:330) - seq2seq-distillation/lightning_base.py (208:215) duplicated block id: 917 size: 8 cleaned lines of code in 2 files: - rag/finetune_rag.py (199:208) - seq2seq-distillation/finetune.py (130:139) duplicated block id: 918 size: 7 cleaned lines of code in 2 files: - movement-pruning/bertarize.py (108:114) - movement-pruning/counts_parameters.py (76:82) duplicated block id: 919 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (309:316) - rag-end2end-retriever/lightning_base.py (219:225) duplicated block id: 920 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (770:779) - xtreme-s/run_xtreme_s.py (940:949) duplicated block id: 921 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (460:466) - rag/finetune_rag.py (384:390) duplicated block id: 922 size: 7 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (335:341) - tapex/run_wikisql_with_tapex.py (353:359) duplicated block id: 923 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (356:364) - rag/lightning_base.py (346:354) duplicated block id: 924 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (123:129) - movement-pruning/masked_run_glue.py (144:151) duplicated block id: 925 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (486:492) - movement-pruning/masked_run_glue.py (746:753) duplicated block id: 926 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:329) - seq2seq-distillation/finetune.py (305:311) duplicated block id: 927 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (394:400) - seq2seq-distillation/finetune.py (323:329) duplicated block id: 928 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:329) - seq2seq-distillation/finetune.py (314:320) duplicated block id: 929 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:329) - seq2seq-distillation/finetune.py (323:329) duplicated block id: 930 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (394:400) - seq2seq-distillation/finetune.py (305:311) duplicated block id: 931 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (486:492) - luke/run_luke_ner_no_trainer.py (164:170) duplicated block id: 932 size: 7 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (143:149) - visual_bert/processing_image.py (145:151) duplicated block id: 933 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (36:42) - robust-speech-event/run_speech_recognition_ctc_streaming.py (34:40) duplicated block id: 934 size: 7 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (162:169) - layoutlmv3/run_funsd_cord.py (177:184) duplicated block id: 935 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (62:70) - movement-pruning/masked_run_squad.py (61:69) duplicated block id: 936 size: 7 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (621:627) - rag-end2end-retriever/finetune_rag.py (508:514) duplicated block id: 937 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (437:443) - movement-pruning/masked_run_glue.py (813:819) duplicated block id: 938 size: 7 cleaned lines of code in 2 files: - adversarial/run_hans.py (79:85) - tapex/run_wikitablequestions_with_tapex.py (150:156) duplicated block id: 939 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (520:526) - xtreme-s/run_xtreme_s.py (636:642) duplicated block id: 940 size: 7 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (130:136) - tapex/run_wikitablequestions_with_tapex.py (150:156) duplicated block id: 941 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (48:56) - movement-pruning/masked_run_glue.py (58:66) duplicated block id: 942 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:329) - rag/finetune_rag.py (394:400) duplicated block id: 943 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:329) - rag/finetune_rag.py (385:391) duplicated block id: 944 size: 7 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (872:878) - movement-pruning/masked_run_squad.py (1028:1034) duplicated block id: 945 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (517:523) - movement-pruning/masked_run_squad.py (929:935) duplicated block id: 946 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (123:129) - movement-pruning/masked_run_squad.py (151:158) duplicated block id: 947 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (357:363) - seq2seq-distillation/finetune.py (305:311) duplicated block id: 948 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (357:363) - seq2seq-distillation/finetune.py (314:320) duplicated block id: 949 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (357:363) - seq2seq-distillation/finetune.py (323:329) duplicated block id: 950 size: 7 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (540:550) - self-training-text-classification/selftraining.py (169:179) duplicated block id: 951 size: 7 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (138:144) - tapex/run_tabfact_with_tapex.py (79:85) duplicated block id: 952 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (468:475) - tapex/run_wikitablequestions_with_tapex.py (565:572) duplicated block id: 953 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:329) - rag/finetune_rag.py (403:409) duplicated block id: 954 size: 7 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (709:715) - movement-pruning/masked_run_glue.py (813:819) duplicated block id: 955 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (393:399) - rag/finetune_rag.py (411:417) duplicated block id: 956 size: 7 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (277:284) - mm-imdb/run_mmimdb.py (197:204) duplicated block id: 957 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (271:278) - movement-pruning/masked_run_glue.py (449:456) duplicated block id: 958 size: 7 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (335:341) - tapex/run_wikitablequestions_with_tapex.py (351:357) duplicated block id: 959 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (527:533) - seq2seq-distillation/finetune.py (314:320) duplicated block id: 960 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (527:533) - seq2seq-distillation/finetune.py (305:311) duplicated block id: 961 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (378:384) - movement-pruning/masked_run_squad.py (864:871) duplicated block id: 962 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (330:336) - tapex/run_wikitablequestions_with_tapex.py (351:357) duplicated block id: 963 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (55:61) - rag/finetune_rag.py (49:55) duplicated block id: 964 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (62:70) - deebert/run_glue_deebert.py (48:56) duplicated block id: 965 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (177:184) - performer/run_mlm_performer.py (185:192) duplicated block id: 966 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:329) - rag-end2end-retriever/finetune_rag.py (518:524) duplicated block id: 967 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:329) - rag-end2end-retriever/finetune_rag.py (509:515) duplicated block id: 968 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:329) - rag-end2end-retriever/finetune_rag.py (527:533) duplicated block id: 969 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (526:532) - rag-end2end-retriever/finetune_rag.py (535:541) duplicated block id: 970 size: 7 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (164:170) - movement-pruning/masked_run_glue.py (746:753) duplicated block id: 971 size: 7 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (152:158) - jax-projects/model_parallel/run_clm_mp.py (156:162) duplicated block id: 972 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (162:169) - bert-loses-patience/pabee/modeling_pabee_albert.py (182:189) duplicated block id: 973 size: 7 cleaned lines of code in 2 files: - quantization-qdqbert/evaluate-hf-trt-qa.py (382:389) - quantization-qdqbert/run_quant_qa.py (582:589) duplicated block id: 974 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (385:391) - rag/finetune_rag.py (403:409) duplicated block id: 975 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (385:391) - rag/finetune_rag.py (394:400) duplicated block id: 976 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (518:524) - rag/finetune_rag.py (385:391) duplicated block id: 977 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (544:550) - movement-pruning/masked_run_glue.py (813:819) duplicated block id: 978 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (378:384) - movement-pruning/masked_run_glue.py (746:753) duplicated block id: 979 size: 7 cleaned lines of code in 2 files: - visual_bert/modeling_frcnn.py (143:149) - visual_bert/processing_image.py (145:151) duplicated block id: 980 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (62:70) - distillation/run_squad_w_distillation.py (78:86) duplicated block id: 981 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (393:399) - movement-pruning/masked_run_squad.py (881:887) duplicated block id: 982 size: 7 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (324:330) - quantization-qdqbert/run_quant_qa.py (335:341) duplicated block id: 983 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/distributed_ray_retriever.py (79:85) - rag/distributed_pytorch_retriever.py (35:41) duplicated block id: 984 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (361:369) - seq2seq-distillation/finetune.py (288:296) duplicated block id: 985 size: 7 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (130:136) - self-training-text-classification/finetuning.py (102:108) duplicated block id: 986 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (359:365) - movement-pruning/masked_run_glue.py (530:536) duplicated block id: 987 size: 7 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (212:218) - tapex/run_wikisql_with_tapex.py (235:241) duplicated block id: 988 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (509:515) - distillation/run_squad_w_distillation.py (672:678) duplicated block id: 989 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (193:199) - deebert/src/modeling_highway_bert.py (222:228) duplicated block id: 990 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (336:342) - movement-pruning/emmental/modeling_bert_masked.py (981:987) duplicated block id: 991 size: 7 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (314:322) - jax-projects/model_parallel/run_clm_mp.py (201:209) duplicated block id: 992 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (336:342) - movement-pruning/emmental/modeling_bert_masked.py (887:893) duplicated block id: 993 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (357:363) - rag/finetune_rag.py (403:409) duplicated block id: 994 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (474:482) - seq2seq-distillation/finetune.py (288:296) duplicated block id: 995 size: 7 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (236:245) - self-training-text-classification/finetuning.py (540:550) duplicated block id: 996 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (481:487) - rag/finetune_rag.py (384:390) duplicated block id: 997 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (512:518) - mm-imdb/run_mmimdb.py (378:384) duplicated block id: 998 size: 7 cleaned lines of code in 2 files: - bertology/run_bertology.py (254:261) - mm-imdb/run_mmimdb.py (312:320) duplicated block id: 999 size: 7 cleaned lines of code in 2 files: - lxmert/processing_image.py (145:151) - visual_bert/modeling_frcnn.py (143:149) duplicated block id: 1000 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (309:316) - seq2seq-distillation/lightning_base.py (217:223) duplicated block id: 1001 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (273:281) - seq2seq-distillation/finetune.py (180:188) duplicated block id: 1002 size: 7 cleaned lines of code in 2 files: - rag/distributed_pytorch_retriever.py (35:41) - rag/distributed_ray_retriever.py (72:78) duplicated block id: 1003 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (512:518) - deebert/run_glue_deebert.py (486:492) duplicated block id: 1004 size: 7 cleaned lines of code in 2 files: - longform-qa/eli5_utils.py (203:209) - longform-qa/eli5_utils.py (394:400) duplicated block id: 1005 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (123:135) - movement-pruning/emmental/modeling_bert_masked.py (486:498) duplicated block id: 1006 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (403:409) - seq2seq-distillation/finetune.py (314:320) duplicated block id: 1007 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (403:409) - seq2seq-distillation/finetune.py (305:311) duplicated block id: 1008 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (513:519) - quantization-qdqbert/run_quant_qa.py (667:673) duplicated block id: 1009 size: 7 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (139:145) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (111:117) duplicated block id: 1010 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (500:506) - mm-imdb/run_mmimdb.py (393:399) duplicated block id: 1011 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (481:487) - rag-end2end-retriever/finetune_rag.py (508:514) duplicated block id: 1012 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (512:518) - movement-pruning/masked_run_squad.py (864:871) duplicated block id: 1013 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (460:466) - rag-end2end-retriever/finetune_rag.py (508:514) duplicated block id: 1014 size: 7 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (621:627) - rag/finetune_rag.py (384:390) duplicated block id: 1015 size: 7 cleaned lines of code in 2 files: - seq2seq-distillation/finetune.py (322:328) - seq2seq-distillation/finetune.py (331:337) duplicated block id: 1016 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (336:342) - movement-pruning/emmental/modeling_bert_masked.py (807:813) duplicated block id: 1017 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (336:342) - movement-pruning/emmental/modeling_bert_masked.py (714:720) duplicated block id: 1018 size: 7 cleaned lines of code in 2 files: - adversarial/run_hans.py (132:141) - mlm_wwm/run_mlm_wwm.py (236:245) duplicated block id: 1019 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (385:391) - seq2seq-distillation/finetune.py (314:320) duplicated block id: 1020 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (385:391) - seq2seq-distillation/finetune.py (323:329) duplicated block id: 1021 size: 7 cleaned lines of code in 2 files: - adversarial/run_hans.py (79:85) - jax-projects/hybrid_clip/run_hybrid_clip.py (138:144) duplicated block id: 1022 size: 7 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (324:330) - tapex/run_wikitablequestions_with_tapex.py (351:357) duplicated block id: 1023 size: 7 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (102:108) - tapex/run_wikitablequestions_with_tapex.py (150:156) duplicated block id: 1024 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (527:533) - rag/finetune_rag.py (385:391) duplicated block id: 1025 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (588:594) - seq2seq-distillation/finetune.py (396:402) duplicated block id: 1026 size: 7 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (162:169) - tapex/run_wikitablequestions_with_tapex.py (228:235) duplicated block id: 1027 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (326:332) - deebert/run_glue_deebert.py (299:305) duplicated block id: 1028 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (307:315) - xtreme-s/run_xtreme_s.py (351:359) duplicated block id: 1029 size: 7 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (111:117) - performer/run_mlm_performer.py (154:160) duplicated block id: 1030 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (50:56) - information-gain-filtration/run_clm_igf.py (403:409) duplicated block id: 1031 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (182:188) - quantization-qdqbert/run_quant_qa.py (212:218) duplicated block id: 1032 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (330:336) - tapex/run_tabfact_with_tapex.py (307:313) duplicated block id: 1033 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (534:540) - mm-imdb/run_mmimdb.py (393:399) duplicated block id: 1034 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (48:56) - distillation/run_squad_w_distillation.py (78:86) duplicated block id: 1035 size: 7 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (111:117) - mlm_wwm/run_mlm_wwm.py (144:150) duplicated block id: 1036 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (704:710) - robust-speech-event/run_speech_recognition_ctc_streaming.py (610:616) duplicated block id: 1037 size: 7 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (102:108) - tapex/run_tabfact_with_tapex.py (79:85) duplicated block id: 1038 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (509:517) - xtreme-s/run_xtreme_s.py (710:718) duplicated block id: 1039 size: 7 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (324:330) - tapex/run_tabfact_with_tapex.py (307:313) duplicated block id: 1040 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (517:523) - distillation/run_squad_w_distillation.py (680:686) duplicated block id: 1041 size: 7 cleaned lines of code in 2 files: - seq2seq-distillation/finetune.py (305:311) - seq2seq-distillation/finetune.py (323:329) duplicated block id: 1042 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (303:310) - movement-pruning/masked_run_squad.py (462:469) duplicated block id: 1043 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (512:518) - movement-pruning/masked_run_glue.py (746:753) duplicated block id: 1044 size: 7 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (156:162) - performer/run_mlm_performer.py (167:173) duplicated block id: 1045 size: 7 cleaned lines of code in 2 files: - seq2seq-distillation/finetune.py (305:311) - seq2seq-distillation/finetune.py (314:320) duplicated block id: 1046 size: 7 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (813:819) - movement-pruning/masked_run_squad.py (969:975) duplicated block id: 1047 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (357:363) - rag/finetune_rag.py (394:400) duplicated block id: 1048 size: 7 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (53:59) - performer/run_mlm_performer.py (49:55) duplicated block id: 1049 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (670:679) - xtreme-s/run_xtreme_s.py (940:949) duplicated block id: 1050 size: 7 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (143:149) - lxmert/processing_image.py (145:151) duplicated block id: 1051 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (623:629) - movement-pruning/masked_run_glue.py (881:887) duplicated block id: 1052 size: 7 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (164:170) - mm-imdb/run_mmimdb.py (378:384) duplicated block id: 1053 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (182:188) - bert-loses-patience/run_glue_with_pabee.py (308:314) duplicated block id: 1054 size: 7 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (78:86) - movement-pruning/masked_run_squad.py (61:69) duplicated block id: 1055 size: 7 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (142:148) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (111:117) duplicated block id: 1056 size: 7 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (641:647) - mm-imdb/run_mmimdb.py (393:399) duplicated block id: 1057 size: 7 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (429:435) - jax-projects/model_parallel/run_clm_mp.py (458:464) duplicated block id: 1058 size: 7 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (339:347) - performer/run_mlm_performer.py (569:577) duplicated block id: 1059 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (673:679) - movement-pruning/masked_run_glue.py (881:887) duplicated block id: 1060 size: 7 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (201:209) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (229:237) duplicated block id: 1061 size: 7 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (307:313) - tapex/run_wikisql_with_tapex.py (353:359) duplicated block id: 1062 size: 7 cleaned lines of code in 2 files: - adversarial/run_hans.py (79:85) - quantization-qdqbert/run_quant_qa.py (130:136) duplicated block id: 1063 size: 7 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (335:341) - tapex/run_tabfact_with_tapex.py (307:313) duplicated block id: 1064 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (215:222) - mm-imdb/run_mmimdb.py (197:204) duplicated block id: 1065 size: 7 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (138:144) - self-training-text-classification/finetuning.py (102:108) duplicated block id: 1066 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (518:524) - seq2seq-distillation/finetune.py (305:311) duplicated block id: 1067 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (518:524) - seq2seq-distillation/finetune.py (323:329) duplicated block id: 1068 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (304:312) - xtreme-s/run_xtreme_s.py (351:359) duplicated block id: 1069 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (640:648) - wav2vec2/run_common_voice.py (494:502) duplicated block id: 1070 size: 7 cleaned lines of code in 2 files: - rag/finetune_rag.py (402:408) - rag/finetune_rag.py (411:417) duplicated block id: 1071 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (738:746) - robust-speech-event/run_speech_recognition_ctc_streaming.py (640:648) duplicated block id: 1072 size: 7 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (130:136) - tapex/run_tabfact_with_tapex.py (79:85) duplicated block id: 1073 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (360:367) - movement-pruning/emmental/modeling_bert_masked.py (731:738) duplicated block id: 1074 size: 7 cleaned lines of code in 2 files: - quantization-qdqbert/evaluate-hf-trt-qa.py (252:258) - self-training-text-classification/selftraining.py (179:186) duplicated block id: 1075 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (422:429) - xtreme-s/run_xtreme_s.py (507:514) duplicated block id: 1076 size: 7 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (496:503) - jax-projects/model_parallel/run_clm_mp.py (572:579) duplicated block id: 1077 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (410:416) - movement-pruning/masked_run_squad.py (929:935) duplicated block id: 1078 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_roberta.py (117:124) - movement-pruning/emmental/modeling_bert_masked.py (731:738) duplicated block id: 1079 size: 7 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (164:170) - movement-pruning/masked_run_squad.py (864:871) duplicated block id: 1080 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (330:336) - mlm_wwm/run_mlm_wwm.py (324:330) duplicated block id: 1081 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (481:491) - quantization-qdqbert/run_quant_qa.py (643:653) duplicated block id: 1082 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (738:746) - wav2vec2/run_common_voice.py (494:502) duplicated block id: 1083 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (517:523) - rag-end2end-retriever/finetune_rag.py (535:541) duplicated block id: 1084 size: 7 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (156:162) - mlm_wwm/run_mlm_wwm.py (157:163) duplicated block id: 1085 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (509:515) - rag/finetune_rag.py (394:400) duplicated block id: 1086 size: 7 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (435:443) - xtreme-s/run_xtreme_s.py (520:528) duplicated block id: 1087 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (41:59) - movement-pruning/masked_run_glue.py (38:55) duplicated block id: 1088 size: 7 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (212:218) - tapex/run_wikitablequestions_with_tapex.py (233:239) duplicated block id: 1089 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (509:515) - seq2seq-distillation/finetune.py (314:320) duplicated block id: 1090 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (509:515) - seq2seq-distillation/finetune.py (323:329) duplicated block id: 1091 size: 7 cleaned lines of code in 2 files: - adversarial/run_hans.py (79:85) - tapex/run_wikisql_with_tapex.py (152:158) duplicated block id: 1092 size: 7 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (672:678) - movement-pruning/masked_run_glue.py (771:777) duplicated block id: 1093 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (591:597) - movement-pruning/masked_run_glue.py (813:819) duplicated block id: 1094 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (92:99) - movement-pruning/emmental/modeling_bert_masked.py (359:366) duplicated block id: 1095 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (535:541) - rag/finetune_rag.py (393:399) duplicated block id: 1096 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (62:70) - movement-pruning/masked_run_glue.py (58:66) duplicated block id: 1097 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (509:515) - rag/finetune_rag.py (403:409) duplicated block id: 1098 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (309:316) - rag/lightning_base.py (217:223) duplicated block id: 1099 size: 7 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (138:144) - quantization-qdqbert/run_quant_qa.py (130:136) duplicated block id: 1100 size: 7 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (672:678) - mm-imdb/run_mmimdb.py (401:407) duplicated block id: 1101 size: 7 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (738:748) - movement-pruning/emmental/modeling_bert_masked.py (914:924) duplicated block id: 1102 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (32:42) - rag/finetune_rag.py (25:35) duplicated block id: 1103 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (47:53) - movement-pruning/emmental/modeling_bert_masked.py (120:126) duplicated block id: 1104 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (468:475) - tapex/run_wikisql_with_tapex.py (589:596) duplicated block id: 1105 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (535:541) - rag/finetune_rag.py (402:408) duplicated block id: 1106 size: 7 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (307:313) - tapex/run_wikitablequestions_with_tapex.py (351:357) duplicated block id: 1107 size: 7 cleaned lines of code in 2 files: - seq2seq-distillation/finetune.py (314:320) - seq2seq-distillation/finetune.py (323:329) duplicated block id: 1108 size: 7 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (549:555) - deebert/run_glue_deebert.py (511:517) duplicated block id: 1109 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (509:515) - rag-end2end-retriever/finetune_rag.py (527:533) duplicated block id: 1110 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (509:515) - rag-end2end-retriever/finetune_rag.py (518:524) duplicated block id: 1111 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (48:56) - movement-pruning/masked_run_squad.py (61:69) duplicated block id: 1112 size: 7 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (130:136) - tapex/run_wikisql_with_tapex.py (152:158) duplicated block id: 1113 size: 7 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (324:330) - tapex/run_wikisql_with_tapex.py (353:359) duplicated block id: 1114 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (357:363) - rag-end2end-retriever/finetune_rag.py (527:533) duplicated block id: 1115 size: 7 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (357:363) - rag-end2end-retriever/finetune_rag.py (518:524) duplicated block id: 1116 size: 7 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (236:243) - mm-imdb/run_mmimdb.py (312:320) duplicated block id: 1117 size: 7 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:329) - mm-imdb/run_mmimdb.py (357:363) duplicated block id: 1118 size: 7 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (486:492) - movement-pruning/masked_run_squad.py (864:871) duplicated block id: 1119 size: 7 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (138:144) - tapex/run_wikisql_with_tapex.py (152:158) duplicated block id: 1120 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (517:523) - rag/finetune_rag.py (411:417) duplicated block id: 1121 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/kb_encode_utils.py (19:25) - rag-end2end-retriever/use_own_knowledge_dataset.py (29:35) duplicated block id: 1122 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/kb_encode_utils.py (19:25) - rag/use_own_knowledge_dataset.py (36:42) duplicated block id: 1123 size: 7 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (138:144) - tapex/run_wikitablequestions_with_tapex.py (150:156) duplicated block id: 1124 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (330:336) - tapex/run_wikisql_with_tapex.py (353:359) duplicated block id: 1125 size: 7 cleaned lines of code in 2 files: - adversarial/run_hans.py (108:114) - performer/run_mlm_performer.py (463:469) duplicated block id: 1126 size: 7 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (195:201) - wav2vec2/run_pretrain.py (201:207) duplicated block id: 1127 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (47:53) - movement-pruning/emmental/modeling_bert_masked.py (224:230) duplicated block id: 1128 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (755:761) - seq2seq-distillation/finetune.py (396:402) duplicated block id: 1129 size: 7 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (192:198) - self-training-text-classification/selftraining.py (81:87) duplicated block id: 1130 size: 7 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (680:686) - mm-imdb/run_mmimdb.py (410:416) duplicated block id: 1131 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (468:475) - wav2vec2/run_common_voice.py (489:496) duplicated block id: 1132 size: 7 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (78:86) - movement-pruning/masked_run_glue.py (58:66) duplicated block id: 1133 size: 7 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (162:169) - tapex/run_wikisql_with_tapex.py (230:237) duplicated block id: 1134 size: 7 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (102:108) - tapex/run_wikisql_with_tapex.py (152:158) duplicated block id: 1135 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (47:53) - movement-pruning/emmental/modeling_bert_masked.py (330:336) duplicated block id: 1136 size: 7 cleaned lines of code in 2 files: - deebert/src/modeling_highway_bert.py (47:53) - movement-pruning/emmental/modeling_bert_masked.py (297:303) duplicated block id: 1137 size: 7 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (330:336) - quantization-qdqbert/run_quant_qa.py (335:341) duplicated block id: 1138 size: 7 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (526:532) - rag/finetune_rag.py (411:417) duplicated block id: 1139 size: 7 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (353:361) - performer/run_mlm_performer.py (478:486) duplicated block id: 1140 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (592:597) - quantization-qdqbert/evaluate-hf-trt-qa.py (55:61) duplicated block id: 1141 size: 6 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (185:196) - wav2vec2/run_common_voice.py (257:268) duplicated block id: 1142 size: 6 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1725:1730) - visual_bert/utils.py (200:205) duplicated block id: 1143 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (295:302) - tapex/run_tabfact_with_tapex.py (185:196) duplicated block id: 1144 size: 6 cleaned lines of code in 2 files: - movement-pruning/Saving_PruneBERT.ipynb (48:53) - movement-pruning/Saving_PruneBERT.ipynb (542:547) duplicated block id: 1145 size: 6 cleaned lines of code in 2 files: - codeparrot/scripts/codeparrot_training.py (62:67) - codeparrot/scripts/validation_loss.py (21:26) duplicated block id: 1146 size: 6 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (566:571) - rag-end2end-retriever/lightning_base.py (139:144) duplicated block id: 1147 size: 6 cleaned lines of code in 2 files: - movement-pruning/Saving_PruneBERT.ipynb (404:409) - movement-pruning/Saving_PruneBERT.ipynb (542:547) duplicated block id: 1148 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (461:466) - information-gain-filtration/run_clm_igf.py (322:327) duplicated block id: 1149 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (269:275) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (226:232) duplicated block id: 1150 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (338:343) - performer/run_mlm_performer.py (560:565) duplicated block id: 1151 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (701:710) - mm-imdb/run_mmimdb.py (529:538) duplicated block id: 1152 size: 6 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (196:207) - tapex/run_tabfact_with_tapex.py (185:196) duplicated block id: 1153 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (617:622) - tapex/run_tabfact_with_tapex.py (410:415) duplicated block id: 1154 size: 6 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (226:237) - wav2vec2/run_common_voice.py (257:268) duplicated block id: 1155 size: 6 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:327) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1156 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (764:771) - movement-pruning/masked_run_glue.py (863:869) duplicated block id: 1157 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (461:466) - seq2seq-distillation/finetune.py (314:319) duplicated block id: 1158 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (461:466) - seq2seq-distillation/finetune.py (305:310) duplicated block id: 1159 size: 6 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (301:307) - movement-pruning/masked_run_squad.py (675:680) duplicated block id: 1160 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (461:466) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1161 size: 6 cleaned lines of code in 2 files: - rag/distributed_pytorch_retriever.py (36:41) - rag/distributed_ray_retriever.py (20:25) duplicated block id: 1162 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (461:466) - seq2seq-distillation/finetune.py (323:328) duplicated block id: 1163 size: 6 cleaned lines of code in 2 files: - rag/finetune_rag.py (394:399) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1164 size: 6 cleaned lines of code in 2 files: - bertology/run_bertology.py (263:268) - deebert/run_glue_deebert.py (412:417) duplicated block id: 1165 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (438:443) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (437:442) duplicated block id: 1166 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (300:306) - wav2vec2/run_common_voice.py (185:190) duplicated block id: 1167 size: 6 cleaned lines of code in 2 files: - movement-pruning/Saving_PruneBERT.ipynb (48:53) - movement-pruning/Saving_PruneBERT.ipynb (404:409) duplicated block id: 1168 size: 6 cleaned lines of code in 2 files: - codeparrot/scripts/codeparrot_training.py (85:90) - codeparrot/scripts/validation_loss.py (36:41) duplicated block id: 1169 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (482:487) - rag-end2end-retriever/finetune_rag.py (536:541) duplicated block id: 1170 size: 6 cleaned lines of code in 2 files: - performer/modeling_flax_performer.py (250:256) - performer/modeling_flax_performer.py (273:279) duplicated block id: 1171 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (622:627) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1172 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (622:627) - seq2seq-distillation/finetune.py (314:319) duplicated block id: 1173 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (622:627) - seq2seq-distillation/finetune.py (323:328) duplicated block id: 1174 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (622:627) - seq2seq-distillation/finetune.py (305:310) duplicated block id: 1175 size: 6 cleaned lines of code in 2 files: - movement-pruning/Saving_PruneBERT.ipynb (269:274) - movement-pruning/Saving_PruneBERT.ipynb (590:595) duplicated block id: 1176 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (131:146) - xtreme-s/run_xtreme_s.py (148:163) duplicated block id: 1177 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (657:663) - tapex/run_wikisql_with_tapex.py (622:628) duplicated block id: 1178 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (329:334) - quantization-qdqbert/evaluate-hf-trt-qa.py (55:61) duplicated block id: 1179 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (536:541) - seq2seq-distillation/finetune.py (314:319) duplicated block id: 1180 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (536:541) - seq2seq-distillation/finetune.py (323:328) duplicated block id: 1181 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (536:541) - seq2seq-distillation/finetune.py (305:310) duplicated block id: 1182 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/distributed_ray_retriever.py (20:25) - rag/distributed_ray_retriever.py (73:78) duplicated block id: 1183 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (381:387) - seq2seq-distillation/finetune.py (182:188) duplicated block id: 1184 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (536:541) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1185 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (89:94) - luke/run_luke_ner_no_trainer.py (561:566) duplicated block id: 1186 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (508:513) - xtreme-s/run_xtreme_s.py (693:698) duplicated block id: 1187 size: 6 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (99:104) - movement-pruning/emmental/modeling_bert_masked.py (106:111) duplicated block id: 1188 size: 6 cleaned lines of code in 2 files: - movement-pruning/Saving_PruneBERT.ipynb (48:53) - movement-pruning/Saving_PruneBERT.ipynb (55:60) duplicated block id: 1189 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/utils_rag.py (78:83) - seq2seq-distillation/utils.py (193:199) duplicated block id: 1190 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (27:45) - movement-pruning/masked_run_glue.py (39:55) duplicated block id: 1191 size: 6 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (301:307) - mm-imdb/run_mmimdb.py (329:334) duplicated block id: 1192 size: 6 cleaned lines of code in 2 files: - movement-pruning/Saving_PruneBERT.ipynb (269:274) - movement-pruning/Saving_PruneBERT.ipynb (348:353) duplicated block id: 1193 size: 6 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (192:203) - robust-speech-event/run_speech_recognition_ctc_bnb.py (364:375) duplicated block id: 1194 size: 6 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (434:441) - tapex/run_wikitablequestions_with_tapex.py (582:589) duplicated block id: 1195 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (608:614) - movement-pruning/masked_run_squad.py (1020:1027) duplicated block id: 1196 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (319:330) - tapex/run_tabfact_with_tapex.py (185:196) duplicated block id: 1197 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (336:343) - rag/lightning_base.py (214:219) duplicated block id: 1198 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (221:226) - movement-pruning/masked_run_squad.py (300:305) duplicated block id: 1199 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (115:120) - movement-pruning/masked_run_glue.py (135:140) duplicated block id: 1200 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (57:68) - wav2vec2/run_pretrain.py (34:45) duplicated block id: 1201 size: 6 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1725:1730) - lxmert/utils.py (200:205) duplicated block id: 1202 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (364:375) - tapex/run_tabfact_with_tapex.py (185:196) duplicated block id: 1203 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (357:362) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1204 size: 6 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (153:158) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (116:121) duplicated block id: 1205 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (211:217) - movement-pruning/masked_run_squad.py (217:223) duplicated block id: 1206 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (548:553) - rag/eval_rag.py (216:221) duplicated block id: 1207 size: 6 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:327) - rag/finetune_rag.py (412:417) duplicated block id: 1208 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (209:214) - movement-pruning/masked_run_glue.py (402:407) duplicated block id: 1209 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (228:236) - movement-pruning/masked_run_glue.py (378:386) duplicated block id: 1210 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (640:647) - tapex/run_wikisql_with_tapex.py (594:601) duplicated block id: 1211 size: 6 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (739:748) - movement-pruning/emmental/modeling_bert_masked.py (828:837) duplicated block id: 1212 size: 6 cleaned lines of code in 2 files: - bertology/run_bertology.py (277:282) - information-gain-filtration/run_clm_igf.py (301:307) duplicated block id: 1213 size: 6 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (566:571) - rag/lightning_base.py (137:142) duplicated block id: 1214 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (536:541) - rag/finetune_rag.py (385:390) duplicated block id: 1215 size: 6 cleaned lines of code in 2 files: - wav2vec2/run_asr.py (442:450) - wav2vec2/run_common_voice.py (441:449) duplicated block id: 1216 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (366:371) - tapex/run_tabfact_with_tapex.py (326:331) duplicated block id: 1217 size: 6 cleaned lines of code in 2 files: - visual_bert/modeling_frcnn.py (1228:1233) - visual_bert/modeling_frcnn.py (1239:1244) duplicated block id: 1218 size: 6 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (69:76) - self-training-text-classification/selftraining.py (47:54) duplicated block id: 1219 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (738:745) - tapex/run_wikisql_with_tapex.py (594:601) duplicated block id: 1220 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (527:532) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1221 size: 6 cleaned lines of code in 2 files: - visual_bert/visualizing_image.py (309:314) - visual_bert/visualizing_image.py (443:448) duplicated block id: 1222 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (432:437) - bertology/run_bertology.py (270:275) duplicated block id: 1223 size: 6 cleaned lines of code in 2 files: - visual_bert/visualizing_image.py (309:314) - visual_bert/visualizing_image.py (481:486) duplicated block id: 1224 size: 6 cleaned lines of code in 2 files: - visual_bert/visualizing_image.py (309:314) - visual_bert/visualizing_image.py (462:467) duplicated block id: 1225 size: 6 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (371:376) - layoutlmv3/run_funsd_cord.py (403:408) duplicated block id: 1226 size: 6 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (371:376) - layoutlmv3/run_funsd_cord.py (387:392) duplicated block id: 1227 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (426:431) - information-gain-filtration/run_clm_igf.py (301:307) duplicated block id: 1228 size: 6 cleaned lines of code in 2 files: - longform-qa/eli5_utils.py (236:242) - longform-qa/eli5_utils.py (279:285) duplicated block id: 1229 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_albert.py (156:162) - bert-loses-patience/pabee/modeling_pabee_bert.py (179:185) duplicated block id: 1230 size: 6 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (100:111) - tapex/run_wikitablequestions_with_tapex.py (107:118) duplicated block id: 1231 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (487:492) - distillation/run_squad_w_distillation.py (629:634) duplicated block id: 1232 size: 6 cleaned lines of code in 2 files: - longform-qa/eli5_utils.py (249:254) - longform-qa/eli5_utils.py (292:297) duplicated block id: 1233 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/utils_rag.py (24:29) - seq2seq-distillation/utils.py (214:219) duplicated block id: 1234 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (440:447) - seq2seq-distillation/lightning_base.py (214:219) duplicated block id: 1235 size: 6 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (178:183) - performer/run_mlm_performer.py (191:196) duplicated block id: 1236 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (549:554) - mm-imdb/run_mmimdb.py (403:408) duplicated block id: 1237 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (425:430) - bertology/run_bertology.py (263:268) duplicated block id: 1238 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (426:431) - quantization-qdqbert/evaluate-hf-trt-qa.py (55:61) duplicated block id: 1239 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/lightning_base.py (139:144) - self-training-text-classification/finetuning.py (746:751) duplicated block id: 1240 size: 6 cleaned lines of code in 2 files: - mlm_wwm/run_mlm_wwm.py (158:163) - wav2vec2/run_pretrain.py (123:128) duplicated block id: 1241 size: 6 cleaned lines of code in 2 files: - adversarial/utils_hans.py (99:105) - adversarial/utils_hans.py (171:177) duplicated block id: 1242 size: 6 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:327) - rag-end2end-retriever/finetune_rag.py (536:541) duplicated block id: 1243 size: 6 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (561:566) - mm-imdb/run_mmimdb.py (87:92) duplicated block id: 1244 size: 6 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (107:118) - tapex/run_wikisql_with_tapex.py (109:120) duplicated block id: 1245 size: 6 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (83:88) - xtreme-s/run_xtreme_s.py (221:226) duplicated block id: 1246 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (51:56) - mm-imdb/run_mmimdb.py (57:62) duplicated block id: 1247 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (57:62) - movement-pruning/masked_run_glue.py (61:66) duplicated block id: 1248 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (57:62) - movement-pruning/masked_run_squad.py (64:69) duplicated block id: 1249 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/utils_rag.py (99:104) - seq2seq-distillation/utils.py (203:208) duplicated block id: 1250 size: 6 cleaned lines of code in 2 files: - rag/finetune_rag.py (385:390) - rag/finetune_rag.py (412:417) duplicated block id: 1251 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (705:710) - rag-end2end-retriever/lightning_base.py (216:221) duplicated block id: 1252 size: 6 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (434:441) - tapex/run_wikisql_with_tapex.py (606:613) duplicated block id: 1253 size: 6 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (184:189) - layoutlmv3/run_funsd_cord.py (179:184) duplicated block id: 1254 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (645:653) - tapex/run_wikitablequestions_with_tapex.py (582:589) duplicated block id: 1255 size: 6 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1172:1177) - visual_bert/modeling_frcnn.py (1239:1244) duplicated block id: 1256 size: 6 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (387:392) - layoutlmv3/run_funsd_cord.py (403:408) duplicated block id: 1257 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (426:431) - movement-pruning/masked_run_squad.py (675:680) duplicated block id: 1258 size: 6 cleaned lines of code in 2 files: - movement-pruning/Saving_PruneBERT.ipynb (348:353) - movement-pruning/Saving_PruneBERT.ipynb (590:595) duplicated block id: 1259 size: 6 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1228:1233) - lxmert/modeling_frcnn.py (1239:1244) duplicated block id: 1260 size: 6 cleaned lines of code in 2 files: - seq2seq-distillation/_test_seq2seq_examples.py (300:305) - seq2seq-distillation/_test_seq2seq_examples.py (348:353) duplicated block id: 1261 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (440:447) - rag/lightning_base.py (214:219) duplicated block id: 1262 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (461:466) - rag/finetune_rag.py (412:417) duplicated block id: 1263 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (461:466) - rag/finetune_rag.py (403:408) duplicated block id: 1264 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (264:270) - movement-pruning/masked_run_glue.py (454:459) duplicated block id: 1265 size: 6 cleaned lines of code in 2 files: - codeparrot/scripts/preprocessing.py (163:170) - codeparrot/scripts/pretokenizing.py (18:24) duplicated block id: 1266 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (482:487) - information-gain-filtration/run_clm_igf.py (322:327) duplicated block id: 1267 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (658:664) - movement-pruning/masked_run_squad.py (1020:1027) duplicated block id: 1268 size: 6 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (483:491) - tapex/run_tabfact_with_tapex.py (434:441) duplicated block id: 1269 size: 6 cleaned lines of code in 2 files: - seq2seq-distillation/_test_seq2seq_examples.py (300:305) - seq2seq-distillation/_test_seq2seq_examples.py (403:408) duplicated block id: 1270 size: 6 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (673:678) - self-training-text-classification/finetuning.py (258:263) duplicated block id: 1271 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (171:177) - movement-pruning/masked_run_glue.py (211:217) duplicated block id: 1272 size: 6 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (483:491) - tapex/run_wikisql_with_tapex.py (606:613) duplicated block id: 1273 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (440:447) - rag-end2end-retriever/lightning_base.py (216:221) duplicated block id: 1274 size: 6 cleaned lines of code in 2 files: - adversarial/utils_hans.py (152:159) - adversarial/utils_hans.py (238:245) duplicated block id: 1275 size: 6 cleaned lines of code in 2 files: - bertology/run_bertology.py (270:275) - deebert/run_glue_deebert.py (419:424) duplicated block id: 1276 size: 6 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (226:237) - robust-speech-event/run_speech_recognition_ctc_bnb.py (364:375) duplicated block id: 1277 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (165:170) - xtreme-s/run_xtreme_s.py (209:214) duplicated block id: 1278 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (109:114) - luke/run_luke_ner_no_trainer.py (561:566) duplicated block id: 1279 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (529:538) - movement-pruning/masked_run_glue.py (916:925) duplicated block id: 1280 size: 6 cleaned lines of code in 2 files: - codeparrot/scripts/codeparrot_training.py (230:235) - luke/run_luke_ner_no_trainer.py (593:598) duplicated block id: 1281 size: 6 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (400:405) - jax-projects/hybrid_clip/run_hybrid_clip.py (338:343) duplicated block id: 1282 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (520:532) - xtreme-s/run_xtreme_s.py (735:747) duplicated block id: 1283 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (89:94) - self-training-text-classification/finetuning.py (741:746) duplicated block id: 1284 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (357:362) - rag/finetune_rag.py (412:417) duplicated block id: 1285 size: 6 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (309:314) - lxmert/visualizing_image.py (481:486) duplicated block id: 1286 size: 6 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (309:314) - lxmert/visualizing_image.py (462:467) duplicated block id: 1287 size: 6 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (100:111) - tapex/run_wikisql_with_tapex.py (109:120) duplicated block id: 1288 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (617:622) - tapex/run_wikisql_with_tapex.py (579:584) duplicated block id: 1289 size: 6 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (309:314) - visual_bert/visualizing_image.py (443:448) duplicated block id: 1290 size: 6 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (226:237) - mlm_wwm/run_mlm_wwm.py (196:207) duplicated block id: 1291 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (738:745) - tapex/run_wikitablequestions_with_tapex.py (570:577) duplicated block id: 1292 size: 6 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (309:314) - lxmert/visualizing_image.py (443:448) duplicated block id: 1293 size: 6 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (309:314) - visual_bert/visualizing_image.py (481:486) duplicated block id: 1294 size: 6 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (309:314) - visual_bert/visualizing_image.py (462:467) duplicated block id: 1295 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (163:168) - xtreme-s/run_xtreme_s.py (209:214) duplicated block id: 1296 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (439:444) - jax-projects/model_parallel/run_clm_mp.py (467:472) duplicated block id: 1297 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (617:622) - tapex/run_wikitablequestions_with_tapex.py (555:560) duplicated block id: 1298 size: 6 cleaned lines of code in 2 files: - rag/finetune_rag.py (403:408) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1299 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (307:316) - wav2vec2/run_common_voice.py (192:201) duplicated block id: 1300 size: 6 cleaned lines of code in 2 files: - codeparrot/scripts/codeparrot_training.py (175:180) - codeparrot/scripts/validation_loss.py (53:58) duplicated block id: 1301 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (563:568) - xtreme-s/run_xtreme_s.py (693:698) duplicated block id: 1302 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (209:214) - movement-pruning/masked_run_squad.py (423:428) duplicated block id: 1303 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/modeling_hybrid_clip.py (188:194) - performer/modeling_flax_performer.py (498:504) duplicated block id: 1304 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (439:444) - information-gain-filtration/run_clm_igf.py (301:307) duplicated block id: 1305 size: 6 cleaned lines of code in 2 files: - bertology/run_bertology.py (443:453) - bertology/run_prune_gpt.py (381:391) duplicated block id: 1306 size: 6 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (116:121) - mlm_wwm/run_mlm_wwm.py (158:163) duplicated block id: 1307 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (425:430) - information-gain-filtration/run_clm_igf.py (278:283) duplicated block id: 1308 size: 6 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1172:1177) - lxmert/modeling_frcnn.py (1239:1244) duplicated block id: 1309 size: 6 cleaned lines of code in 2 files: - rag/finetune_rag.py (412:417) - seq2seq-distillation/finetune.py (323:328) duplicated block id: 1310 size: 6 cleaned lines of code in 2 files: - rag/finetune_rag.py (412:417) - seq2seq-distillation/finetune.py (314:319) duplicated block id: 1311 size: 6 cleaned lines of code in 2 files: - rag/finetune_rag.py (412:417) - seq2seq-distillation/finetune.py (305:310) duplicated block id: 1312 size: 6 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (301:307) - movement-pruning/masked_run_glue.py (592:597) duplicated block id: 1313 size: 6 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (458:463) - quantization-qdqbert/run_quant_qa.py (617:622) duplicated block id: 1314 size: 6 cleaned lines of code in 2 files: - rag/finetune_rag.py (412:417) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1315 size: 6 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (226:237) - layoutlmv3/run_funsd_cord.py (192:203) duplicated block id: 1316 size: 6 cleaned lines of code in 2 files: - rag/finetune_rag.py (385:390) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1317 size: 6 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (462:467) - visual_bert/visualizing_image.py (309:314) duplicated block id: 1318 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (482:487) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1319 size: 6 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (92:97) - movement-pruning/emmental/modeling_bert_masked.py (106:111) duplicated block id: 1320 size: 6 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (92:97) - movement-pruning/emmental/modeling_bert_masked.py (99:104) duplicated block id: 1321 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (132:147) - xtreme-s/run_xtreme_s.py (148:163) duplicated block id: 1322 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/utils_qa.py (33:38) - quantization-qdqbert/utils_qa.py (250:255) duplicated block id: 1323 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (482:487) - seq2seq-distillation/finetune.py (314:319) duplicated block id: 1324 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (482:487) - seq2seq-distillation/finetune.py (323:328) duplicated block id: 1325 size: 6 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (364:370) - wav2vec2/run_pretrain.py (369:375) duplicated block id: 1326 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (482:487) - seq2seq-distillation/finetune.py (305:310) duplicated block id: 1327 size: 6 cleaned lines of code in 2 files: - deebert/src/modeling_highway_roberta.py (95:100) - movement-pruning/emmental/modeling_bert_masked.py (715:720) duplicated block id: 1328 size: 6 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (483:491) - tapex/run_wikitablequestions_with_tapex.py (582:589) duplicated block id: 1329 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (412:417) - information-gain-filtration/run_clm_igf.py (278:283) duplicated block id: 1330 size: 6 cleaned lines of code in 2 files: - deebert/src/modeling_highway_roberta.py (95:100) - movement-pruning/emmental/modeling_bert_masked.py (808:813) duplicated block id: 1331 size: 6 cleaned lines of code in 2 files: - self-training-text-classification/finetuning.py (746:751) - seq2seq-distillation/lightning_base.py (137:142) duplicated block id: 1332 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/evaluate-hf-trt-qa.py (363:372) - quantization-qdqbert/run_quant_qa.py (563:571) duplicated block id: 1333 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (439:444) - quantization-qdqbert/evaluate-hf-trt-qa.py (55:61) duplicated block id: 1334 size: 6 cleaned lines of code in 2 files: - pplm/run_pplm_discrim_train.py (343:348) - pplm/run_pplm_discrim_train.py (399:406) duplicated block id: 1335 size: 6 cleaned lines of code in 2 files: - visual_bert/modeling_frcnn.py (1172:1177) - visual_bert/modeling_frcnn.py (1239:1244) duplicated block id: 1336 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (325:330) - mm-imdb/run_mmimdb.py (294:299) duplicated block id: 1337 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (295:302) - wav2vec2/run_common_voice.py (257:268) duplicated block id: 1338 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (297:302) - xtreme-s/run_xtreme_s.py (342:347) duplicated block id: 1339 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (295:302) - robust-speech-event/run_speech_recognition_ctc_bnb.py (364:375) duplicated block id: 1340 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (295:302) - robust-speech-event/run_speech_recognition_ctc_streaming.py (319:330) duplicated block id: 1341 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (300:306) - wav2vec2/run_asr.py (266:271) duplicated block id: 1342 size: 6 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (252:257) - quantization-qdqbert/evaluate-hf-trt-qa.py (55:61) duplicated block id: 1343 size: 6 cleaned lines of code in 2 files: - bertology/run_bertology.py (277:282) - quantization-qdqbert/evaluate-hf-trt-qa.py (55:61) duplicated block id: 1344 size: 6 cleaned lines of code in 2 files: - pplm/run_pplm_discrim_train.py (329:336) - pplm/run_pplm_discrim_train.py (382:389) duplicated block id: 1345 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (303:309) - wav2vec2/run_asr.py (266:271) duplicated block id: 1346 size: 6 cleaned lines of code in 2 files: - longform-qa/eli5_utils.py (224:230) - longform-qa/eli5_utils.py (426:432) duplicated block id: 1347 size: 6 cleaned lines of code in 2 files: - longform-qa/eli5_utils.py (224:230) - longform-qa/eli5_utils.py (465:471) duplicated block id: 1348 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (562:567) - rag-end2end-retriever/lightning_base.py (216:221) duplicated block id: 1349 size: 6 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (184:189) - tapex/run_wikitablequestions_with_tapex.py (230:235) duplicated block id: 1350 size: 6 cleaned lines of code in 2 files: - performer/run_mlm_performer.py (168:173) - wav2vec2/run_pretrain.py (123:128) duplicated block id: 1351 size: 6 cleaned lines of code in 2 files: - rag/utils_rag.py (78:83) - seq2seq-distillation/utils.py (193:199) duplicated block id: 1352 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (640:647) - tapex/run_wikitablequestions_with_tapex.py (570:577) duplicated block id: 1353 size: 6 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (252:257) - information-gain-filtration/run_clm_igf.py (301:307) duplicated block id: 1354 size: 6 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (481:486) - visual_bert/visualizing_image.py (309:314) duplicated block id: 1355 size: 6 cleaned lines of code in 2 files: - seq2seq-distillation/finetune.py (305:310) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1356 size: 6 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (157:162) - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (116:121) duplicated block id: 1357 size: 6 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (192:203) - robust-speech-event/run_speech_recognition_ctc_streaming.py (319:330) duplicated block id: 1358 size: 6 cleaned lines of code in 2 files: - adversarial/run_hans.py (41:52) - wav2vec2/run_pretrain.py (34:45) duplicated block id: 1359 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (461:466) - rag-end2end-retriever/finetune_rag.py (536:541) duplicated block id: 1360 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (295:300) - mm-imdb/run_mmimdb.py (209:214) duplicated block id: 1361 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (310:319) - wav2vec2/run_asr.py (273:282) duplicated block id: 1362 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/pabee/modeling_pabee_bert.py (193:198) - movement-pruning/emmental/modeling_bert_masked.py (640:645) duplicated block id: 1363 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (506:511) - movement-pruning/masked_run_glue.py (592:597) duplicated block id: 1364 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (295:302) - layoutlmv3/run_funsd_cord.py (192:203) duplicated block id: 1365 size: 6 cleaned lines of code in 2 files: - movement-pruning/Saving_PruneBERT.ipynb (55:60) - movement-pruning/Saving_PruneBERT.ipynb (542:547) duplicated block id: 1366 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/distributed_ray_retriever.py (20:25) - rag-end2end-retriever/distributed_ray_retriever.py (80:85) duplicated block id: 1367 size: 6 cleaned lines of code in 2 files: - bertology/run_bertology.py (277:282) - movement-pruning/masked_run_squad.py (675:680) duplicated block id: 1368 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (825:834) - mm-imdb/run_mmimdb.py (529:538) duplicated block id: 1369 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (622:627) - rag/finetune_rag.py (412:417) duplicated block id: 1370 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (622:627) - rag/finetune_rag.py (403:408) duplicated block id: 1371 size: 6 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (481:486) - jax-projects/hybrid_clip/run_hybrid_clip.py (438:443) duplicated block id: 1372 size: 6 cleaned lines of code in 2 files: - lxmert/utils.py (200:205) - visual_bert/modeling_frcnn.py (1725:1730) duplicated block id: 1373 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (509:514) - rag-end2end-retriever/finetune_rag.py (536:541) duplicated block id: 1374 size: 6 cleaned lines of code in 2 files: - movement-pruning/Saving_PruneBERT.ipynb (55:60) - movement-pruning/Saving_PruneBERT.ipynb (404:409) duplicated block id: 1375 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (592:597) - movement-pruning/masked_run_squad.py (675:680) duplicated block id: 1376 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (461:466) - rag-end2end-retriever/finetune_rag.py (527:532) duplicated block id: 1377 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (461:466) - rag-end2end-retriever/finetune_rag.py (518:523) duplicated block id: 1378 size: 6 cleaned lines of code in 2 files: - tapex/run_tabfact_with_tapex.py (83:88) - wav2vec2/run_asr.py (129:134) duplicated block id: 1379 size: 6 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (226:237) - tapex/run_tabfact_with_tapex.py (185:196) duplicated block id: 1380 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (461:466) - rag/finetune_rag.py (394:399) duplicated block id: 1381 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (608:614) - distillation/run_squad_w_distillation.py (764:771) duplicated block id: 1382 size: 6 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (226:237) - robust-speech-event/run_speech_recognition_ctc_streaming.py (319:330) duplicated block id: 1383 size: 6 cleaned lines of code in 2 files: - deebert/src/modeling_highway_roberta.py (95:100) - movement-pruning/emmental/modeling_bert_masked.py (982:987) duplicated block id: 1384 size: 6 cleaned lines of code in 2 files: - deebert/src/modeling_highway_roberta.py (95:100) - movement-pruning/emmental/modeling_bert_masked.py (888:893) duplicated block id: 1385 size: 6 cleaned lines of code in 2 files: - bertology/run_bertology.py (277:282) - distillation/run_squad_w_distillation.py (506:511) duplicated block id: 1386 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (294:299) - movement-pruning/masked_run_glue.py (496:501) duplicated block id: 1387 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (87:92) - self-training-text-classification/finetuning.py (741:746) duplicated block id: 1388 size: 6 cleaned lines of code in 2 files: - performer/modeling_flax_performer.py (227:233) - performer/modeling_flax_performer.py (274:280) duplicated block id: 1389 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (109:114) - self-training-text-classification/finetuning.py (741:746) duplicated block id: 1390 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (705:710) - rag/lightning_base.py (214:219) duplicated block id: 1391 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (518:523) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1392 size: 6 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (107:118) - tapex/run_wikitablequestions_with_tapex.py (107:118) duplicated block id: 1393 size: 6 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (168:173) - mlm_wwm/run_mlm_wwm.py (178:183) duplicated block id: 1394 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (446:453) - movement-pruning/masked_run_squad.py (459:466) duplicated block id: 1395 size: 6 cleaned lines of code in 2 files: - longform-qa/eli5_utils.py (247:252) - longform-qa/eli5_utils.py (481:486) duplicated block id: 1396 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (645:653) - tapex/run_wikisql_with_tapex.py (606:613) duplicated block id: 1397 size: 6 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (192:203) - wav2vec2/run_common_voice.py (257:268) duplicated block id: 1398 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (425:430) - bertology/run_prune_gpt.py (245:250) duplicated block id: 1399 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (57:68) - wav2vec2/run_asr.py (38:49) duplicated block id: 1400 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (640:649) - movement-pruning/masked_run_glue.py (905:914) duplicated block id: 1401 size: 6 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (498:503) - tapex/run_wikitablequestions_with_tapex.py (459:464) duplicated block id: 1402 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (548:553) - rag-end2end-retriever/eval_rag.py (216:221) duplicated block id: 1403 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (629:634) - mm-imdb/run_mmimdb.py (379:384) duplicated block id: 1404 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (509:514) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1405 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (300:305) - xtreme-s/run_xtreme_s.py (342:347) duplicated block id: 1406 size: 6 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (301:307) - quantization-qdqbert/evaluate-hf-trt-qa.py (55:61) duplicated block id: 1407 size: 6 cleaned lines of code in 2 files: - layoutlmv3/run_funsd_cord.py (192:203) - mlm_wwm/run_mlm_wwm.py (196:207) duplicated block id: 1408 size: 6 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1239:1244) - visual_bert/modeling_frcnn.py (1172:1177) duplicated block id: 1409 size: 6 cleaned lines of code in 2 files: - jax-projects/wav2vec2/run_wav2vec2_pretrain_flax.py (116:121) - performer/run_mlm_performer.py (168:173) duplicated block id: 1410 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (506:511) - information-gain-filtration/run_clm_igf.py (301:307) duplicated block id: 1411 size: 6 cleaned lines of code in 2 files: - bertology/run_prune_gpt.py (245:250) - deebert/run_glue_deebert.py (412:417) duplicated block id: 1412 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (509:514) - rag/finetune_rag.py (412:417) duplicated block id: 1413 size: 6 cleaned lines of code in 2 files: - luke/run_luke_ner_no_trainer.py (566:571) - seq2seq-distillation/lightning_base.py (137:142) duplicated block id: 1414 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (439:444) - movement-pruning/masked_run_squad.py (675:680) duplicated block id: 1415 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (336:343) - rag-end2end-retriever/lightning_base.py (216:221) duplicated block id: 1416 size: 6 cleaned lines of code in 2 files: - lxmert/visualizing_image.py (443:448) - visual_bert/visualizing_image.py (309:314) duplicated block id: 1417 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (82:89) - mm-imdb/run_mmimdb.py (80:87) duplicated block id: 1418 size: 6 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1239:1244) - visual_bert/modeling_frcnn.py (1228:1233) duplicated block id: 1419 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (513:518) - distillation/run_squad_w_distillation.py (629:634) duplicated block id: 1420 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (115:120) - movement-pruning/masked_run_squad.py (142:147) duplicated block id: 1421 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (310:319) - wav2vec2/run_common_voice.py (192:201) duplicated block id: 1422 size: 6 cleaned lines of code in 2 files: - seq2seq-distillation/finetune.py (314:319) - seq2seq-distillation/finetune.py (332:337) duplicated block id: 1423 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (81:86) - mm-imdb/run_mmimdb.py (57:62) duplicated block id: 1424 size: 6 cleaned lines of code in 2 files: - rag/lightning_base.py (137:142) - self-training-text-classification/finetuning.py (746:751) duplicated block id: 1425 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/distributed_ray_retriever.py (20:25) - rag/distributed_pytorch_retriever.py (36:41) duplicated block id: 1426 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (295:302) - mlm_wwm/run_mlm_wwm.py (196:207) duplicated block id: 1427 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (200:207) - movement-pruning/masked_run_squad.py (207:214) duplicated block id: 1428 size: 6 cleaned lines of code in 2 files: - adversarial/run_hans.py (83:88) - jax-projects/hybrid_clip/run_hybrid_clip.py (160:165) duplicated block id: 1429 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (622:627) - rag/finetune_rag.py (394:399) duplicated block id: 1430 size: 6 cleaned lines of code in 2 files: - rag/utils_rag.py (99:104) - seq2seq-distillation/utils.py (203:208) duplicated block id: 1431 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (562:567) - seq2seq-distillation/lightning_base.py (214:219) duplicated block id: 1432 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (635:640) - mm-imdb/run_mmimdb.py (386:391) duplicated block id: 1433 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (357:362) - rag-end2end-retriever/finetune_rag.py (536:541) duplicated block id: 1434 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (245:252) - movement-pruning/masked_run_glue.py (420:427) duplicated block id: 1435 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (65:70) - mm-imdb/run_mmimdb.py (57:62) duplicated block id: 1436 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/distributed_ray_retriever.py (80:85) - rag/distributed_ray_retriever.py (20:25) duplicated block id: 1437 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (165:171) - jax-projects/model_parallel/run_clm_mp.py (158:164) duplicated block id: 1438 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_bnb.py (303:309) - wav2vec2/run_common_voice.py (185:190) duplicated block id: 1439 size: 6 cleaned lines of code in 2 files: - information-gain-filtration/run_clm_igf.py (322:327) - movement-pruning/masked_run_glue.py (622:627) duplicated block id: 1440 size: 6 cleaned lines of code in 2 files: - rag/utils_rag.py (24:29) - seq2seq-distillation/utils.py (214:219) duplicated block id: 1441 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (439:444) - distillation/run_squad_w_distillation.py (506:511) duplicated block id: 1442 size: 6 cleaned lines of code in 2 files: - rag-end2end-retriever/finetune_rag.py (502:507) - seq2seq-distillation/finetune.py (298:303) duplicated block id: 1443 size: 6 cleaned lines of code in 2 files: - visual_bert/modeling_frcnn.py (1725:1730) - visual_bert/utils.py (200:205) duplicated block id: 1444 size: 6 cleaned lines of code in 2 files: - longform-qa/eli5_utils.py (292:297) - longform-qa/eli5_utils.py (451:456) duplicated block id: 1445 size: 6 cleaned lines of code in 2 files: - movement-pruning/emmental/modeling_bert_masked.py (828:837) - movement-pruning/emmental/modeling_bert_masked.py (915:924) duplicated block id: 1446 size: 6 cleaned lines of code in 2 files: - adversarial/run_hans.py (83:88) - jax-projects/model_parallel/run_clm_mp.py (137:142) duplicated block id: 1447 size: 6 cleaned lines of code in 2 files: - jax-projects/model_parallel/run_clm_mp.py (157:162) - wav2vec2/run_pretrain.py (123:128) duplicated block id: 1448 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_squad.py (705:710) - seq2seq-distillation/lightning_base.py (214:219) duplicated block id: 1449 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (482:487) - rag/finetune_rag.py (412:417) duplicated block id: 1450 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (482:487) - rag/finetune_rag.py (403:408) duplicated block id: 1451 size: 6 cleaned lines of code in 2 files: - pplm/run_pplm_discrim_train.py (303:308) - pplm/run_pplm_discrim_train.py (399:406) duplicated block id: 1452 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/evaluate-hf-trt-qa.py (242:248) - self-training-text-classification/selftraining.py (167:173) duplicated block id: 1453 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (657:663) - tapex/run_wikitablequestions_with_tapex.py (598:604) duplicated block id: 1454 size: 6 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (184:189) - tapex/run_wikisql_with_tapex.py (232:237) duplicated block id: 1455 size: 6 cleaned lines of code in 2 files: - adversarial/run_hans.py (173:178) - adversarial/run_hans.py (184:189) duplicated block id: 1456 size: 6 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (153:158) - wav2vec2/run_pretrain.py (123:128) duplicated block id: 1457 size: 6 cleaned lines of code in 2 files: - performer/modeling_flax_performer_utils.py (580:587) - performer/modeling_flax_performer_utils.py (613:620) duplicated block id: 1458 size: 6 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (311:317) - jax-projects/hybrid_clip/run_hybrid_clip.py (269:275) duplicated block id: 1459 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (482:487) - rag/finetune_rag.py (394:399) duplicated block id: 1460 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (482:487) - rag-end2end-retriever/finetune_rag.py (527:532) duplicated block id: 1461 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (482:487) - rag-end2end-retriever/finetune_rag.py (518:523) duplicated block id: 1462 size: 6 cleaned lines of code in 2 files: - tapex/run_wikitablequestions_with_tapex.py (459:464) - tapex/run_wikitablequestions_with_tapex.py (474:479) duplicated block id: 1463 size: 6 cleaned lines of code in 2 files: - longform-qa/eli5_utils.py (449:454) - longform-qa/eli5_utils.py (481:486) duplicated block id: 1464 size: 6 cleaned lines of code in 2 files: - jax-projects/big_bird/prepare_natural_questions.py (169:175) - jax-projects/big_bird/prepare_natural_questions.py (256:262) duplicated block id: 1465 size: 6 cleaned lines of code in 2 files: - quantization-qdqbert/run_quant_qa.py (645:653) - tapex/run_tabfact_with_tapex.py (434:441) duplicated block id: 1466 size: 6 cleaned lines of code in 2 files: - mm-imdb/run_mmimdb.py (336:343) - seq2seq-distillation/lightning_base.py (214:219) duplicated block id: 1467 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (629:634) - luke/run_luke_ner_no_trainer.py (165:170) duplicated block id: 1468 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (425:430) - mm-imdb/run_mmimdb.py (322:327) duplicated block id: 1469 size: 6 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (483:488) - tapex/run_wikisql_with_tapex.py (498:503) duplicated block id: 1470 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (658:664) - distillation/run_squad_w_distillation.py (764:771) duplicated block id: 1471 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (622:627) - rag-end2end-retriever/finetune_rag.py (527:532) duplicated block id: 1472 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (622:627) - rag-end2end-retriever/finetune_rag.py (518:523) duplicated block id: 1473 size: 6 cleaned lines of code in 2 files: - lxmert/modeling_frcnn.py (1228:1233) - visual_bert/modeling_frcnn.py (1239:1244) duplicated block id: 1474 size: 6 cleaned lines of code in 2 files: - jax-projects/hybrid_clip/run_hybrid_clip.py (338:343) - jax-projects/model_parallel/run_clm_mp.py (323:328) duplicated block id: 1475 size: 6 cleaned lines of code in 2 files: - tapex/run_wikisql_with_tapex.py (483:488) - tapex/run_wikitablequestions_with_tapex.py (474:479) duplicated block id: 1476 size: 6 cleaned lines of code in 2 files: - distillation/run_squad_w_distillation.py (562:567) - rag/lightning_base.py (214:219) duplicated block id: 1477 size: 6 cleaned lines of code in 2 files: - rag/distributed_ray_retriever.py (20:25) - rag/distributed_ray_retriever.py (73:78) duplicated block id: 1478 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (426:431) - distillation/run_squad_w_distillation.py (506:511) duplicated block id: 1479 size: 6 cleaned lines of code in 2 files: - robust-speech-event/run_speech_recognition_ctc_streaming.py (307:316) - wav2vec2/run_asr.py (273:282) duplicated block id: 1480 size: 6 cleaned lines of code in 2 files: - deebert/run_glue_deebert.py (412:417) - mm-imdb/run_mmimdb.py (322:327) duplicated block id: 1481 size: 6 cleaned lines of code in 2 files: - adversarial/run_hans.py (41:52) - wav2vec2/run_asr.py (38:49) duplicated block id: 1482 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (622:627) - rag-end2end-retriever/finetune_rag.py (536:541) duplicated block id: 1483 size: 6 cleaned lines of code in 2 files: - movement-pruning/masked_run_glue.py (863:869) - movement-pruning/masked_run_squad.py (1020:1027) duplicated block id: 1484 size: 6 cleaned lines of code in 2 files: - rag/finetune_rag.py (378:383) - seq2seq-distillation/finetune.py (298:303) duplicated block id: 1485 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (42:59) - deebert/run_glue_deebert.py (27:45) duplicated block id: 1486 size: 6 cleaned lines of code in 2 files: - bert-loses-patience/run_glue_with_pabee.py (250:255) - mm-imdb/run_mmimdb.py (209:214) duplicated block id: 1487 size: 6 cleaned lines of code in 2 files: - jax-projects/dataset-streaming/run_mlm_flax_stream.py (188:193) - mlm_wwm/run_mlm_wwm.py (178:183) duplicated block id: 1488 size: 6 cleaned lines of code in 2 files: - seq2seq-distillation/_test_seq2seq_examples.py (262:268) - seq2seq-distillation/_test_seq2seq_examples_multi_gpu.py (143:149)