duplicated block id: 1 size: 64 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/parts/text/numbers.py (23:101) - benchmarks/rnnt/ootb/train/common/text/numbers.py (23:99) duplicated block id: 2 size: 50 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/parts/text/cleaners.py (20:89) - benchmarks/rnnt/ootb/train/common/text/cleaners.py (20:83) duplicated block id: 3 size: 50 cleaned lines of code in 2 files: - bmlogging/bmlogger.py (36:118) - fb5logging/fb5logger.py (11:93) duplicated block id: 4 size: 44 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/parts/segment.py (107:170) - benchmarks/rnnt/ootb/train/common/audio.py (118:184) duplicated block id: 5 size: 37 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/parts/segment.py (34:81) - benchmarks/rnnt/ootb/train/common/audio.py (68:116) duplicated block id: 6 size: 31 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (772:823) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1239:1289) duplicated block id: 7 size: 30 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/utils/download_librispeech.py (25:60) - benchmarks/rnnt/ootb/train/utils/download_librispeech.py (24:59) duplicated block id: 8 size: 24 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/utils/preprocessing_utils.py (48:77) - benchmarks/rnnt/ootb/train/utils/preprocessing_utils.py (47:76) duplicated block id: 9 size: 24 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (639:670) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1106:1137) duplicated block id: 10 size: 23 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/utils/download_utils.py (24:52) - benchmarks/rnnt/ootb/train/utils/download_utils.py (23:51) duplicated block id: 11 size: 22 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (1167:1189) - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (1384:1406) duplicated block id: 12 size: 21 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (725:745) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (748:768) duplicated block id: 13 size: 21 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/utils/convert_librispeech.py (35:58) - benchmarks/rnnt/ootb/train/utils/convert_librispeech.py (35:57) duplicated block id: 14 size: 20 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (834:857) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (1003:1026) duplicated block id: 15 size: 19 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (598:624) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1063:1089) duplicated block id: 16 size: 19 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (754:783) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (863:892) duplicated block id: 17 size: 18 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (251:269) - benchmarks/dlrm/ootb/data_utils.py (467:485) duplicated block id: 18 size: 17 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (700:729) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1167:1196) duplicated block id: 19 size: 17 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (620:637) - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (647:664) duplicated block id: 20 size: 17 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/utils/convert_librispeech.py (60:82) - benchmarks/rnnt/ootb/train/utils/convert_librispeech.py (59:81) duplicated block id: 21 size: 17 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (620:637) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1114:1131) duplicated block id: 22 size: 16 cleaned lines of code in 2 files: - bmlogging/loggerconstants.py (7:32) - fb5logging/loggerconstants.py (7:32) duplicated block id: 23 size: 16 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (290:305) - benchmarks/dlrm/ootb/data_utils.py (511:526) duplicated block id: 24 size: 16 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (882:904) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (938:960) duplicated block id: 25 size: 16 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/utils/preprocessing_utils.py (26:45) - benchmarks/rnnt/ootb/train/utils/preprocessing_utils.py (26:45) duplicated block id: 26 size: 16 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (237:252) - benchmarks/dlrm/ootb/data_utils.py (329:344) duplicated block id: 27 size: 14 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (280:294) - benchmarks/dlrm/ootb/data_utils.py (385:399) duplicated block id: 28 size: 14 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/model_separable_rnnt.py (187:214) - benchmarks/rnnt/ootb/train/rnnt/model.py (248:275) duplicated block id: 29 size: 14 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/metrics.py (21:37) - benchmarks/rnnt/ootb/train/common/metrics.py (19:35) duplicated block id: 30 size: 13 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (153:168) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (298:313) duplicated block id: 31 size: 13 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/utils/download_utils.py (54:69) - benchmarks/rnnt/ootb/train/utils/download_utils.py (53:68) duplicated block id: 32 size: 13 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/parts/features.py (99:113) - benchmarks/rnnt/ootb/train/common/data/features.py (180:195) duplicated block id: 33 size: 13 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/extend_distributed.py (208:220) - benchmarks/dlrm/ootb/extend_distributed.py (300:312) duplicated block id: 34 size: 13 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (412:424) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (796:808) duplicated block id: 35 size: 12 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (581:592) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (797:808) duplicated block id: 36 size: 12 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/extend_distributed.py (253:265) - benchmarks/dlrm/ootb/extend_distributed.py (345:357) duplicated block id: 37 size: 12 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/cython/cython_criteo.py (28:44) - benchmarks/dlrm/ootb/data_utils.py (1265:1281) duplicated block id: 38 size: 12 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/train/common/optimizers.py (91:110) - benchmarks/rnnt/ootb/train/common/optimizers.py (190:209) duplicated block id: 39 size: 12 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (968:979) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (983:994) duplicated block id: 40 size: 12 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/configs/rnnt.toml (19:30) - benchmarks/rnnt/ootb/inference/pytorch/configs/rnnt.toml (48:59) duplicated block id: 41 size: 12 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (413:424) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (581:592) duplicated block id: 42 size: 11 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (173:183) - benchmarks/dlrm/ootb/data_utils.py (1189:1199) duplicated block id: 43 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (825:843) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1291:1309) duplicated block id: 44 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (493:503) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (535:545) duplicated block id: 45 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (500:511) - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (545:556) duplicated block id: 46 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (347:356) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (484:493) duplicated block id: 47 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/mlperf_logger.py (38:49) - benchmarks/rnnt/ootb/train/mlperf/logging.py (51:62) duplicated block id: 48 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (359:368) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (496:505) duplicated block id: 49 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (1237:1249) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (98:110) duplicated block id: 50 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (1193:1203) - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (1408:1418) duplicated block id: 51 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/extend_distributed.py (303:312) - benchmarks/dlrm/ootb/extend_distributed.py (361:370) duplicated block id: 52 size: 10 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/utils/download_librispeech.py (65:76) - benchmarks/rnnt/ootb/train/utils/download_librispeech.py (61:72) duplicated block id: 53 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (648:659) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (697:708) duplicated block id: 54 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (316:326) - benchmarks/dlrm/ootb/data_utils.py (542:553) duplicated block id: 55 size: 10 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/parts/segment.py (95:104) - benchmarks/rnnt/ootb/train/common/audio.py (57:66) duplicated block id: 56 size: 10 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/extend_distributed.py (211:220) - benchmarks/dlrm/ootb/extend_distributed.py (361:370) duplicated block id: 57 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (948:958) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1007:1017) duplicated block id: 58 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (183:194) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (331:342) duplicated block id: 59 size: 9 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/loadgen/loadgen.cc (1268:1289) - benchmarks/rnnt/ootb/inference/loadgen/loadgen.cc (1426:1439) duplicated block id: 60 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (555:573) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1018:1036) duplicated block id: 61 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (49:57) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (53:61) duplicated block id: 62 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/cython/cython_criteo.py (47:55) - benchmarks/dlrm/ootb/data_utils.py (1284:1292) duplicated block id: 63 size: 9 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/train/common/optimizers.py (77:85) - benchmarks/rnnt/ootb/train/common/optimizers.py (173:181) duplicated block id: 64 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (527:535) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (989:997) duplicated block id: 65 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (74:82) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (83:91) duplicated block id: 66 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (483:491) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (525:533) duplicated block id: 67 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (901:910) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (924:933) duplicated block id: 68 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (892:902) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1007:1017) duplicated block id: 69 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (849:857) - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (311:319) duplicated block id: 70 size: 9 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (1309:1320) - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (1635:1646) duplicated block id: 71 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/optim/rwsadagrad.py (56:70) - benchmarks/rnnt/ootb/train/common/optimizers.py (193:207) duplicated block id: 72 size: 8 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/train/common/data/dali/iterator.py (22:34) - benchmarks/rnnt/ootb/train/common/data/dataset.py (31:43) duplicated block id: 73 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/optim/rwsadagrad.py (56:70) - benchmarks/rnnt/ootb/train/common/optimizers.py (94:108) duplicated block id: 74 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/tools/visualize.py (566:576) - benchmarks/dlrm/ootb/tools/visualize.py (582:591) duplicated block id: 75 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/tools/visualize.py (597:606) - benchmarks/dlrm/ootb/tools/visualize.py (612:621) duplicated block id: 76 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (385:393) - benchmarks/dlrm/ootb/data_utils.py (501:509) duplicated block id: 77 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (792:800) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (804:812) duplicated block id: 78 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (347:354) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (526:533) duplicated block id: 79 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (359:366) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (538:545) duplicated block id: 80 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (199:207) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (389:397) duplicated block id: 81 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (741:750) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1208:1217) duplicated block id: 82 size: 8 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/parts/features.py (50:58) - benchmarks/rnnt/ootb/inference/pytorch/parts/features.py (191:199) duplicated block id: 83 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/tools/visualize.py (627:636) - benchmarks/dlrm/ootb/tools/visualize.py (642:651) duplicated block id: 84 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (280:288) - benchmarks/dlrm/ootb/data_utils.py (501:509) duplicated block id: 85 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (985:995) - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (1014:1026) duplicated block id: 86 size: 8 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/loadgen/loadgen.cc (755:763) - benchmarks/rnnt/ootb/inference/loadgen/loadgen.cc (852:859) duplicated block id: 87 size: 8 cleaned lines of code in 2 files: - benchmarks/dlrm/ubench/dlrm_ubench_infer_driver.py (71:79) - benchmarks/dlrm/ubench/dlrm_ubench_train_driver.py (112:120) duplicated block id: 88 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (1347:1353) - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (1727:1733) duplicated block id: 89 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (801:808) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (232:239) duplicated block id: 90 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (196:202) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (279:286) duplicated block id: 91 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/cython/cython_criteo.py (47:53) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (347:353) duplicated block id: 92 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (976:985) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1051:1060) duplicated block id: 93 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (241:247) - benchmarks/dlrm/ootb/data_utils.py (455:461) duplicated block id: 94 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (816:825) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (837:846) duplicated block id: 95 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (333:339) - benchmarks/dlrm/ootb/data_utils.py (455:461) duplicated block id: 96 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (440:447) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (466:473) duplicated block id: 97 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (1284:1290) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (526:532) duplicated block id: 98 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (753:763) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1220:1230) duplicated block id: 99 size: 7 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/loadgen/loadgen.cc (1365:1372) - benchmarks/rnnt/ootb/inference/loadgen/loadgen.cc (1426:1433) duplicated block id: 100 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (776:782) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (786:792) duplicated block id: 101 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (425:434) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (810:819) duplicated block id: 102 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (264:271) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (635:642) duplicated block id: 103 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (578:584) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1041:1047) duplicated block id: 104 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (1284:1290) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (484:490) duplicated block id: 105 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/extend_distributed.py (115:121) - benchmarks/dlrm/ootb/extend_distributed.py (145:151) duplicated block id: 106 size: 7 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/loadgen/loadgen.cc (1268:1275) - benchmarks/rnnt/ootb/inference/loadgen/loadgen.cc (1365:1372) duplicated block id: 107 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (816:825) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (1006:1015) duplicated block id: 108 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ubench/dlrm_ubench_infer_driver.py (26:33) - benchmarks/dlrm/ubench/dlrm_ubench_train_driver.py (29:36) duplicated block id: 109 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (733:739) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1200:1206) duplicated block id: 110 size: 7 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/parts/text/__init__.py (6:12) - benchmarks/rnnt/ootb/train/common/text/__init__.py (7:13) duplicated block id: 111 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/cython/cython_criteo.py (47:53) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (526:532) duplicated block id: 112 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (1179:1185) - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (2330:2336) duplicated block id: 113 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (430:436) - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (440:446) duplicated block id: 114 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/cython/cython_criteo.py (47:53) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (484:490) duplicated block id: 115 size: 7 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/utils/convert_librispeech.py (27:33) - benchmarks/rnnt/ootb/train/utils/convert_librispeech.py (27:33) duplicated block id: 116 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (814:823) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (945:954) duplicated block id: 117 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (1179:1185) - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (2425:2431) duplicated block id: 118 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ubench/dlrm_ubench_infer_driver.py (62:69) - benchmarks/dlrm/ubench/dlrm_ubench_train_driver.py (103:110) duplicated block id: 119 size: 7 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/loadgen/logging.h (139:147) - benchmarks/rnnt/ootb/inference/loadgen/logging.h (153:161) duplicated block id: 120 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (450:456) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (472:478) duplicated block id: 121 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (2330:2336) - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (2425:2431) duplicated block id: 122 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/extend_distributed.py (239:246) - benchmarks/dlrm/ootb/extend_distributed.py (330:337) duplicated block id: 123 size: 7 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (1284:1290) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (347:353) duplicated block id: 124 size: 7 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/rnn.py (65:71) - benchmarks/rnnt/ootb/train/common/rnn.py (67:73) duplicated block id: 125 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (484:489) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (875:880) duplicated block id: 126 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (448:453) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (838:843) duplicated block id: 127 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (183:189) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (402:408) duplicated block id: 128 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (279:285) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (558:564) duplicated block id: 129 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (914:921) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1053:1060) duplicated block id: 130 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (1673:1678) - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (1681:1686) duplicated block id: 131 size: 6 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/parts/features.py (61:67) - benchmarks/rnnt/ootb/inference/pytorch/parts/features.py (202:208) duplicated block id: 132 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (804:809) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (924:929) duplicated block id: 133 size: 6 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/parts/manifest.py (65:78) - benchmarks/rnnt/ootb/train/common/text/__init__.py (18:31) duplicated block id: 134 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (804:809) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (901:906) duplicated block id: 135 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (838:843) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (990:995) duplicated block id: 136 size: 6 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/loadgen/bindings/c_api.cc (36:43) - benchmarks/rnnt/ootb/inference/loadgen/bindings/python_api.cc (49:56) duplicated block id: 137 size: 6 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/pytorch/rnn.py (59:64) - benchmarks/rnnt/ootb/train/common/rnn.py (58:63) duplicated block id: 138 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (516:523) - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (588:595) duplicated block id: 139 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (528:533) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (838:843) duplicated block id: 140 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/mlperf_logger.py (69:77) - benchmarks/rnnt/ootb/train/mlperf/logging.py (65:73) duplicated block id: 141 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (140:146) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (283:289) duplicated block id: 142 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (331:337) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (402:408) duplicated block id: 143 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (167:172) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (177:182) duplicated block id: 144 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (484:490) - benchmarks/dlrm/ootb/data_utils.py (525:531) duplicated block id: 145 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (659:664) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1099:1104) duplicated block id: 146 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (448:453) - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (528:533) duplicated block id: 147 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/tools/visualize.py (455:461) - benchmarks/dlrm/ootb/tools/visualize.py (490:496) duplicated block id: 148 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (448:453) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (990:995) duplicated block id: 149 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (829:834) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (876:881) duplicated block id: 150 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_loader_terabyte.py (346:351) - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (277:282) duplicated block id: 151 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_loader_terabyte.py (346:351) - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (287:292) duplicated block id: 152 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (632:637) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1099:1104) duplicated block id: 153 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_utils.py (1108:1113) - benchmarks/dlrm/ootb/data_utils.py (1177:1182) duplicated block id: 154 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (792:797) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (901:906) duplicated block id: 155 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/extend_distributed.py (328:334) - benchmarks/dlrm/ootb/extend_distributed.py (424:430) duplicated block id: 156 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (677:686) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1144:1153) duplicated block id: 157 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (1256:1261) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (1288:1293) duplicated block id: 158 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (792:797) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (924:929) duplicated block id: 159 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (370:375) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (379:384) duplicated block id: 160 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (455:461) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (845:851) duplicated block id: 161 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1099:1104) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (1126:1131) duplicated block id: 162 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (837:844) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (947:954) duplicated block id: 163 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (947:954) - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (1006:1013) duplicated block id: 164 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (277:282) - benchmarks/dlrm/ootb/dlrm_data_caffe2.py (287:292) duplicated block id: 165 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/data_loader_terabyte.py (325:330) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (474:479) duplicated block id: 166 size: 6 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/loadgen/bindings/c_api.cc (93:99) - benchmarks/rnnt/ootb/inference/loadgen/bindings/python_api.cc (116:122) duplicated block id: 167 size: 6 cleaned lines of code in 2 files: - benchmarks/rnnt/ootb/inference/loadgen/bindings/c_api.cc (114:119) - benchmarks/rnnt/ootb/inference/loadgen/bindings/python_api.cc (137:142) duplicated block id: 168 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (914:921) - benchmarks/dlrm/ootb/dlrm_data_pytorch.py (978:985) duplicated block id: 169 size: 6 cleaned lines of code in 2 files: - benchmarks/dlrm/ootb/dlrm_s_caffe2.py (1486:1491) - benchmarks/dlrm/ootb/dlrm_s_pytorch.py (2263:2270)