duplicated block id: 1 size: 46 cleaned lines of code in 2 files: - kokoro/pypi.cfg (15:71) - kokoro/pypi_presubmit.cfg (15:71) duplicated block id: 2 size: 42 cleaned lines of code in 2 files: - kokoro/presubmit_base.cfg (17:68) - kokoro/pypi_presubmit.cfg (17:68) duplicated block id: 3 size: 42 cleaned lines of code in 2 files: - kokoro/presubmit_base.cfg (17:68) - kokoro/pypi.cfg (17:68) duplicated block id: 4 size: 32 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/simulated/benchmark.py (14:51) - dataflux_pytorch/benchmark/checkpointing/simulated/llama2.py (15:52) duplicated block id: 5 size: 16 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/multinode/benchmark-deploy.yaml (54:69) - dataflux_pytorch/benchmark/checkpointing/simulated/benchmark-deployment.yaml (47:62) duplicated block id: 6 size: 14 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/multinode/train.py (140:153) - dataflux_pytorch/benchmark/checkpointing/multinode/train.py (185:198) duplicated block id: 7 size: 13 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/multinode/benchmark-deploy.yaml (57:69) - dataflux_pytorch/benchmark/standalone_dataloader/deployment.yaml (51:64) duplicated block id: 8 size: 13 cleaned lines of code in 2 files: - dataflux_pytorch/dataflux_iterable_dataset.py (96:126) - dataflux_pytorch/dataflux_mapstyle_dataset.py (99:132) duplicated block id: 9 size: 13 cleaned lines of code in 2 files: - dataflux_pytorch/dataflux_iterable_dataset.py (28:72) - dataflux_pytorch/dataflux_mapstyle_dataset.py (29:73) duplicated block id: 10 size: 13 cleaned lines of code in 2 files: - dataflux_pytorch/dataflux_iterable_dataset.py (200:217) - dataflux_pytorch/dataflux_mapstyle_dataset.py (206:225) duplicated block id: 11 size: 13 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/simulated/benchmark-deployment.yaml (50:62) - dataflux_pytorch/benchmark/standalone_dataloader/deployment.yaml (51:64) duplicated block id: 12 size: 11 cleaned lines of code in 2 files: - dataflux_pytorch/dataflux_iterable_dataset.py (73:83) - dataflux_pytorch/dataflux_mapstyle_dataset.py (75:85) duplicated block id: 13 size: 11 cleaned lines of code in 2 files: - dataflux_pytorch/dataflux_iterable_dataset.py (187:198) - dataflux_pytorch/dataflux_mapstyle_dataset.py (193:204) duplicated block id: 14 size: 10 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/multinode/benchmark-deploy.yaml (33:46) - dataflux_pytorch/benchmark/checkpointing/simulated/benchmark-deployment.yaml (33:43) duplicated block id: 15 size: 9 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/simulated/benchmark.py (88:96) - dataflux_pytorch/benchmark/checkpointing/simulated/llama2.py (90:98) duplicated block id: 16 size: 9 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/standalone_dataloader/standalone_dataloader.py (263:271) - dataflux_pytorch/benchmark/standalone_dataloader/standalone_dataloader.py (289:297) duplicated block id: 17 size: 9 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/multinode/benchmark-deploy.yaml (96:105) - dataflux_pytorch/benchmark/checkpointing/simulated/benchmark-deployment.yaml (93:102) duplicated block id: 18 size: 8 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/multinode/benchmark-deploy.yaml (19:26) - dataflux_pytorch/benchmark/checkpointing/simulated/benchmark-deployment.yaml (19:26) duplicated block id: 19 size: 8 cleaned lines of code in 2 files: - dataflux_pytorch/lightning/gcs_filesystem.py (107:114) - dataflux_pytorch/lightning/gcs_filesystem.py (122:129) duplicated block id: 20 size: 8 cleaned lines of code in 2 files: - dataflux_pytorch/multipart_upload/multipart.py (195:202) - dataflux_pytorch/multipart_upload/multipart.py (296:303) duplicated block id: 21 size: 7 cleaned lines of code in 2 files: - dataflux_pytorch/dataflux_iterable_dataset.py (137:143) - dataflux_pytorch/dataflux_mapstyle_dataset.py (145:151) duplicated block id: 22 size: 7 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/standalone_dataloader/standalone_dataloader.py (286:292) - dataflux_pytorch/dataflux_iterable_dataset.py (178:184) duplicated block id: 23 size: 6 cleaned lines of code in 2 files: - kokoro/presubmit_base.cfg (71:77) - kokoro/pypi_presubmit.cfg (65:71) duplicated block id: 24 size: 6 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/multinode/benchmark-deploy.yaml (21:26) - dataflux_pytorch/benchmark/standalone_dataloader/deployment.yaml (10:15) duplicated block id: 25 size: 6 cleaned lines of code in 2 files: - kokoro/presubmit_base.cfg (71:77) - kokoro/pypi.cfg (65:71) duplicated block id: 26 size: 6 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/multinode/benchmark-deploy.yaml (85:90) - dataflux_pytorch/benchmark/checkpointing/simulated/benchmark-deployment.yaml (77:82) duplicated block id: 27 size: 6 cleaned lines of code in 2 files: - dataflux_pytorch/dataflux_iterable_dataset.py (145:152) - dataflux_pytorch/dataflux_mapstyle_dataset.py (153:160) duplicated block id: 28 size: 6 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/simulated/benchmark.py (58:64) - dataflux_pytorch/benchmark/checkpointing/simulated/llama2.py (59:65) duplicated block id: 29 size: 6 cleaned lines of code in 2 files: - dataflux_pytorch/lightning/dataflux_lightning_checkpoint.py (34:39) - dataflux_pytorch/lightning/dataflux_lightning_checkpoint.py (93:98) duplicated block id: 30 size: 6 cleaned lines of code in 2 files: - dataflux_pytorch/dataflux_iterable_dataset.py (84:91) - dataflux_pytorch/dataflux_mapstyle_dataset.py (87:94) duplicated block id: 31 size: 6 cleaned lines of code in 2 files: - dataflux_pytorch/benchmark/checkpointing/simulated/benchmark-deployment.yaml (21:26) - dataflux_pytorch/benchmark/standalone_dataloader/deployment.yaml (10:15)