duplicated block id: 1 size: 36 cleaned lines of code in 5 files: - step7_pipeline_parallel_afab/tensor_parallel.py (0:0) - step5_data_parallel_naive/tensor_parallel.py (0:0) - step8_pipeline_parallel_1f1b/tensor_parallel.py (0:0) - step4_tensor_parallel/tensor_parallel.py (0:0) - step6_data_parallel_bucket/tensor_parallel.py (0:0) duplicated block id: 2 size: 36 cleaned lines of code in 3 files: - step7_pipeline_parallel_afab/data_parallel.py (0:0) - step8_pipeline_parallel_1f1b/data_parallel.py (0:0) - step6_data_parallel_bucket/data_parallel.py (0:0) duplicated block id: 3 size: 32 cleaned lines of code in 7 files: - step7_pipeline_parallel_afab/process_group_manager.py (0:0) - step5_data_parallel_naive/process_group_manager.py (0:0) - step2_process_group_manager/process_group_manager.py (0:0) - step8_pipeline_parallel_1f1b/process_group_manager.py (0:0) - step3_dataloader/process_group_manager.py (0:0) - step4_tensor_parallel/process_group_manager.py (0:0) - step6_data_parallel_bucket/process_group_manager.py (0:0) duplicated block id: 4 size: 25 cleaned lines of code in 4 files: - step7_pipeline_parallel_afab/dataloader.py (0:0) - step5_data_parallel_naive/dataloader.py (0:0) - step8_pipeline_parallel_1f1b/dataloader.py (0:0) - step6_data_parallel_bucket/dataloader.py (0:0) duplicated block id: 5 size: 17 cleaned lines of code in 8 files: - step7_pipeline_parallel_afab/model.py (0:0) - step5_data_parallel_naive/model.py (0:0) - step2_process_group_manager/model.py (0:0) - step8_pipeline_parallel_1f1b/model.py (0:0) - step1_modeling/model.py (0:0) - step3_dataloader/model.py (0:0) - step4_tensor_parallel/model.py (0:0) - step6_data_parallel_bucket/model.py (0:0) duplicated block id: 6 size: 18 cleaned lines of code in 2 files: - step3_dataloader/dataloader.py (0:0) - step4_tensor_parallel/dataloader.py (0:0) duplicated block id: 7 size: 18 cleaned lines of code in 4 files: - step7_pipeline_parallel_afab/train.py (0:0) - step5_data_parallel_naive/train.py (0:0) - step8_pipeline_parallel_1f1b/train.py (0:0) - step6_data_parallel_bucket/train.py (0:0) duplicated block id: 8 size: 15 cleaned lines of code in 8 files: - step7_pipeline_parallel_afab/utils.py (0:0) - step5_data_parallel_naive/utils.py (0:0) - step2_process_group_manager/utils.py (0:0) - step8_pipeline_parallel_1f1b/utils.py (0:0) - step1_modeling/utils.py (0:0) - step3_dataloader/utils.py (0:0) - step4_tensor_parallel/utils.py (0:0) - step6_data_parallel_bucket/utils.py (0:0) duplicated block id: 9 size: 14 cleaned lines of code in 2 files: - step3_dataloader/train.py (0:0) - step4_tensor_parallel/train.py (0:0)