duplicated block id: 1 size: 20 cleaned lines of code in 2 files: - fairscale/nn/checkpoint/checkpoint_activations.py (45:95) - fairscale/nn/pipe/checkpoint.py (128:181) duplicated block id: 2 size: 14 cleaned lines of code in 2 files: - benchmarks/experimental/experimental_async_approaches.py (63:78) - benchmarks/models/transformer_lm.py (28:45) duplicated block id: 3 size: 13 cleaned lines of code in 2 files: - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (202:219) - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (252:269) duplicated block id: 4 size: 13 cleaned lines of code in 2 files: - benchmarks/golden_configs/lm_wikitext2.py (12:24) - benchmarks/golden_configs/lm_wikitext2.py (70:82) duplicated block id: 5 size: 12 cleaned lines of code in 2 files: - fairscale/experimental/nn/data_parallel/gossip/distributed.py (690:708) - fairscale/experimental/nn/data_parallel/gossip/distributed.py (775:794) duplicated block id: 6 size: 12 cleaned lines of code in 2 files: - benchmarks/experimental/experimental_async_approaches.py (695:706) - benchmarks/pipe.py (248:259) duplicated block id: 7 size: 11 cleaned lines of code in 2 files: - benchmarks/experimental/offload.py (171:183) - benchmarks/pipe.py (85:97) duplicated block id: 8 size: 11 cleaned lines of code in 2 files: - fairscale/clib/fused_adam_cuda/fused_adam_cuda_kernel.cu (227:237) - fairscale/clib/fused_adam_cuda/fused_adam_cuda_kernel.cu (246:256) duplicated block id: 9 size: 11 cleaned lines of code in 2 files: - fairscale/nn/pipe/async_pipe.py (338:353) - fairscale/nn/pipe/pipe.py (328:343) duplicated block id: 10 size: 11 cleaned lines of code in 2 files: - fairscale/nn/data_parallel/sharded_ddp.py (479:489) - fairscale/nn/data_parallel/sharded_ddp.py (637:647) duplicated block id: 11 size: 10 cleaned lines of code in 2 files: - benchmarks/experimental/experimental_async_approaches.py (637:648) - benchmarks/pipe.py (174:185) duplicated block id: 12 size: 10 cleaned lines of code in 2 files: - fairscale/experimental/nn/ssd_offload.py (313:327) - fairscale/nn/misc/flatten_params_wrapper.py (95:109) duplicated block id: 13 size: 10 cleaned lines of code in 2 files: - benchmarks/experimental/experimental_async_approaches.py (98:110) - benchmarks/models/transformer_lm.py (178:192) duplicated block id: 14 size: 10 cleaned lines of code in 2 files: - fairscale/nn/model_parallel/layers.py (95:104) - fairscale/nn/model_parallel/layers.py (163:172) duplicated block id: 15 size: 9 cleaned lines of code in 2 files: - fairscale/nn/pipe/copy.py (46:55) - fairscale/nn/pipe/copy.py (107:116) duplicated block id: 16 size: 9 cleaned lines of code in 2 files: - benchmarks/experimental/experimental_async_approaches.py (192:201) - benchmarks/experimental/experimental_async_approaches.py (327:336) duplicated block id: 17 size: 9 cleaned lines of code in 2 files: - fairscale/nn/pipe/checkpoint.py (247:256) - fairscale/nn/pipe/checkpoint.py (293:302) duplicated block id: 18 size: 9 cleaned lines of code in 2 files: - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (154:166) - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (230:242) duplicated block id: 19 size: 8 cleaned lines of code in 2 files: - fairscale/optim/adam.py (32:40) - fairscale/optim/grad_scaler.py (32:40) duplicated block id: 20 size: 8 cleaned lines of code in 2 files: - fairscale/experimental/nn/data_parallel/gossip/distributed.py (31:38) - fairscale/experimental/nn/data_parallel/gossip/utils/__init__.py (7:14) duplicated block id: 21 size: 8 cleaned lines of code in 2 files: - fairscale/nn/data_parallel/sharded_ddp.py (412:423) - fairscale/nn/data_parallel/sharded_ddp.py (455:467) duplicated block id: 22 size: 8 cleaned lines of code in 2 files: - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (178:188) - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (232:242) duplicated block id: 23 size: 8 cleaned lines of code in 2 files: - benchmarks/moe.py (65:73) - benchmarks/pipe.py (91:99) duplicated block id: 24 size: 8 cleaned lines of code in 2 files: - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (230:241) - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (277:288) duplicated block id: 25 size: 8 cleaned lines of code in 2 files: - fairscale/nn/model_parallel/layers.py (266:275) - fairscale/nn/model_parallel/layers.py (353:362) duplicated block id: 26 size: 8 cleaned lines of code in 2 files: - fairscale/experimental/nn/distributed_pipeline/pipeline.py (143:152) - fairscale/nn/pipe/pipe.py (362:371) duplicated block id: 27 size: 8 cleaned lines of code in 2 files: - fairscale/nn/pipe/skip/tracker.py (59:66) - fairscale/nn/pipe/skip/tracker.py (154:161) duplicated block id: 28 size: 8 cleaned lines of code in 2 files: - fairscale/clib/fused_adam_cuda/fused_adam_cuda_kernel.cu (107:114) - fairscale/clib/fused_adam_cuda/fused_adam_cuda_kernel.cu (122:129) duplicated block id: 29 size: 8 cleaned lines of code in 2 files: - benchmarks/experimental/offload.py (72:81) - benchmarks/utils.py (101:110) duplicated block id: 30 size: 8 cleaned lines of code in 2 files: - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (156:166) - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (178:188) duplicated block id: 31 size: 8 cleaned lines of code in 2 files: - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (154:165) - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (277:288) duplicated block id: 32 size: 8 cleaned lines of code in 2 files: - fairscale/experimental/nn/ampnet_pipe/ampnet.py (356:363) - fairscale/experimental/nn/ampnet_pipe/ampnet.py (370:377) duplicated block id: 33 size: 7 cleaned lines of code in 2 files: - fairscale/nn/model_parallel/layers.py (138:144) - fairscale/nn/model_parallel/layers.py (207:213) duplicated block id: 34 size: 7 cleaned lines of code in 2 files: - fairscale/experimental/nn/ampnet_pipe/ampnet.py (177:183) - fairscale/experimental/nn/ampnet_pipe/ampnet.py (193:200) duplicated block id: 35 size: 7 cleaned lines of code in 2 files: - fairscale/nn/pipe/async_schedule.py (344:350) - fairscale/nn/pipe/async_schedule.py (402:408) duplicated block id: 36 size: 7 cleaned lines of code in 2 files: - fairscale/nn/misc/param_bucket.py (24:30) - fairscale/nn/misc/param_bucket.py (46:52) duplicated block id: 37 size: 7 cleaned lines of code in 2 files: - benchmarks/experimental/offload.py (216:222) - benchmarks/pipe.py (141:147) duplicated block id: 38 size: 7 cleaned lines of code in 2 files: - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (178:187) - fairscale/experimental/nn/data_parallel/gossip/graph_manager.py (279:288) duplicated block id: 39 size: 7 cleaned lines of code in 2 files: - stubs/torch/nn/modules/container.pyi (79:91) - stubs/torch/nn/modules/container.pyi (133:145) duplicated block id: 40 size: 7 cleaned lines of code in 2 files: - fairscale/experimental/nn/ampnet_pipe/ampnet.py (55:63) - fairscale/nn/pipe/async_schedule.py (52:60) duplicated block id: 41 size: 7 cleaned lines of code in 2 files: - fairscale/experimental/nn/data_parallel/gossip/distributed.py (187:193) - fairscale/experimental/nn/data_parallel/gossip/distributed.py (872:878) duplicated block id: 42 size: 7 cleaned lines of code in 2 files: - benchmarks/golden_configs/lm_wikitext2.py (54:62) - benchmarks/golden_configs/lm_wikitext2.py (82:90) duplicated block id: 43 size: 7 cleaned lines of code in 2 files: - benchmarks/experimental/experimental_async_approaches.py (366:372) - benchmarks/experimental/experimental_async_approaches.py (401:407) duplicated block id: 44 size: 7 cleaned lines of code in 2 files: - stubs/torch/nn/modules/normalization.pyi (10:19) - stubs/torch/nn/modules/normalization.pyi (23:32) duplicated block id: 45 size: 7 cleaned lines of code in 2 files: - benchmarks/experimental/offload.py (249:255) - benchmarks/pipe.py (208:214) duplicated block id: 46 size: 7 cleaned lines of code in 2 files: - fairscale/nn/pipe/pipeline.py (44:53) - fairscale/nn/pipe/worker.py (36:45) duplicated block id: 47 size: 7 cleaned lines of code in 2 files: - fairscale/nn/data_parallel/fully_sharded_data_parallel.py (22:28) - fairscale/nn/misc/flatten_params_wrapper.py (16:22) duplicated block id: 48 size: 6 cleaned lines of code in 2 files: - fairscale/experimental/nn/mevo.py (156:162) - fairscale/experimental/nn/mevo.py (231:237) duplicated block id: 49 size: 6 cleaned lines of code in 2 files: - fairscale/experimental/tooling/layer_memory_tracker.py (404:409) - fairscale/experimental/tooling/layer_memory_tracker.py (436:441) duplicated block id: 50 size: 6 cleaned lines of code in 2 files: - fairscale/nn/misc/param_bucket.py (46:51) - fairscale/nn/misc/param_bucket.py (136:141) duplicated block id: 51 size: 6 cleaned lines of code in 2 files: - benchmarks/experimental/offload.py (327:332) - benchmarks/experimental/offload.py (338:343) duplicated block id: 52 size: 6 cleaned lines of code in 2 files: - benchmarks/experimental/offload.py (177:183) - benchmarks/moe.py (65:71) duplicated block id: 53 size: 6 cleaned lines of code in 2 files: - benchmarks/experimental/offload.py (216:221) - benchmarks/moe.py (103:108) duplicated block id: 54 size: 6 cleaned lines of code in 2 files: - fairscale/nn/pipe/async_pipe.py (26:31) - fairscale/nn/pipe/pipe.py (48:53) duplicated block id: 55 size: 6 cleaned lines of code in 2 files: - benchmarks/experimental/experimental_async_approaches.py (87:94) - benchmarks/models/transformer_lm.py (167:174) duplicated block id: 56 size: 6 cleaned lines of code in 2 files: - benchmarks/experimental/offload.py (226:231) - benchmarks/pipe.py (149:154) duplicated block id: 57 size: 6 cleaned lines of code in 2 files: - benchmarks/experimental/offload.py (209:214) - benchmarks/pipe.py (133:138) duplicated block id: 58 size: 6 cleaned lines of code in 2 files: - fairscale/nn/misc/param_bucket.py (24:29) - fairscale/nn/misc/param_bucket.py (136:141) duplicated block id: 59 size: 6 cleaned lines of code in 2 files: - benchmarks/moe.py (103:108) - benchmarks/pipe.py (141:146)