duplicated block id: 1 size: 141 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (403:551) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (183:331) duplicated block id: 2 size: 42 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_nightly_supported.py (34:80) - dags/solutions_team/solutionsteam_tf_release_supported.py (35:81) duplicated block id: 3 size: 34 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (146:181) - dags/sparsity_diffusion_devx/configs/gke_config.py (84:119) duplicated block id: 4 size: 33 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (27:63) - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (28:64) duplicated block id: 5 size: 32 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (31:64) - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (37:71) duplicated block id: 6 size: 31 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (31:64) - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (37:70) duplicated block id: 7 size: 30 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (38:69) - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (42:74) duplicated block id: 8 size: 30 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (30:63) - dags/map_reproducibility/a3ultra/nemo_two_node.py (30:63) duplicated block id: 9 size: 29 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (39:69) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (39:69) duplicated block id: 10 size: 29 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (44:74) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (39:69) duplicated block id: 11 size: 28 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (28:57) - dags/inference/configs/trtllm_bench_inference_config.py (28:57) duplicated block id: 12 size: 28 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/sample_a3mega_maxtext_single_run.py (19:65) - dags/map_reproducibility/internal_runs/sample_a3ultra_maxtext_single_run.py (19:64) duplicated block id: 13 size: 27 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (28:55) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (28:56) duplicated block id: 14 size: 27 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/sample_a3ultra_maxtext_single_run.py (19:61) - dags/map_reproducibility/internal_runs/sample_a4_maxtext_single_run.py (19:61) duplicated block id: 15 size: 27 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/sample_a3mega_maxtext_single_run.py (19:62) - dags/map_reproducibility/internal_runs/sample_a4_maxtext_single_run.py (19:61) duplicated block id: 16 size: 26 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (192:220) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (364:392) duplicated block id: 17 size: 25 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:73) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:69) duplicated block id: 18 size: 25 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:69) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:67) duplicated block id: 19 size: 25 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (334:360) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (527:553) duplicated block id: 20 size: 25 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/internal_aotc_workload.py (177:202) - dags/map_reproducibility/utils/sample_workload_utils.py (332:357) duplicated block id: 21 size: 25 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:74) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:73) duplicated block id: 22 size: 25 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:74) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:67) duplicated block id: 23 size: 25 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:73) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:67) duplicated block id: 24 size: 25 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:69) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:73) duplicated block id: 25 size: 25 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:67) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:69) duplicated block id: 26 size: 24 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (163:188) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (528:553) duplicated block id: 27 size: 24 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (115:140) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (308:333) duplicated block id: 28 size: 24 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (163:188) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (335:360) duplicated block id: 29 size: 23 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (85:108) - dags/multipod/configs/gke_config.py (185:208) duplicated block id: 30 size: 23 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (334:358) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (307:331) duplicated block id: 31 size: 22 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (335:358) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (115:138) duplicated block id: 32 size: 22 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (163:186) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (115:138) duplicated block id: 33 size: 22 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (40:62) - dags/sparsity_diffusion_devx/configs/gke_config.py (53:75) duplicated block id: 34 size: 22 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (73:96) - dags/multipod/configs/mxla_collective_config.py (63:86) duplicated block id: 35 size: 22 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (528:551) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (115:138) duplicated block id: 36 size: 22 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (163:186) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (308:331) duplicated block id: 37 size: 21 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (43:65) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (43:65) duplicated block id: 38 size: 21 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (46:66) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:60) duplicated block id: 39 size: 21 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (46:66) - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:60) duplicated block id: 40 size: 21 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (82:102) - dags/inference/configs/trt_llm_mlperf_v41_config.py (91:111) duplicated block id: 41 size: 21 cleaned lines of code in 2 files: - xlml/utils/gpu.py (176:196) - xlml/utils/gpu.py (231:251) duplicated block id: 42 size: 21 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (120:142) - dags/multipod/configs/gke_config.py (220:242) duplicated block id: 43 size: 21 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:60) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:60) duplicated block id: 44 size: 20 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (126:145) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (81:100) duplicated block id: 45 size: 20 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (110:130) - dags/inference/configs/trt_llm_mlperf_v41_config.py (168:188) duplicated block id: 46 size: 20 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (43:63) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (43:64) duplicated block id: 47 size: 20 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:59) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (46:65) duplicated block id: 48 size: 20 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (46:65) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:59) duplicated block id: 49 size: 20 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (49:70) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (43:64) duplicated block id: 50 size: 19 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (145:166) - dags/inference/configs/trt_llm_mlperf_v40_config.py (138:159) duplicated block id: 51 size: 19 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (52:70) - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:58) duplicated block id: 52 size: 19 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (222:242) - dags/sparsity_diffusion_devx/configs/gke_config.py (60:80) duplicated block id: 53 size: 19 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (45:63) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:58) duplicated block id: 54 size: 19 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (145:166) - dags/inference/configs/trtllm_bench_inference_config.py (105:126) duplicated block id: 55 size: 19 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (52:70) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:58) duplicated block id: 56 size: 19 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v41_config.py (200:221) - dags/inference/configs/trtllm_bench_inference_config.py (105:126) duplicated block id: 57 size: 19 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (122:142) - dags/sparsity_diffusion_devx/configs/gke_config.py (60:80) duplicated block id: 58 size: 19 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (380:402) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (159:181) duplicated block id: 59 size: 19 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (138:159) - dags/inference/configs/trtllm_bench_inference_config.py (105:126) duplicated block id: 60 size: 19 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (145:166) - dags/inference/configs/trt_llm_mlperf_v41_config.py (200:221) duplicated block id: 61 size: 19 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (124:143) - dags/inference/configs/trtllm_bench_inference_config.py (84:103) duplicated block id: 62 size: 19 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (45:63) - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:58) duplicated block id: 63 size: 19 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (138:159) - dags/inference/configs/trt_llm_mlperf_v41_config.py (200:221) duplicated block id: 64 size: 17 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (47:67) - dags/pytorch_xla/r2_7.py (38:59) duplicated block id: 65 size: 17 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (27:45) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (27:45) duplicated block id: 66 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (54:69) - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:60) duplicated block id: 67 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (48:63) - dags/map_reproducibility/a3mega/nemo_two_node.py (45:60) duplicated block id: 68 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/nemo_two_node.py (32:50) - dags/map_reproducibility/a4/two_node_nemo.py (33:51) duplicated block id: 69 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (48:63) - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:60) duplicated block id: 70 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (28:46) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (28:46) duplicated block id: 71 size: 16 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (160:175) - dags/inference/maxtext_inference.py (597:612) duplicated block id: 72 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (47:62) - dags/map_reproducibility/a3mega/nemo_two_node.py (45:60) duplicated block id: 73 size: 16 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (65:81) - dags/multipod/configs/gke_config.py (283:299) duplicated block id: 74 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (45:60) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (48:63) duplicated block id: 75 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (32:50) - dags/map_reproducibility/a4/two_node_nemo.py (33:51) duplicated block id: 76 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (28:44) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (28:45) duplicated block id: 77 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (42:57) - dags/map_reproducibility/a3mega/nemo_two_node.py (45:60) duplicated block id: 78 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (48:63) - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:60) duplicated block id: 79 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (54:69) - dags/map_reproducibility/a3mega/nemo_two_node.py (45:60) duplicated block id: 80 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (42:57) - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:60) duplicated block id: 81 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (45:60) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (42:57) duplicated block id: 82 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (42:57) - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:60) duplicated block id: 83 size: 16 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (47:62) - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:60) duplicated block id: 84 size: 15 cleaned lines of code in 2 files: - dags/multipod/maxtext_gpu_end_to_end.py (72:87) - dags/multipod/maxtext_gpu_end_to_end.py (100:115) duplicated block id: 85 size: 15 cleaned lines of code in 2 files: - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (175:200) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (336:360) duplicated block id: 86 size: 15 cleaned lines of code in 2 files: - dags/multipod/maxtext_trillium_configs_perf.py (39:53) - dags/multipod/maxtext_v5e_configs_perf.py (40:54) duplicated block id: 87 size: 15 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (364:378) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (144:158) duplicated block id: 88 size: 15 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (47:62) - dags/multipod/configs/gke_config.py (222:237) duplicated block id: 89 size: 15 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (119:134) - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (118:133) duplicated block id: 90 size: 15 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (102:116) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (47:61) duplicated block id: 91 size: 15 cleaned lines of code in 2 files: - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (104:119) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (165:180) duplicated block id: 92 size: 15 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (47:62) - dags/multipod/configs/gke_config.py (122:137) duplicated block id: 93 size: 15 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (26:42) - dags/pytorch_xla/r2_7.py (25:39) duplicated block id: 94 size: 15 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (192:206) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (144:158) duplicated block id: 95 size: 15 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (882:897) - dags/map_reproducibility/utils/common_utils.py (1018:1033) duplicated block id: 96 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (200:214) - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (119:133) duplicated block id: 97 size: 14 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (70:85) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (70:85) duplicated block id: 98 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (120:134) - dags/multipod/configs/mxla_collective_config.py (64:78) duplicated block id: 99 size: 14 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (64:78) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (320:334) duplicated block id: 100 size: 14 cleaned lines of code in 2 files: - dags/multipod/maxtext_checkpointing.py (47:63) - dags/multipod/maxtext_profiling_vertex_ai_tensorboard.py (40:56) duplicated block id: 101 size: 14 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (69:84) - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (68:83) duplicated block id: 102 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (119:133) - dags/multipod/configs/maxtext_gce_config.py (74:88) duplicated block id: 103 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (120:134) - dags/multipod/configs/maxtext_gce_config.py (74:88) duplicated block id: 104 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (120:134) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (320:334) duplicated block id: 105 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (200:214) - dags/multipod/configs/maxtext_gce_config.py (74:88) duplicated block id: 106 size: 14 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (82:95) - dags/solutions_team/solutionsteam_tf_nightly_supported.py (119:132) duplicated block id: 107 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (200:214) - dags/inference/configs/jetstream_pytorch_gce_config.py (120:134) duplicated block id: 108 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (119:133) - dags/multipod/configs/mxla_collective_config.py (64:78) duplicated block id: 109 size: 14 cleaned lines of code in 2 files: - deployment/clusters.tf (63:77) - deployment/clusters.tf (281:295) duplicated block id: 110 size: 14 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (88:101) - dags/sparsity_diffusion_devx/configs/gke_config.py (47:60) duplicated block id: 111 size: 14 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (51:68) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (51:68) duplicated block id: 112 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (200:214) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (320:334) duplicated block id: 113 size: 14 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (74:88) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (320:334) duplicated block id: 114 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (31:44) - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (31:44) duplicated block id: 115 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (119:133) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (320:334) duplicated block id: 116 size: 14 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (188:201) - dags/sparsity_diffusion_devx/configs/gke_config.py (47:60) duplicated block id: 117 size: 14 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (200:214) - dags/multipod/configs/mxla_collective_config.py (64:78) duplicated block id: 118 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (122:134) - dags/multipod/configs/maxtext_gce_config.py (124:136) duplicated block id: 119 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (121:133) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (78:90) duplicated block id: 120 size: 13 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (76:88) - dags/multipod/configs/maxtext_gce_config.py (124:136) duplicated block id: 121 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:57) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (46:58) duplicated block id: 122 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (202:214) - dags/multipod/configs/jax_tests_gce_config.py (50:62) duplicated block id: 123 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (122:134) - dags/multipod/configs/jax_tests_gce_config.py (50:62) duplicated block id: 124 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (52:64) - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:57) duplicated block id: 125 size: 13 cleaned lines of code in 2 files: - deployment/clusters.tf (22:37) - deployment/clusters.tf (124:139) duplicated block id: 126 size: 13 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (124:136) - dags/multipod/configs/mxla_collective_config.py (66:78) duplicated block id: 127 size: 13 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (237:249) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (322:334) duplicated block id: 128 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (46:58) - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:62) duplicated block id: 129 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:52) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:57) duplicated block id: 130 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (52:64) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:57) duplicated block id: 131 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:52) - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:62) duplicated block id: 132 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (52:64) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:55) duplicated block id: 133 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (122:134) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (78:90) duplicated block id: 134 size: 13 cleaned lines of code in 2 files: - dags/multipod/maxtext_trillium_configs_perf.py (78:91) - dags/multipod/maxtext_v5e_configs_perf.py (74:87) duplicated block id: 135 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (45:57) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:57) duplicated block id: 136 size: 13 cleaned lines of code in 2 files: - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (322:334) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (78:90) duplicated block id: 137 size: 13 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (66:78) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (78:90) duplicated block id: 138 size: 13 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (76:88) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (78:90) duplicated block id: 139 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (46:58) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:55) duplicated block id: 140 size: 13 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (124:136) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (78:90) duplicated block id: 141 size: 13 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (50:62) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (78:90) duplicated block id: 142 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (46:58) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:61) duplicated block id: 143 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (46:58) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:57) duplicated block id: 144 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (146:161) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (266:281) duplicated block id: 145 size: 13 cleaned lines of code in 2 files: - dags/multipod/maxtext_end_to_end.py (118:130) - dags/sparsity_diffusion_devx/maxtext_moe_tpu_e2e.py (111:123) duplicated block id: 146 size: 13 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_microbenchmark.py (196:208) - dags/inference/maxtext_model_config_generator.py (123:135) duplicated block id: 147 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:52) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:55) duplicated block id: 148 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:61) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:52) duplicated block id: 149 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (52:64) - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:62) duplicated block id: 150 size: 13 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (237:249) - dags/multipod/configs/jax_tests_gce_config.py (50:62) duplicated block id: 151 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (45:57) - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:57) duplicated block id: 152 size: 13 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (237:249) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (78:90) duplicated block id: 153 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (45:57) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:55) duplicated block id: 154 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:52) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:57) duplicated block id: 155 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (46:58) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:55) duplicated block id: 156 size: 13 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (237:249) - dags/multipod/configs/maxtext_gce_config.py (76:88) duplicated block id: 157 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:52) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:55) duplicated block id: 158 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (46:58) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:61) duplicated block id: 159 size: 13 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (237:249) - dags/multipod/configs/mxla_collective_config.py (66:78) duplicated block id: 160 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (121:133) - dags/inference/maxtext_inference_offline_benchmark.py (237:249) duplicated block id: 161 size: 13 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (50:62) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (322:334) duplicated block id: 162 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (45:57) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:61) duplicated block id: 163 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (44:57) - dags/inference/configs/trt_llm_mlperf_v40_config.py (46:59) duplicated block id: 164 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (45:57) - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:62) duplicated block id: 165 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v41_config.py (201:216) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (266:281) duplicated block id: 166 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (121:133) - dags/multipod/configs/maxtext_gce_config.py (124:136) duplicated block id: 167 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/trtllm_bench_inference_config.py (106:121) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (266:281) duplicated block id: 168 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (202:214) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (78:90) duplicated block id: 169 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:57) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:52) duplicated block id: 170 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:62) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (46:58) duplicated block id: 171 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (139:154) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (266:281) duplicated block id: 172 size: 13 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (50:62) - dags/multipod/configs/maxtext_gce_config.py (76:88) duplicated block id: 173 size: 13 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (124:136) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (322:334) duplicated block id: 174 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (31:43) - dags/inference/configs/jetstream_pytorch_gce_config.py (31:43) duplicated block id: 175 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (202:214) - dags/multipod/configs/maxtext_gce_config.py (124:136) duplicated block id: 176 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:52) - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:57) duplicated block id: 177 size: 13 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (50:62) - dags/multipod/configs/maxtext_gce_config.py (124:136) duplicated block id: 178 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (46:59) - dags/inference/configs/trtllm_bench_inference_config.py (44:57) duplicated block id: 179 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (202:214) - dags/inference/maxtext_inference_offline_benchmark.py (237:249) duplicated block id: 180 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (122:134) - dags/inference/maxtext_inference_offline_benchmark.py (237:249) duplicated block id: 181 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:62) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:52) duplicated block id: 182 size: 13 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (39:52) - dags/solutions_team/solutionsteam_tf_release_se_supported.py (129:142) duplicated block id: 183 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (46:58) - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:57) duplicated block id: 184 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:52) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:61) duplicated block id: 185 size: 13 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (237:249) - dags/multipod/configs/maxtext_gce_config.py (124:136) duplicated block id: 186 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (121:133) - dags/multipod/configs/jax_tests_gce_config.py (50:62) duplicated block id: 187 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (46:58) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:57) duplicated block id: 188 size: 13 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (50:62) - dags/multipod/configs/mxla_collective_config.py (66:78) duplicated block id: 189 size: 13 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (52:64) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:61) duplicated block id: 190 size: 13 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (31:43) - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (31:43) duplicated block id: 191 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (124:136) - dags/inference/configs/trt_llm_mlperf_v41_config.py (176:188) duplicated block id: 192 size: 12 cleaned lines of code in 2 files: - dags/multipod/maxtext_checkpointing.py (31:42) - dags/multipod/maxtext_profiling.py (31:42) duplicated block id: 193 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (29:40) - dags/inference/configs/trt_llm_mlperf_v41_config.py (29:40) duplicated block id: 194 size: 12 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (124:137) - dags/pytorch_xla/pytorchxla_torchbench.py (136:149) duplicated block id: 195 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (31:42) - dags/multipod/configs/jax_tests_gce_config.py (28:39) duplicated block id: 196 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (216:229) - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (135:148) duplicated block id: 197 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (124:136) - dags/inference/configs/trt_llm_mlperf_v40_config.py (118:130) duplicated block id: 198 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (31:42) - dags/inference/maxtext_inference_offline_benchmark.py (157:168) duplicated block id: 199 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (31:42) - dags/multipod/configs/jax_tests_gce_config.py (28:39) duplicated block id: 200 size: 12 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (26:39) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (28:41) duplicated block id: 201 size: 12 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (103:116) - dags/pytorch_xla/pytorchxla_torchbench.py (121:134) duplicated block id: 202 size: 12 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (88:101) - dags/pytorch_xla/pytorchxla_torchbench.py (107:120) duplicated block id: 203 size: 12 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (118:131) - dags/pytorch_xla/pytorchxla_torchbench.py (135:148) duplicated block id: 204 size: 12 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (109:122) - dags/pytorch_xla/pytorchxla_torchbench.py (122:135) duplicated block id: 205 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v41_config.py (29:40) - dags/inference/configs/trtllm_bench_inference_config.py (28:39) duplicated block id: 206 size: 12 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (50:63) - dags/pytorch_xla/pytorchxla_torchbench.py (66:79) duplicated block id: 207 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (28:39) - dags/inference/configs/trt_llm_mlperf_v41_config.py (29:40) duplicated block id: 208 size: 12 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (933:944) - dags/map_reproducibility/utils/common_utils.py (1056:1067) duplicated block id: 209 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (31:42) - dags/inference/maxtext_inference_offline_benchmark.py (157:168) duplicated block id: 210 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v41_config.py (176:188) - dags/inference/configs/trtllm_bench_inference_config.py (84:96) duplicated block id: 211 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (29:40) - dags/inference/configs/trtllm_bench_inference_config.py (28:39) duplicated block id: 212 size: 12 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (94:107) - dags/pytorch_xla/pytorchxla_torchbench.py (108:121) duplicated block id: 213 size: 12 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (27:40) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (27:40) duplicated block id: 214 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (118:130) - dags/inference/configs/trtllm_bench_inference_config.py (84:96) duplicated block id: 215 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (28:39) - dags/inference/configs/trt_llm_mlperf_v40_config.py (29:40) duplicated block id: 216 size: 12 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (157:168) - dags/multipod/configs/jax_tests_gce_config.py (28:39) duplicated block id: 217 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (31:42) - dags/inference/maxtext_inference_offline_benchmark.py (157:168) duplicated block id: 218 size: 12 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (102:113) - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (120:131) duplicated block id: 219 size: 12 cleaned lines of code in 2 files: - xlml/utils/gpu.py (134:155) - xlml/utils/gpu.py (203:221) duplicated block id: 220 size: 12 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (114:126) - dags/inference/maxtext_inference.py (190:202) duplicated block id: 221 size: 12 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (71:84) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (70:83) duplicated block id: 222 size: 12 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (94:106) - dags/inference/maxtext_inference.py (225:237) duplicated block id: 223 size: 12 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (31:42) - dags/multipod/configs/jax_tests_gce_config.py (28:39) duplicated block id: 224 size: 12 cleaned lines of code in 2 files: - dags/multipod/maxtext_v5e_configs_perf.py (59:70) - dags/multipod/maxtext_v5e_configs_perf.py (107:118) duplicated block id: 225 size: 11 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (68:79) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (309:320) duplicated block id: 226 size: 11 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (80:92) - dags/pytorch_xla/pytorchxla_torchbench.py (95:107) duplicated block id: 227 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (45:55) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (47:57) duplicated block id: 228 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (75:85) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (56:66) duplicated block id: 229 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (66:76) - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (83:93) duplicated block id: 230 size: 11 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_nightly_supported.py (81:92) - dags/solutions_team/solutionsteam_tf_release_supported.py (83:94) duplicated block id: 231 size: 11 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (107:117) - dags/multipod/configs/mxla_collective_config.py (35:45) duplicated block id: 232 size: 11 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (31:41) - dags/multipod/configs/maxtext_gce_config.py (29:39) duplicated block id: 233 size: 11 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (124:136) - dags/pytorch_xla/pytorchxla2_torchbench.py (119:131) duplicated block id: 234 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:66) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (57:67) duplicated block id: 235 size: 11 cleaned lines of code in 2 files: - dags/multipod/maxtext_end_to_end.py (35:45) - dags/multipod/maxtext_gpu_end_to_end.py (226:236) duplicated block id: 236 size: 11 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (68:79) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (164:175) duplicated block id: 237 size: 11 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (31:41) - dags/multipod/configs/maxtext_gce_config.py (29:39) duplicated block id: 238 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (28:41) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (29:41) duplicated block id: 239 size: 11 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (94:106) - dags/pytorch_xla/pytorchxla2_torchbench.py (89:101) duplicated block id: 240 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/nemo_two_node.py (52:62) - dags/map_reproducibility/a4/two_node_nemo.py (53:63) duplicated block id: 241 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (29:41) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (29:41) duplicated block id: 242 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:55) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (45:55) duplicated block id: 243 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/internal_aotc_workload.py (186:196) - dags/map_reproducibility/utils/sample_workload_utils.py (192:202) duplicated block id: 244 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:55) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (47:57) duplicated block id: 245 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (75:85) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (62:72) duplicated block id: 246 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (75:85) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (58:68) duplicated block id: 247 size: 11 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (68:79) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (336:347) duplicated block id: 248 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (45:55) - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (47:57) duplicated block id: 249 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (63:73) - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (75:85) duplicated block id: 250 size: 11 cleaned lines of code in 2 files: - xlml/apis/task.py (581:596) - xlml/apis/task.py (680:695) duplicated block id: 251 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (47:57) - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:55) duplicated block id: 252 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (58:68) - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (75:85) duplicated block id: 253 size: 11 cleaned lines of code in 2 files: - xlml/utils/metric.py (215:226) - xlml/utils/metric.py (288:299) duplicated block id: 254 size: 11 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (157:167) - dags/multipod/configs/maxtext_gce_config.py (29:39) duplicated block id: 255 size: 11 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (63:74) - dags/inference/configs/trtllm_bench_inference_config.py (61:72) duplicated block id: 256 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (45:55) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (51:61) duplicated block id: 257 size: 11 cleaned lines of code in 2 files: - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (515:527) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (272:284) duplicated block id: 258 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (51:61) - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:55) duplicated block id: 259 size: 11 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (28:38) - dags/multipod/configs/maxtext_gce_config.py (29:39) duplicated block id: 260 size: 11 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (31:41) - dags/multipod/configs/maxtext_gce_config.py (29:39) duplicated block id: 261 size: 11 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (66:78) - dags/pytorch_xla/pytorchxla_torchbench.py (50:62) duplicated block id: 262 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (45:55) - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (52:62) duplicated block id: 263 size: 11 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (68:79) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (116:127) duplicated block id: 264 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (66:76) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (83:93) duplicated block id: 265 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (45:55) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (45:55) duplicated block id: 266 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (52:62) - dags/map_reproducibility/a4/two_node_nemo.py (53:63) duplicated block id: 267 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (52:62) - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:55) duplicated block id: 268 size: 11 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (109:121) - dags/pytorch_xla/pytorchxla2_torchbench.py (104:116) duplicated block id: 269 size: 11 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/sample_workload_utils.py (192:202) - dags/map_reproducibility/utils/sample_workload_utils.py (341:351) duplicated block id: 270 size: 11 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (68:79) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (529:540) duplicated block id: 271 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (28:40) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (29:40) duplicated block id: 272 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (45:54) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:54) duplicated block id: 273 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (46:55) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (47:56) duplicated block id: 274 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:54) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (46:55) duplicated block id: 275 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (37:47) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (31:41) duplicated block id: 276 size: 10 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (53:62) - dags/multipod/configs/gke_config.py (272:281) duplicated block id: 277 size: 10 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (137:148) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (316:327) duplicated block id: 278 size: 10 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (228:237) - dags/multipod/configs/gke_config.py (272:281) duplicated block id: 279 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:54) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:54) duplicated block id: 280 size: 10 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (208:220) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (159:171) duplicated block id: 281 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:54) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:52) duplicated block id: 282 size: 10 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (81:90) - dags/pytorch_xla/r2_7.py (86:95) duplicated block id: 283 size: 10 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (138:149) - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (137:148) duplicated block id: 284 size: 10 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (56:65) - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (70:79) duplicated block id: 285 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (52:61) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:54) duplicated block id: 286 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:54) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:49) duplicated block id: 287 size: 10 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (46:57) - dags/pytorch_xla/pytorchxla_torchbench.py (66:77) duplicated block id: 288 size: 10 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (66:76) - dags/inference/maxtext_inference.py (112:122) duplicated block id: 289 size: 10 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (218:229) - dags/inference/configs/jetstream_pytorch_gce_config.py (138:149) duplicated block id: 290 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (47:56) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (47:56) duplicated block id: 291 size: 10 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (128:137) - dags/multipod/configs/gke_config.py (272:281) duplicated block id: 292 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (29:40) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (29:40) duplicated block id: 293 size: 10 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (348:357) - dags/inference/maxtext_inference.py (486:495) duplicated block id: 294 size: 10 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_microbenchmark.py (126:136) - dags/inference/maxtext_model_config_generator.py (59:68) duplicated block id: 295 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:54) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:58) duplicated block id: 296 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (53:67) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (53:66) duplicated block id: 297 size: 10 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (428:437) - dags/inference/maxtext_inference.py (486:495) duplicated block id: 298 size: 10 cleaned lines of code in 2 files: - xlml/apis/task.py (367:377) - xlml/apis/task.py (587:596) duplicated block id: 299 size: 10 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (272:281) - dags/sparsity_diffusion_devx/configs/gke_config.py (66:75) duplicated block id: 300 size: 10 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (137:148) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (338:349) duplicated block id: 301 size: 10 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (138:149) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (338:349) duplicated block id: 302 size: 10 cleaned lines of code in 2 files: - xlml/apis/task.py (367:377) - xlml/apis/task.py (686:695) duplicated block id: 303 size: 10 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (348:357) - dags/inference/maxtext_inference.py (428:437) duplicated block id: 304 size: 10 cleaned lines of code in 2 files: - xlml/utils/gpu.py (425:434) - xlml/utils/gpu.py (535:544) duplicated block id: 305 size: 10 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (138:149) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (316:327) duplicated block id: 306 size: 10 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (104:113) - dags/solutions_team/solutionsteam_tf_nightly_supported.py (142:151) duplicated block id: 307 size: 10 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_nightly_supported.py (104:114) - dags/solutions_team/solutionsteam_tf_release_supported.py (107:117) duplicated block id: 308 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:54) - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:59) duplicated block id: 309 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:54) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:54) duplicated block id: 310 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:49) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:54) duplicated block id: 311 size: 10 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (218:229) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (338:349) duplicated block id: 312 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (46:55) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:54) duplicated block id: 313 size: 10 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (366:375) - dags/inference/maxtext_inference.py (446:455) duplicated block id: 314 size: 10 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (53:67) - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (53:66) duplicated block id: 315 size: 10 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (218:229) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (316:327) duplicated block id: 316 size: 10 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (50:61) - dags/pytorch_xla/pytorchxla2_torchbench.py (46:57) duplicated block id: 317 size: 10 cleaned lines of code in 2 files: - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (316:327) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (338:349) duplicated block id: 318 size: 10 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (122:131) - dags/solutions_team/solutionsteam_tf_nightly_supported.py (142:151) duplicated block id: 319 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (55:63) - dags/map_reproducibility/a4/two_node_nemo.py (53:61) duplicated block id: 320 size: 9 cleaned lines of code in 2 files: - xlml/utils/metric.py (578:588) - xlml/utils/metric.py (665:675) duplicated block id: 321 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/sample_a3mega_maxtext_single_run.py (70:80) - dags/map_reproducibility/internal_runs/sample_a4_maxtext_single_run.py (67:77) duplicated block id: 322 size: 9 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_nightly_supported.py (94:103) - dags/solutions_team/solutionsteam_tf_release_supported.py (96:105) duplicated block id: 323 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (51:59) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:64) duplicated block id: 324 size: 9 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (329:337) - dags/inference/maxtext_inference.py (410:418) duplicated block id: 325 size: 9 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (87:97) - dags/pytorch_xla/pytorchxla2_torchbench.py (102:112) duplicated block id: 326 size: 9 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (87:97) - dags/pytorch_xla/pytorchxla2_torchbench.py (117:127) duplicated block id: 327 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (28:40) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (28:40) duplicated block id: 328 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (1019:1028) - dags/map_reproducibility/utils/internal_aotc_workload.py (73:82) duplicated block id: 329 size: 9 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (92:102) - dags/pytorch_xla/pytorchxla-torchbench-release.py (122:132) duplicated block id: 330 size: 9 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (312:320) - dags/inference/maxtext_inference.py (393:401) duplicated block id: 331 size: 9 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (92:102) - dags/pytorch_xla/pytorchxla-torchbench-release.py (107:117) duplicated block id: 332 size: 9 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (106:114) - dags/pytorch_xla/pytorchxla-torchbench-release.py (136:144) duplicated block id: 333 size: 9 cleaned lines of code in 2 files: - dags/mantaray/run_mantaray_jobs.py (194:203) - xlml/utils/metric.py (805:814) duplicated block id: 334 size: 9 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (312:320) - dags/inference/maxtext_inference.py (468:476) duplicated block id: 335 size: 9 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (317:331) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (510:524) duplicated block id: 336 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/sample_a3ultra_maxtext_single_run.py (69:79) - dags/map_reproducibility/internal_runs/sample_a4_maxtext_single_run.py (67:77) duplicated block id: 337 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (69:77) - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (85:93) duplicated block id: 338 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/sample_a3mega_maxtext_single_run.py (70:80) - dags/map_reproducibility/internal_runs/sample_a3ultra_maxtext_single_run.py (69:79) duplicated block id: 339 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (49:57) - dags/map_reproducibility/a4/two_node_nemo.py (53:61) duplicated block id: 340 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (28:40) - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (28:40) duplicated block id: 341 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (55:63) - dags/map_reproducibility/a4/two_node_nemo.py (53:61) duplicated block id: 342 size: 9 cleaned lines of code in 2 files: - xlml/apis/task.py (430:438) - xlml/apis/task.py (464:472) duplicated block id: 343 size: 9 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (102:112) - dags/pytorch_xla/pytorchxla2_torchbench.py (117:127) duplicated block id: 344 size: 9 cleaned lines of code in 2 files: - dags/multipod/maxtext_end_to_end.py (132:140) - dags/sparsity_diffusion_devx/maxtext_moe_tpu_e2e.py (125:133) duplicated block id: 345 size: 9 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_release_se_supported.py (118:126) - dags/solutions_team/solutionsteam_tf_release_se_supported.py (147:155) duplicated block id: 346 size: 9 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (116:126) - dags/pytorch_xla/r2_7.py (121:131) duplicated block id: 347 size: 9 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (107:117) - dags/pytorch_xla/pytorchxla-torchbench-release.py (122:132) duplicated block id: 348 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (883:892) - dags/map_reproducibility/utils/internal_aotc_workload.py (73:82) duplicated block id: 349 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (88:96) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (87:95) duplicated block id: 350 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (54:62) - dags/map_reproducibility/a4/two_node_nemo.py (53:61) duplicated block id: 351 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (28:40) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (28:40) duplicated block id: 352 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:64) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (51:59) duplicated block id: 353 size: 9 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (101:109) - dags/pytorch_xla/pytorchxla2_torchbench.py (131:139) duplicated block id: 354 size: 9 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (42:52) - dags/inference/configs/trt_llm_mlperf_v41_config.py (45:55) duplicated block id: 355 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (37:46) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (31:40) duplicated block id: 356 size: 9 cleaned lines of code in 2 files: - dags/multipod/maxtext_v5e_configs_perf.py (48:56) - dags/multipod/maxtext_v5e_configs_perf.py (97:105) duplicated block id: 357 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (49:57) - dags/map_reproducibility/a4/two_node_nemo.py (53:61) duplicated block id: 358 size: 9 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (218:226) - dags/pytorch_xla/r2_7.py (239:247) duplicated block id: 359 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (61:69) - dags/map_reproducibility/a4/two_node_nemo.py (53:61) duplicated block id: 360 size: 9 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (317:331) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (290:304) duplicated block id: 361 size: 9 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (393:401) - dags/inference/maxtext_inference.py (468:476) duplicated block id: 362 size: 9 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (46:56) - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (45:55) duplicated block id: 363 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (57:65) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:64) duplicated block id: 364 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (87:95) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (87:95) duplicated block id: 365 size: 9 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (88:96) - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (87:95) duplicated block id: 366 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (49:56) - dags/map_reproducibility/a4/two_node_nemo.py (55:62) duplicated block id: 367 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (103:112) - dags/pytorch_xla/pytorchxla_torchbench.py (135:144) duplicated block id: 368 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (52:59) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) duplicated block id: 369 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla_torchbench.py (120:127) - dags/pytorch_xla/pytorchxla_torchbench.py (148:155) duplicated block id: 370 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (46:53) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 371 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (1081:1089) - dags/map_reproducibility/utils/internal_aotc_workload.py (157:165) duplicated block id: 372 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/nemo_two_node.py (54:61) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (49:56) duplicated block id: 373 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (47:54) - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:52) duplicated block id: 374 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (87:94) - dags/pytorch_xla/pytorchxla2_torchbench.py (132:139) duplicated block id: 375 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (103:112) - dags/pytorch_xla/pytorchxla_torchbench.py (107:116) duplicated block id: 376 size: 8 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_nightly_supported.py (60:68) - dags/solutions_team/solutionsteam_tf_release_se_supported.py (85:93) duplicated block id: 377 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:57) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 378 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (179:186) - dags/pytorch_xla/r2_7.py (182:189) duplicated block id: 379 size: 8 cleaned lines of code in 2 files: - deployment/clusters.tf (196:205) - deployment/clusters.tf (270:279) duplicated block id: 380 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:50) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) duplicated block id: 381 size: 8 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (157:164) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (58:65) duplicated block id: 382 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (46:53) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 383 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (88:97) - dags/pytorch_xla/pytorchxla_torchbench.py (135:144) duplicated block id: 384 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (88:97) - dags/pytorch_xla/pytorchxla_torchbench.py (121:130) duplicated block id: 385 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/nemo_two_node.py (54:61) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (49:56) duplicated block id: 386 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (118:127) - dags/pytorch_xla/pytorchxla_torchbench.py (107:116) duplicated block id: 387 size: 8 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (145:154) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (515:524) duplicated block id: 388 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (118:127) - dags/pytorch_xla/pytorchxla_torchbench.py (121:130) duplicated block id: 389 size: 8 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (152:161) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (515:524) duplicated block id: 390 size: 8 cleaned lines of code in 2 files: - dags/inference/configs/trtllm_bench_inference_config.py (112:121) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (515:524) duplicated block id: 391 size: 8 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_release_se_supported.py (104:111) - dags/solutions_team/solutionsteam_tf_release_se_supported.py (133:140) duplicated block id: 392 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (240:248) - dags/pytorch_xla/r2_7.py (261:269) duplicated block id: 393 size: 8 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (100:107) - dags/multipod/configs/gke_config.py (259:266) duplicated block id: 394 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:56) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) duplicated block id: 395 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (46:53) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 396 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:50) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 397 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (92:99) - dags/pytorch_xla/pytorchxla-torchbench-release.py (137:144) duplicated block id: 398 size: 8 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (100:107) - dags/multipod/configs/gke_config.py (94:101) duplicated block id: 399 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:52) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 400 size: 8 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (100:107) - dags/multipod/configs/gke_config.py (40:47) duplicated block id: 401 size: 8 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (40:47) - dags/multipod/configs/gke_config.py (259:266) duplicated block id: 402 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (63:70) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:63) duplicated block id: 403 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:52) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 404 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:56) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 405 size: 8 cleaned lines of code in 2 files: - dags/multipod/maxtext_checkpointing.py (31:38) - dags/multipod/maxtext_configs_aot.py (33:40) duplicated block id: 406 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:52) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 407 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (54:61) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (49:56) duplicated block id: 408 size: 8 cleaned lines of code in 2 files: - dags/multipod/maxtext_checkpointing.py (31:38) - dags/multipod/maxtext_gpu_end_to_end.py (226:233) duplicated block id: 409 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (122:129) - dags/pytorch_xla/pytorchxla-torchbench-release.py (137:144) duplicated block id: 410 size: 8 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (100:107) - dags/multipod/configs/gke_config.py (194:201) duplicated block id: 411 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:47) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 412 size: 8 cleaned lines of code in 2 files: - xlml/utils/mantaray.py (55:62) - xlml/utils/mantaray.py (73:80) duplicated block id: 413 size: 8 cleaned lines of code in 2 files: - dags/multipod/maxtext_gpu_end_to_end.py (226:233) - dags/multipod/maxtext_profiling.py (31:38) duplicated block id: 414 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (45:52) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 415 size: 8 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (38:45) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (299:306) duplicated block id: 416 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:52) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 417 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (54:61) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (49:56) duplicated block id: 418 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla_torchbench.py (107:116) - dags/pytorch_xla/pytorchxla_torchbench.py (135:144) duplicated block id: 419 size: 8 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (259:266) - dags/sparsity_diffusion_devx/configs/gke_config.py (53:60) duplicated block id: 420 size: 8 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (46:54) - dags/inference/configs/jetstream_pytorch_gce_config.py (44:52) duplicated block id: 421 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:47) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) duplicated block id: 422 size: 8 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (124:131) - dags/inference/jetstream_inference_e2e.py (137:144) duplicated block id: 423 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla_torchbench.py (107:116) - dags/pytorch_xla/pytorchxla_torchbench.py (121:130) duplicated block id: 424 size: 8 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (40:47) - dags/multipod/configs/gke_config.py (194:201) duplicated block id: 425 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (52:59) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 426 size: 8 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (40:47) - dags/multipod/configs/gke_config.py (94:101) duplicated block id: 427 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:57) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) duplicated block id: 428 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (54:61) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (48:55) duplicated block id: 429 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (93:100) - dags/pytorch_xla/r2_7.py (98:105) duplicated block id: 430 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (26:35) - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (27:35) duplicated block id: 431 size: 8 cleaned lines of code in 2 files: - xlml/utils/metric.py (628:636) - xlml/utils/metric.py (681:689) duplicated block id: 432 size: 8 cleaned lines of code in 2 files: - dags/multipod/maxtext_configs_aot.py (33:40) - dags/multipod/maxtext_profiling.py (31:38) duplicated block id: 433 size: 8 cleaned lines of code in 2 files: - dags/multipod/maxtext_checkpointing.py (31:38) - dags/multipod/maxtext_end_to_end.py (35:42) duplicated block id: 434 size: 8 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (44:52) - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (45:53) duplicated block id: 435 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (50:57) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 436 size: 8 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (68:76) - dags/inference/maxtext_inference.py (152:160) duplicated block id: 437 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (37:44) - dags/pytorch_xla/pytorchxla_torchbench.py (38:45) duplicated block id: 438 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/nemo_two_node.py (54:61) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (48:55) duplicated block id: 439 size: 8 cleaned lines of code in 2 files: - dags/multipod/maxtext_end_to_end.py (35:42) - dags/multipod/maxtext_profiling.py (31:38) duplicated block id: 440 size: 8 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_nightly_supported.py (35:43) - dags/solutions_team/solutionsteam_tf_release_se_supported.py (36:44) duplicated block id: 441 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (45:52) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) duplicated block id: 442 size: 8 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (78:85) - dags/inference/maxtext_inference.py (124:131) duplicated block id: 443 size: 8 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (43:50) - dags/solutions_team/solutionsteam_tf_release_se_supported.py (104:111) duplicated block id: 444 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (43:50) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 445 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (262:269) - dags/map_reproducibility/utils/common_utils.py (318:325) duplicated block id: 446 size: 8 cleaned lines of code in 2 files: - dags/multipod/maxtext_end_to_end.py (157:164) - dags/multipod/maxtext_end_to_end.py (166:173) duplicated block id: 447 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (250:258) - dags/pytorch_xla/r2_7.py (271:279) duplicated block id: 448 size: 8 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (68:76) - dags/inference/maxtext_inference.py (190:198) duplicated block id: 449 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (46:53) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) duplicated block id: 450 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (46:53) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) duplicated block id: 451 size: 8 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (39:46) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (58:65) duplicated block id: 452 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:47) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 453 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:52) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) duplicated block id: 454 size: 8 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (128:135) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (255:262) duplicated block id: 455 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (49:56) - dags/map_reproducibility/a4/two_node_nemo.py (55:62) duplicated block id: 456 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (45:52) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 457 size: 8 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (194:201) - dags/multipod/configs/gke_config.py (259:266) duplicated block id: 458 size: 8 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_release_se_supported.py (85:93) - dags/solutions_team/solutionsteam_tf_release_supported.py (61:69) duplicated block id: 459 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (48:55) - dags/map_reproducibility/a4/two_node_nemo.py (55:62) duplicated block id: 460 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:47) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) duplicated block id: 461 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (52:59) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 462 size: 8 cleaned lines of code in 2 files: - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:263) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (328:335) duplicated block id: 463 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (46:53) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 464 size: 8 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (94:101) - dags/multipod/configs/gke_config.py (259:266) duplicated block id: 465 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (49:56) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 466 size: 8 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (100:107) - dags/sparsity_diffusion_devx/configs/gke_config.py (53:60) duplicated block id: 467 size: 8 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (114:122) - dags/inference/maxtext_inference.py (152:160) duplicated block id: 468 size: 8 cleaned lines of code in 2 files: - dags/multipod/maxtext_configs_aot.py (33:40) - dags/multipod/maxtext_gpu_end_to_end.py (226:233) duplicated block id: 469 size: 8 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (152:160) - dags/inference/maxtext_inference.py (190:198) duplicated block id: 470 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (40:47) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 471 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (45:52) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 472 size: 8 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_release_se_supported.py (36:44) - dags/solutions_team/solutionsteam_tf_release_supported.py (36:44) duplicated block id: 473 size: 8 cleaned lines of code in 2 files: - dags/multipod/maxtext_configs_aot.py (33:40) - dags/multipod/maxtext_end_to_end.py (35:42) duplicated block id: 474 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (45:52) duplicated block id: 475 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla_torchbench.py (121:130) - dags/pytorch_xla/pytorchxla_torchbench.py (135:144) duplicated block id: 476 size: 8 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (117:124) - dags/pytorch_xla/pytorchxla2_torchbench.py (132:139) duplicated block id: 477 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (45:52) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (47:54) duplicated block id: 478 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (40:47) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (38:45) duplicated block id: 479 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:52) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (38:45) duplicated block id: 480 size: 8 cleaned lines of code in 2 files: - dags/sparsity_diffusion_devx/maxtext_moe_tpu_e2e.py (146:153) - dags/sparsity_diffusion_devx/maxtext_moe_tpu_e2e.py (155:162) duplicated block id: 481 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (56:63) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:63) duplicated block id: 482 size: 8 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (33:40) - dags/multipod/configs/maxtext_gce_config.py (106:113) duplicated block id: 483 size: 8 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v41_config.py (207:216) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (515:524) duplicated block id: 484 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (27:35) - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (27:35) duplicated block id: 485 size: 8 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (39:46) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (157:164) duplicated block id: 486 size: 8 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (45:52) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (37:44) duplicated block id: 487 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (82:88) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) duplicated block id: 488 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (124:132) - dags/pytorch_xla/pytorchxla_torchbench.py (108:116) duplicated block id: 489 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (82:88) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 490 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (28:35) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (28:35) duplicated block id: 491 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (128:134) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) duplicated block id: 492 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_sweep_gke_config.py (62:68) - dags/sparsity_diffusion_devx/configs/gke_config.py (54:60) duplicated block id: 493 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (195:201) - dags/multipod/configs/maxtext_sweep_gke_config.py (62:68) duplicated block id: 494 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (80:87) - dags/inference/maxtext_inference_offline_benchmark.py (257:264) duplicated block id: 495 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (51:57) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (49:55) duplicated block id: 496 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (243:249) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 497 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) duplicated block id: 498 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (124:132) - dags/pytorch_xla/pytorchxla_torchbench.py (122:130) duplicated block id: 499 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (243:249) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) duplicated block id: 500 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (134:141) - dags/multipod/configs/gke_config.py (47:54) duplicated block id: 501 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (83:91) - dags/pytorch_xla/pytorchxla2_torchbench.py (78:86) duplicated block id: 502 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (56:62) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (48:54) duplicated block id: 503 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (72:78) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) duplicated block id: 504 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (51:58) - dags/inference/maxtext_inference_offline_benchmark.py (181:187) duplicated block id: 505 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (133:139) - dags/pytorch_xla/pytorchxla_torchbench.py (149:155) duplicated block id: 506 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (56:62) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) duplicated block id: 507 size: 7 cleaned lines of code in 2 files: - dags/multipod/maxtext_trillium_configs_perf.py (47:53) - dags/multipod/maxtext_v5e_configs_perf.py (97:103) duplicated block id: 508 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (80:87) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (342:349) duplicated block id: 509 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (101:107) - dags/multipod/configs/maxtext_sweep_gke_config.py (62:68) duplicated block id: 510 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla_torchbench.py (107:113) - dags/pytorch_xla/pytorchxla_torchbench.py (149:155) duplicated block id: 511 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/inference/maxtext_inference_offline_benchmark.py (243:249) duplicated block id: 512 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (208:214) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) duplicated block id: 513 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/multipod/configs/jax_tests_gce_config.py (56:62) duplicated block id: 514 size: 7 cleaned lines of code in 2 files: - xlml/utils/xpk.py (138:144) - xlml/utils/xpk.py (305:311) duplicated block id: 515 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (134:141) - dags/multipod/configs/gke_config.py (122:129) duplicated block id: 516 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:62) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (49:55) duplicated block id: 517 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (893:900) - dags/map_reproducibility/utils/internal_aotc_workload.py (84:91) duplicated block id: 518 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (119:126) - dags/inference/maxtext_inference.py (271:278) duplicated block id: 519 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/internal_aotc_workload.py (117:123) - dags/map_reproducibility/utils/sample_workload_utils.py (261:267) duplicated block id: 520 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) duplicated block id: 521 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (51:57) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (48:54) duplicated block id: 522 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (72:78) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 523 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (73:80) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (164:171) duplicated block id: 524 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (70:76) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (87:93) duplicated block id: 525 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (128:134) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) duplicated block id: 526 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 527 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (84:90) duplicated block id: 528 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (28:35) - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (28:35) duplicated block id: 529 size: 7 cleaned lines of code in 2 files: - deployment/clusters.tf (215:221) - deployment/clusters.tf (252:258) duplicated block id: 530 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (84:90) duplicated block id: 531 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (63:69) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (49:55) duplicated block id: 532 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (56:62) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) duplicated block id: 533 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (204:210) - dags/inference/maxtext_inference.py (288:294) duplicated block id: 534 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (85:92) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (181:188) duplicated block id: 535 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (204:210) - dags/inference/maxtext_inference.py (280:286) duplicated block id: 536 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (208:214) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 537 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (27:35) - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (28:35) duplicated block id: 538 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (63:70) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (529:536) duplicated block id: 539 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (63:70) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (68:75) duplicated block id: 540 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (127:133) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) duplicated block id: 541 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:62) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (49:55) duplicated block id: 542 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (88:94) - dags/pytorch_xla/pytorchxla_torchbench.py (149:155) duplicated block id: 543 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (54:60) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:62) duplicated block id: 544 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (29:36) - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (29:36) duplicated block id: 545 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (57:63) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (49:55) duplicated block id: 546 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) duplicated block id: 547 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (84:90) duplicated block id: 548 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (228:236) - dags/pytorch_xla/r2_7.py (249:257) duplicated block id: 549 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (85:92) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (353:360) duplicated block id: 550 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (124:132) - dags/pytorch_xla/pytorchxla2_torchbench.py (104:112) duplicated block id: 551 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (73:80) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (309:316) duplicated block id: 552 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 553 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (130:136) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 554 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (84:90) duplicated block id: 555 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (243:249) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) duplicated block id: 556 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (109:117) - dags/pytorch_xla/pytorchxla_torchbench.py (136:144) duplicated block id: 557 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_release_se_supported.py (57:64) - dags/solutions_team/solutionsteam_tf_release_supported.py (45:52) duplicated block id: 558 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:62) - dags/map_reproducibility/a4/two_node_nemo.py (55:61) duplicated block id: 559 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_nightly_supported.py (44:51) - dags/solutions_team/solutionsteam_tf_release_se_supported.py (57:64) duplicated block id: 560 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (328:334) duplicated block id: 561 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (137:146) - dags/pytorch_xla/r2_7.py (139:147) duplicated block id: 562 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (208:214) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) duplicated block id: 563 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (243:249) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) duplicated block id: 564 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (130:136) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) duplicated block id: 565 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (109:117) - dags/pytorch_xla/pytorchxla_torchbench.py (108:116) duplicated block id: 566 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (257:264) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (320:327) duplicated block id: 567 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (137:143) - dags/inference/configs/trt_llm_mlperf_v41_config.py (192:198) duplicated block id: 568 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (34:40) - dags/multipod/configs/mxla_collective_config.py (35:41) duplicated block id: 569 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (41:47) - dags/multipod/configs/maxtext_sweep_gke_config.py (62:68) duplicated block id: 570 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (28:35) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (28:35) duplicated block id: 571 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (128:134) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 572 size: 7 cleaned lines of code in 2 files: - deployment/clusters.tf (152:160) - deployment/clusters.tf (271:279) duplicated block id: 573 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (56:62) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (49:55) duplicated block id: 574 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (56:62) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) duplicated block id: 575 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (116:123) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (224:231) duplicated block id: 576 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (63:70) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (309:316) duplicated block id: 577 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (80:87) - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (141:148) duplicated block id: 578 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (328:334) duplicated block id: 579 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (63:70) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (336:343) duplicated block id: 580 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (94:102) - dags/pytorch_xla/pytorchxla2_torchbench.py (104:112) duplicated block id: 581 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/multipod/configs/mxla_collective_config.py (72:78) duplicated block id: 582 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (280:286) - dags/inference/maxtext_inference.py (288:294) duplicated block id: 583 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (44:50) - dags/inference/maxtext_inference_offline_benchmark.py (169:175) duplicated block id: 584 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (127:133) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) duplicated block id: 585 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (28:35) - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (28:35) duplicated block id: 586 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) duplicated block id: 587 size: 7 cleaned lines of code in 2 files: - deployment/clusters.tf (152:160) - deployment/clusters.tf (197:205) duplicated block id: 588 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (94:102) - dags/pytorch_xla/pytorchxla2_torchbench.py (119:127) duplicated block id: 589 size: 7 cleaned lines of code in 2 files: - deployment/clusters.tf (152:160) - deployment/clusters.tf (234:242) duplicated block id: 590 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 591 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (36:42) - dags/multipod/configs/maxtext_gce_config.py (106:112) duplicated block id: 592 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (243:249) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) duplicated block id: 593 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (63:69) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (48:54) duplicated block id: 594 size: 7 cleaned lines of code in 2 files: - dags/inference/trt_llm_inference.py (38:44) - dags/inference/trt_llm_mlperf_v40_inference.py (52:58) duplicated block id: 595 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (128:134) - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) duplicated block id: 596 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (257:264) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (342:349) duplicated block id: 597 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (224:231) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (174:181) duplicated block id: 598 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (85:92) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (546:553) duplicated block id: 599 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (134:141) - dags/sparsity_diffusion_devx/configs/gke_config.py (60:67) duplicated block id: 600 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (57:63) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (49:55) duplicated block id: 601 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (73:80) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (529:536) duplicated block id: 602 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (72:78) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) duplicated block id: 603 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (128:134) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) duplicated block id: 604 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (112:118) - dags/inference/maxtext_inference_microbenchmark.py (250:256) duplicated block id: 605 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (118:124) - dags/pytorch_xla/pytorchxla_torchbench.py (149:155) duplicated block id: 606 size: 7 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (134:140) - dags/inference/maxtext_inference.py (465:471) duplicated block id: 607 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (63:70) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (164:171) duplicated block id: 608 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (36:42) - dags/multipod/configs/maxtext_gce_config.py (106:112) duplicated block id: 609 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 610 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (88:94) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (70:76) duplicated block id: 611 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (328:334) duplicated block id: 612 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (260:266) - dags/multipod/configs/maxtext_sweep_gke_config.py (62:68) duplicated block id: 613 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (127:133) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) duplicated block id: 614 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (72:78) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) duplicated block id: 615 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (195:202) - dags/inference/maxtext_inference.py (271:278) duplicated block id: 616 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_nightly_supported.py (52:59) - dags/solutions_team/solutionsteam_tf_release_se_supported.py (76:83) duplicated block id: 617 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (103:109) - dags/pytorch_xla/pytorchxla_torchbench.py (149:155) duplicated block id: 618 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_nightly_supported.py (150:158) - dags/solutions_team/solutionsteam_tf_release_supported.py (118:126) duplicated block id: 619 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (208:214) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) duplicated block id: 620 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (57:63) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (49:55) duplicated block id: 621 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (84:90) duplicated block id: 622 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (309:315) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (507:513) duplicated block id: 623 size: 7 cleaned lines of code in 2 files: - dags/multipod/mxla_collective_nightly.py (71:77) - dags/multipod/mxla_collective_nightly.py (84:90) duplicated block id: 624 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) duplicated block id: 625 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (208:214) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) duplicated block id: 626 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (130:136) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) duplicated block id: 627 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (116:123) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (395:402) duplicated block id: 628 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (62:68) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (300:306) duplicated block id: 629 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (56:62) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) duplicated block id: 630 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (133:139) - dags/pytorch_xla/pytorchxla_torchbench.py (107:113) duplicated block id: 631 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (134:141) - dags/multipod/configs/gke_config.py (222:229) duplicated block id: 632 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (133:139) - dags/pytorch_xla/pytorchxla_torchbench.py (121:127) duplicated block id: 633 size: 7 cleaned lines of code in 2 files: - dags/multipod/mxla_collective_nightly.py (45:51) - dags/multipod/mxla_collective_nightly.py (58:64) duplicated block id: 634 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (94:102) - dags/pytorch_xla/pytorchxla_torchbench.py (136:144) duplicated block id: 635 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (133:139) - dags/pytorch_xla/pytorchxla_torchbench.py (135:141) duplicated block id: 636 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (94:102) - dags/pytorch_xla/pytorchxla_torchbench.py (122:130) duplicated block id: 637 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (56:62) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (49:55) duplicated block id: 638 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (82:88) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) duplicated block id: 639 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (130:136) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) duplicated block id: 640 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (84:90) duplicated block id: 641 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla_torchbench.py (135:141) - dags/pytorch_xla/pytorchxla_torchbench.py (149:155) duplicated block id: 642 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (883:890) - dags/multipod/maxtext_gpu_end_to_end.py (72:79) duplicated block id: 643 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/multipod/configs/maxtext_gce_config.py (82:88) duplicated block id: 644 size: 7 cleaned lines of code in 2 files: - deployment/clusters.tf (4:15) - deployment/clusters.tf (106:117) duplicated block id: 645 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (883:890) - dags/multipod/maxtext_gpu_end_to_end.py (100:107) duplicated block id: 646 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:62) - dags/map_reproducibility/a3ultra/nemo_two_node.py (54:60) duplicated block id: 647 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (56:62) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) duplicated block id: 648 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (116:123) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (174:181) duplicated block id: 649 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) - dags/multipod/configs/maxtext_gce_config.py (130:136) duplicated block id: 650 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (72:78) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) duplicated block id: 651 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (80:87) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (320:327) duplicated block id: 652 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (208:214) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) duplicated block id: 653 size: 7 cleaned lines of code in 2 files: - deployment/clusters.tf (234:242) - deployment/clusters.tf (271:279) duplicated block id: 654 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (128:134) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) duplicated block id: 655 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (328:334) duplicated block id: 656 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_release_se_supported.py (76:83) - dags/solutions_team/solutionsteam_tf_release_supported.py (53:60) duplicated block id: 657 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (73:80) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (116:123) duplicated block id: 658 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (95:101) - dags/multipod/configs/maxtext_sweep_gke_config.py (62:68) duplicated block id: 659 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (56:62) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (48:54) duplicated block id: 660 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (124:132) - dags/pytorch_xla/pytorchxla2_torchbench.py (89:97) duplicated block id: 661 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (162:168) - dags/multipod/configs/maxtext_gce_config.py (106:112) duplicated block id: 662 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (175:181) - dags/inference/maxtext_inference.py (280:286) duplicated block id: 663 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (204:210) - dags/inference/maxtext_inference.py (212:218) duplicated block id: 664 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (80:87) - dags/inference/configs/jetstream_pytorch_gce_config.py (142:149) duplicated block id: 665 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (175:181) - dags/inference/maxtext_inference.py (288:294) duplicated block id: 666 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (51:57) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (48:54) duplicated block id: 667 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (80:86) - dags/inference/maxtext_inference_offline_benchmark.py (278:284) duplicated block id: 668 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (128:134) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) duplicated block id: 669 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (130:136) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) duplicated block id: 670 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (73:80) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (336:343) duplicated block id: 671 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (167:173) - dags/inference/maxtext_inference.py (212:218) duplicated block id: 672 size: 7 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (121:127) - dags/inference/maxtext_inference.py (309:315) duplicated block id: 673 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (46:54) - dags/pytorch_xla/pytorchxla_torchbench.py (46:54) duplicated block id: 674 size: 7 cleaned lines of code in 2 files: - dags/framework3p/microbenchmarks_dag.py (40:46) - dags/framework3p/microbenchmarks_dag.py (51:57) duplicated block id: 675 size: 7 cleaned lines of code in 2 files: - dags/multipod/maxtext_end_to_end.py (171:179) - dags/sparsity_diffusion_devx/maxtext_moe_tpu_e2e.py (160:168) duplicated block id: 676 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (328:334) duplicated block id: 677 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 678 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (72:78) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) duplicated block id: 679 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (141:148) - dags/inference/maxtext_inference_offline_benchmark.py (257:264) duplicated block id: 680 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (167:173) - dags/inference/maxtext_inference.py (288:294) duplicated block id: 681 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (167:173) - dags/inference/maxtext_inference.py (280:286) duplicated block id: 682 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (127:133) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) duplicated block id: 683 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (127:133) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) duplicated block id: 684 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (84:90) duplicated block id: 685 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (109:117) - dags/pytorch_xla/pytorchxla2_torchbench.py (119:127) duplicated block id: 686 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (175:181) - dags/inference/maxtext_inference.py (212:218) duplicated block id: 687 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/internal_aotc_workload.py (73:80) - dags/multipod/maxtext_gpu_end_to_end.py (100:107) duplicated block id: 688 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (1019:1026) - dags/multipod/maxtext_gpu_end_to_end.py (72:79) duplicated block id: 689 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (222:229) - dags/inference/maxtext_inference_offline_benchmark.py (257:264) duplicated block id: 690 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (82:88) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (345:351) duplicated block id: 691 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (36:42) - dags/multipod/configs/maxtext_gce_config.py (106:112) duplicated block id: 692 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (51:57) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (49:55) duplicated block id: 693 size: 7 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (66:72) - dags/inference/maxtext_inference_microbenchmark.py (250:256) duplicated block id: 694 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (51:57) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (49:55) duplicated block id: 695 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/jax_tests_gce_config.py (56:62) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 696 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (1019:1026) - dags/multipod/maxtext_gpu_end_to_end.py (100:107) duplicated block id: 697 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (175:181) - dags/inference/maxtext_inference.py (204:210) duplicated block id: 698 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (109:117) - dags/pytorch_xla/pytorchxla2_torchbench.py (89:97) duplicated block id: 699 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (51:57) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (49:55) duplicated block id: 700 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (57:63) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (48:54) duplicated block id: 701 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (82:88) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (125:131) duplicated block id: 702 size: 7 cleaned lines of code in 2 files: - deployment/clusters.tf (197:205) - deployment/clusters.tf (234:242) duplicated block id: 703 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (63:69) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (49:55) duplicated block id: 704 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (57:63) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (48:54) duplicated block id: 705 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (71:77) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (87:93) duplicated block id: 706 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/internal_aotc_workload.py (73:80) - dags/multipod/maxtext_gpu_end_to_end.py (72:79) duplicated block id: 707 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v41_config.py (192:198) - dags/inference/configs/trtllm_bench_inference_config.py (97:103) duplicated block id: 708 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (127:133) - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) duplicated block id: 709 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/mxla_collective_config.py (63:70) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (116:123) duplicated block id: 710 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (208:214) - dags/inference/configs/trt_llm_mlperf_v40_config.py (129:135) duplicated block id: 711 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (188:196) - dags/pytorch_xla/r2_7.py (191:199) duplicated block id: 712 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (71:77) - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (88:94) duplicated block id: 713 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (328:334) duplicated block id: 714 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (243:249) - dags/inference/maxtext_inference.py (251:257) duplicated block id: 715 size: 7 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (224:231) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (395:402) duplicated block id: 716 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (142:149) - dags/inference/maxtext_inference_offline_benchmark.py (257:264) duplicated block id: 717 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (1057:1063) - dags/map_reproducibility/utils/internal_aotc_workload.py (130:136) duplicated block id: 718 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (73:80) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (68:75) duplicated block id: 719 size: 7 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (78:86) - dags/pytorch_xla/pytorchxla_torchbench.py (98:106) duplicated block id: 720 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (934:940) - dags/map_reproducibility/utils/internal_aotc_workload.py (130:136) duplicated block id: 721 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (87:93) - dags/map_reproducibility/internal_runs/a4_maxtext_benchmarking_dags.py (70:76) duplicated block id: 722 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (82:88) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (318:324) duplicated block id: 723 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3mega_maxtext_benchmarking_dags.py (88:94) - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (70:76) duplicated block id: 724 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (167:173) - dags/inference/maxtext_inference.py (175:181) duplicated block id: 725 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (212:218) - dags/inference/maxtext_inference.py (288:294) duplicated block id: 726 size: 7 cleaned lines of code in 2 files: - dags/sparsity_diffusion_devx/jax_stable_stack_gpu_e2e.py (40:46) - dags/sparsity_diffusion_devx/jax_stable_stack_tpu_e2e.py (42:48) duplicated block id: 727 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (167:173) - dags/inference/maxtext_inference.py (204:210) duplicated block id: 728 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (243:249) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (173:179) duplicated block id: 729 size: 7 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (212:218) - dags/inference/maxtext_inference.py (280:286) duplicated block id: 730 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (57:63) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (49:55) duplicated block id: 731 size: 7 cleaned lines of code in 2 files: - dags/multipod/maxtext_end_to_end.py (162:168) - dags/sparsity_diffusion_devx/maxtext_moe_tpu_e2e.py (151:157) duplicated block id: 732 size: 7 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (29:36) - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (29:36) duplicated block id: 733 size: 7 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (80:87) - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (222:229) duplicated block id: 734 size: 7 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (127:133) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (256:262) duplicated block id: 735 size: 7 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (130:136) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (538:544) duplicated block id: 736 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (269:274) - dags/pytorch_xla/r2_7.py (213:218) duplicated block id: 737 size: 6 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (134:140) - dags/multipod/configs/maxtext_sweep_gke_config.py (96:101) duplicated block id: 738 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (113:118) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (111:116) duplicated block id: 739 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (119:125) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (165:171) duplicated block id: 740 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (37:42) - dags/multipod/configs/mxla_collective_config.py (35:40) duplicated block id: 741 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (43:48) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (60:65) duplicated block id: 742 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (269:274) - dags/pytorch_xla/r2_7.py (182:187) duplicated block id: 743 size: 6 cleaned lines of code in 2 files: - dags/sparsity_diffusion_devx/jax_stable_stack_gpu_e2e.py (34:39) - dags/sparsity_diffusion_devx/maxtext_moe_gpu_e2e.py (76:81) duplicated block id: 744 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (102:107) - dags/solutions_team/solutionsteam_tf_nightly_supported.py (122:127) duplicated block id: 745 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_checkpointing.py (31:36) - dags/multipod/maxtext_trillium_configs_perf.py (39:44) duplicated block id: 746 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (113:118) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (41:46) duplicated block id: 747 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (113:118) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (60:65) duplicated block id: 748 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (41:46) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (380:385) duplicated block id: 749 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (48:53) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 750 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (429:434) - dags/inference/maxtext_inference.py (447:452) duplicated block id: 751 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (269:274) - dags/pytorch_xla/r2_7.py (222:227) duplicated block id: 752 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (44:50) - dags/inference/configs/trt_llm_mlperf_v41_config.py (49:55) duplicated block id: 753 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_v5e_configs_perf.py (72:78) - dags/multipod/maxtext_v5e_configs_perf.py (120:126) duplicated block id: 754 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (52:57) - dags/inference/configs/trt_llm_mlperf_v41_config.py (57:62) duplicated block id: 755 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (883:889) - dags/map_reproducibility/utils/internal_aotc_workload.py (215:220) duplicated block id: 756 size: 6 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (153:158) - dags/multipod/configs/gke_config.py (75:81) duplicated block id: 757 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (47:52) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 758 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (200:206) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (337:343) duplicated block id: 759 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (253:258) - deployment/clusters.tf (290:295) duplicated block id: 760 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (120:126) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (117:123) duplicated block id: 761 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (179:184) - dags/pytorch_xla/nightly.py (228:233) duplicated block id: 762 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (131:136) - dags/inference/configs/trtllm_bench_inference_config.py (98:103) duplicated block id: 763 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (47:53) - dags/multipod/configs/maxtext_sweep_gke_config.py (96:101) duplicated block id: 764 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (228:233) - dags/pytorch_xla/r2_7.py (222:227) duplicated block id: 765 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (228:233) - dags/pytorch_xla/r2_7.py (213:218) duplicated block id: 766 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (29:35) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (29:35) duplicated block id: 767 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (179:184) - dags/pytorch_xla/r2_7.py (222:227) duplicated block id: 768 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (228:233) - dags/pytorch_xla/r2_7.py (182:187) duplicated block id: 769 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (269:274) - dags/pytorch_xla/r2_7.py (249:254) duplicated block id: 770 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (138:143) - dags/inference/configs/trt_llm_mlperf_v40_config.py (131:136) duplicated block id: 771 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (179:184) - dags/pytorch_xla/r2_7.py (213:218) duplicated block id: 772 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trtllm_bench_inference_config.py (88:93) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (500:505) duplicated block id: 773 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (200:206) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (117:123) duplicated block id: 774 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v41_config.py (180:185) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (500:505) duplicated block id: 775 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_gpu_end_to_end.py (129:134) - dags/sparsity_diffusion_devx/jax_stable_stack_gpu_e2e.py (48:53) duplicated block id: 776 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (69:75) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (320:326) duplicated block id: 777 size: 6 cleaned lines of code in 2 files: - dags/mantaray/run_mantaray_jobs.py (83:88) - xlml/utils/metric.py (453:458) duplicated block id: 778 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_inference_config.py (128:133) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (500:505) duplicated block id: 779 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/r2_7.py (213:218) - dags/pytorch_xla/r2_7.py (249:254) duplicated block id: 780 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (478:483) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (596:601) duplicated block id: 781 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (179:184) - dags/pytorch_xla/r2_7.py (249:254) duplicated block id: 782 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (19:24) - dags/map_reproducibility/internal_runs/dag_configs.py (40:45) duplicated block id: 783 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (19:24) - dags/map_reproducibility/internal_runs/dag_configs.py (26:31) duplicated block id: 784 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (19:24) - dags/map_reproducibility/internal_runs/dag_configs.py (33:38) duplicated block id: 785 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (52:57) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 786 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (19:24) - dags/map_reproducibility/internal_runs/dag_configs.py (47:52) duplicated block id: 787 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (19:24) - dags/map_reproducibility/internal_runs/dag_configs.py (54:59) duplicated block id: 788 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (530:536) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (320:326) duplicated block id: 789 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (113:118) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (56:61) duplicated block id: 790 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (85:90) - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (120:125) duplicated block id: 791 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (46:51) - dags/inference/maxtext_inference_offline_benchmark.py (170:175) duplicated block id: 792 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (47:52) - dags/map_reproducibility/internal_runs/dag_configs.py (54:59) duplicated block id: 793 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (47:52) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 794 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (29:35) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (30:35) duplicated block id: 795 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_trillium_configs_perf.py (64:69) - dags/multipod/maxtext_v5e_configs_perf.py (108:113) duplicated block id: 796 size: 6 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (144:149) - dags/sparsity_diffusion_devx/configs/gke_config.py (70:75) duplicated block id: 797 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (55:61) - deployment/clusters.tf (126:132) duplicated block id: 798 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (45:50) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (40:45) duplicated block id: 799 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (85:90) - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (102:107) duplicated block id: 800 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_trillium_configs_perf.py (64:69) - dags/multipod/maxtext_v5e_configs_perf.py (60:65) duplicated block id: 801 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (222:228) - dags/multipod/configs/maxtext_sweep_gke_config.py (96:101) duplicated block id: 802 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/internal_aotc_workload.py (215:220) - dags/multipod/maxtext_gpu_end_to_end.py (100:106) duplicated block id: 803 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (94:99) - dags/pytorch_xla/pytorchxla_torchbench.py (150:155) duplicated block id: 804 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (113:118) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (208:213) duplicated block id: 805 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (29:35) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (30:35) duplicated block id: 806 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (41:46) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (56:61) duplicated block id: 807 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (38:43) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (299:304) duplicated block id: 808 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (28:35) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (30:35) duplicated block id: 809 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (30:36) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (28:34) duplicated block id: 810 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (29:35) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (29:35) duplicated block id: 811 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (244:250) - deployment/clusters.tf (281:287) duplicated block id: 812 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/r2_7.py (213:218) - dags/pytorch_xla/r2_7.py (222:227) duplicated block id: 813 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (33:38) - dags/map_reproducibility/internal_runs/dag_configs.py (54:59) duplicated block id: 814 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (285:290) - dags/multipod/configs/maxtext_sweep_gke_config.py (113:118) duplicated block id: 815 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (111:116) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (159:164) duplicated block id: 816 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (120:126) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (69:75) duplicated block id: 817 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_end_to_end.py (35:40) - dags/multipod/maxtext_trillium_configs_perf.py (39:44) duplicated block id: 818 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (153:159) - dags/inference/maxtext_inference.py (228:234) duplicated block id: 819 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (208:213) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (60:65) duplicated block id: 820 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (216:221) - deployment/clusters.tf (290:295) duplicated block id: 821 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (116:121) - dags/pytorch_xla/nightly.py (250:255) duplicated block id: 822 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (228:233) - dags/pytorch_xla/nightly.py (269:274) duplicated block id: 823 size: 6 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (140:145) - dags/multipod/configs/gke_config.py (167:172) duplicated block id: 824 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:50) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (39:44) duplicated block id: 825 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/r2_7.py (182:187) - dags/pytorch_xla/r2_7.py (249:254) duplicated block id: 826 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (124:129) - dags/pytorch_xla/pytorchxla2_torchbench.py (134:139) duplicated block id: 827 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_configs_aot.py (33:38) - dags/multipod/maxtext_trillium_configs_perf.py (39:44) duplicated block id: 828 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (146:151) - dags/map_reproducibility/internal_runs/dag_configs.py (210:215) duplicated block id: 829 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (43:48) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (208:213) duplicated block id: 830 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (113:118) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (380:385) duplicated block id: 831 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v41_config.py (49:55) - dags/inference/configs/trtllm_bench_inference_config.py (44:50) duplicated block id: 832 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_profiling.py (31:36) - dags/multipod/maxtext_v5e_configs_perf.py (40:45) duplicated block id: 833 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (139:144) - dags/pytorch_xla/pytorchxla_torchbench.py (136:141) duplicated block id: 834 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (45:50) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 835 size: 6 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (140:145) - dags/sparsity_diffusion_devx/configs/gke_config.py (105:110) duplicated block id: 836 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_configs_aot.py (33:38) - dags/multipod/maxtext_v5e_configs_perf.py (40:45) duplicated block id: 837 size: 6 cleaned lines of code in 2 files: - xlml/apis/task.py (296:301) - xlml/apis/task.py (352:357) duplicated block id: 838 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (208:213) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (56:61) duplicated block id: 839 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (65:72) - dags/pytorch_xla/pytorchxla2_torchbench.py (62:69) duplicated block id: 840 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (41:46) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (208:213) duplicated block id: 841 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (139:144) - dags/pytorch_xla/pytorchxla_torchbench.py (122:127) duplicated block id: 842 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (70:75) - dags/solutions_team/solutionsteam_tf_release_se_supported.py (132:137) duplicated block id: 843 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (139:144) - dags/pytorch_xla/pytorchxla_torchbench.py (108:113) duplicated block id: 844 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (109:114) - dags/pytorch_xla/pytorchxla_torchbench.py (150:155) duplicated block id: 845 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (45:50) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (39:44) duplicated block id: 846 size: 6 cleaned lines of code in 2 files: - deployment/bigquery.auto.tfvars (76:81) - deployment/bigquery.auto.tfvars (97:102) duplicated block id: 847 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (207:213) - deployment/clusters.tf (244:250) duplicated block id: 848 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/r2_7.py (182:187) - dags/pytorch_xla/r2_7.py (213:218) duplicated block id: 849 size: 6 cleaned lines of code in 2 files: - dags/mlcompass/maxtext_gke.py (100:105) - dags/mlcompass/maxtext_gke.py (109:114) duplicated block id: 850 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (90:96) - dags/multipod/configs/maxtext_gce_config.py (138:144) duplicated block id: 851 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/r2_7.py (182:187) - dags/pytorch_xla/r2_7.py (222:227) duplicated block id: 852 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (119:125) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (337:343) duplicated block id: 853 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:50) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (40:45) duplicated block id: 854 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_gpt3_6b_nightly_gke.py (92:97) - dags/multipod/mxla_gpt3_6b_nightly_gke.py (110:115) duplicated block id: 855 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (970:975) - dags/map_reproducibility/utils/internal_aotc_workload.py (158:163) duplicated block id: 856 size: 6 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (97:103) - dags/inference/maxtext_inference.py (153:159) duplicated block id: 857 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (1019:1025) - dags/map_reproducibility/utils/internal_aotc_workload.py (215:220) duplicated block id: 858 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_gpt3_6b_nightly_gke.py (92:97) - dags/multipod/mxla_gpt3_6b_nightly_gke.py (101:106) duplicated block id: 859 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (116:121) - dags/pytorch_xla/r2_7.py (271:276) duplicated block id: 860 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_profiling.py (31:36) - dags/multipod/maxtext_trillium_configs_perf.py (39:44) duplicated block id: 861 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (156:161) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (108:113) duplicated block id: 862 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (28:35) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (30:35) duplicated block id: 863 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_maxtext_nightly_gke.py (50:55) - dags/multipod/mxla_maxtext_nightly_gke.py (68:73) duplicated block id: 864 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_maxtext_nightly_gke.py (50:55) - dags/multipod/mxla_maxtext_nightly_gke.py (77:82) duplicated block id: 865 size: 6 cleaned lines of code in 2 files: - deployment/bigquery.auto.tfvars (41:46) - deployment/bigquery.auto.tfvars (62:67) duplicated block id: 866 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (30:36) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (30:36) duplicated block id: 867 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (380:385) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (60:65) duplicated block id: 868 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_maxtext_nightly_gke.py (50:55) - dags/multipod/mxla_maxtext_nightly_gke.py (59:64) duplicated block id: 869 size: 6 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (97:103) - dags/inference/maxtext_inference.py (191:197) duplicated block id: 870 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (54:59) - dags/inference/configs/trt_llm_mlperf_v41_config.py (57:62) duplicated block id: 871 size: 6 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (97:103) - dags/inference/maxtext_inference.py (115:121) duplicated block id: 872 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (337:343) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (320:326) duplicated block id: 873 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/r2_7.py (222:227) - dags/pytorch_xla/r2_7.py (249:254) duplicated block id: 874 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (29:35) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (30:35) duplicated block id: 875 size: 6 cleaned lines of code in 2 files: - xlml/utils/metric.py (566:572) - xlml/utils/metric.py (656:661) duplicated block id: 876 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (43:48) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (159:164) duplicated block id: 877 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (29:35) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (30:35) duplicated block id: 878 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_gpt3_6b_nightly_gke.py (101:106) - dags/multipod/mxla_gpt3_6b_nightly_gke.py (110:115) duplicated block id: 879 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_gpt3_6b_nightly_gke.py (32:37) - dags/multipod/mxla_maxtext_nightly_gke.py (31:36) duplicated block id: 880 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (119:125) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (310:316) duplicated block id: 881 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (200:206) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (310:316) duplicated block id: 882 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (200:206) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (165:171) duplicated block id: 883 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (57:62) - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (121:126) duplicated block id: 884 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (59:65) - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (57:63) duplicated block id: 885 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (57:62) - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (103:108) duplicated block id: 886 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (29:35) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (29:35) duplicated block id: 887 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (39:44) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 888 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (179:184) - dags/pytorch_xla/nightly.py (269:274) duplicated block id: 889 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_maxtext_nightly_gke.py (59:64) - dags/multipod/mxla_maxtext_nightly_gke.py (77:82) duplicated block id: 890 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (94:99) - dags/pytorch_xla/pytorchxla2_torchbench.py (134:139) duplicated block id: 891 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_maxtext_nightly_gke.py (59:64) - dags/multipod/mxla_maxtext_nightly_gke.py (68:73) duplicated block id: 892 size: 6 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (144:149) - dags/multipod/configs/gke_config.py (57:62) duplicated block id: 893 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (43:48) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (380:385) duplicated block id: 894 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (71:76) - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (121:126) duplicated block id: 895 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_checkpointing.py (31:36) - dags/multipod/maxtext_v5e_configs_perf.py (40:45) duplicated block id: 896 size: 6 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (144:149) - dags/multipod/configs/gke_config.py (232:237) duplicated block id: 897 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_checkpointing.py (37:42) - dags/multipod/maxtext_convergence.py (37:42) duplicated block id: 898 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (71:76) - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (103:108) duplicated block id: 899 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (48:53) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 900 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (43:48) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (56:61) duplicated block id: 901 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (32:38) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (31:37) duplicated block id: 902 size: 6 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (144:149) - dags/multipod/configs/gke_config.py (132:137) duplicated block id: 903 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_convergence.py (37:42) - dags/multipod/maxtext_profiling.py (37:42) duplicated block id: 904 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (165:171) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (320:326) duplicated block id: 905 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (30:36) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (30:36) duplicated block id: 906 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/internal_aotc_workload.py (143:148) - dags/map_reproducibility/utils/sample_workload_utils.py (282:287) duplicated block id: 907 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (28:35) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (30:35) duplicated block id: 908 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (29:35) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (30:35) duplicated block id: 909 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (30:36) - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (30:36) duplicated block id: 910 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (111:116) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (208:213) duplicated block id: 911 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (120:126) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (530:536) duplicated block id: 912 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (122:128) - dags/multipod/configs/maxtext_sweep_gke_config.py (96:101) duplicated block id: 913 size: 6 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (153:158) - dags/multipod/configs/gke_config.py (293:299) duplicated block id: 914 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (24:30) - deployment/clusters.tf (55:61) duplicated block id: 915 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (131:136) - dags/inference/configs/trt_llm_mlperf_v41_config.py (193:198) duplicated block id: 916 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (42:47) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 917 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_sweep_gke_config.py (96:101) - dags/sparsity_diffusion_devx/configs/gke_config.py (60:66) duplicated block id: 918 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (138:144) - dags/multipod/configs/mxla_collective_config.py (80:86) duplicated block id: 919 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_maxtext_nightly_gke.py (68:73) - dags/multipod/mxla_maxtext_nightly_gke.py (77:82) duplicated block id: 920 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (42:47) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 921 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/a3ultra_maxtext_benchmarking_dags.py (38:43) - dags/map_reproducibility/internal_runs/backfill_dags.py (55:60) duplicated block id: 922 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (119:125) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (530:536) duplicated block id: 923 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (26:31) - dags/map_reproducibility/internal_runs/dag_configs.py (33:38) duplicated block id: 924 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (41:46) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (111:116) duplicated block id: 925 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (207:213) - deployment/clusters.tf (281:287) duplicated block id: 926 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla_torchbench.py (62:67) - dags/pytorch_xla/pytorchxla_torchbench.py (94:99) duplicated block id: 927 size: 6 cleaned lines of code in 2 files: - xlml/utils/gpu.py (436:441) - xlml/utils/gpu.py (546:551) duplicated block id: 928 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (213:218) - dags/inference/maxtext_inference.py (244:249) duplicated block id: 929 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (213:218) - dags/inference/maxtext_inference.py (252:257) duplicated block id: 930 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/nemo_two_node.py (45:50) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (40:45) duplicated block id: 931 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (74:80) - dags/inference/configs/trt_llm_mlperf_v41_config.py (83:89) duplicated block id: 932 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (29:35) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (30:35) duplicated block id: 933 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (26:31) - dags/map_reproducibility/internal_runs/dag_configs.py (47:52) duplicated block id: 934 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (26:31) - dags/map_reproducibility/internal_runs/dag_configs.py (54:59) duplicated block id: 935 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (26:31) - dags/map_reproducibility/internal_runs/dag_configs.py (40:45) duplicated block id: 936 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (176:181) - dags/inference/maxtext_inference.py (252:257) duplicated block id: 937 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (72:77) - deployment/clusters.tf (253:258) duplicated block id: 938 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (176:181) - dags/inference/maxtext_inference.py (244:249) duplicated block id: 939 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (380:385) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (56:61) duplicated block id: 940 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (34:39) - dags/multipod/configs/maxtext_gce_config.py (106:111) duplicated block id: 941 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (119:125) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (69:75) duplicated block id: 942 size: 6 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (35:46) - dags/framework3p/configs/microbenchmarks_config.py (112:123) duplicated block id: 943 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (63:69) - deployment/clusters.tf (207:213) duplicated block id: 944 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (191:197) - dags/inference/maxtext_inference.py (228:234) duplicated block id: 945 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (970:975) - dags/map_reproducibility/utils/common_utils.py (1082:1087) duplicated block id: 946 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (63:69) - deployment/clusters.tf (244:250) duplicated block id: 947 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (56:61) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (60:65) duplicated block id: 948 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (42:48) - dags/pytorch_xla/r2_7.py (59:65) duplicated block id: 949 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (29:35) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (30:35) duplicated block id: 950 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (56:61) - dags/solutions_team/solutionsteam_tf_release_se_supported.py (132:137) duplicated block id: 951 size: 6 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (108:113) - dags/inference/maxtext_inference.py (239:244) duplicated block id: 952 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (117:123) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (320:326) duplicated block id: 953 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v40_config.py (122:127) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (500:505) duplicated block id: 954 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_microbenchmark.py (180:186) - dags/inference/maxtext_model_config_generator.py (102:108) duplicated block id: 955 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/nemo_two_node.py (45:50) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (40:45) duplicated block id: 956 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_maxtext.py (51:56) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 957 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (47:52) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 958 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_gpt3_6b_nightly_gke.py (83:88) - dags/multipod/mxla_gpt3_6b_nightly_gke.py (110:115) duplicated block id: 959 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (67:72) - dags/multipod/configs/maxtext_sweep_gke_config.py (113:118) duplicated block id: 960 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_gpt3_6b_nightly_gke.py (83:88) - dags/multipod/mxla_gpt3_6b_nightly_gke.py (101:106) duplicated block id: 961 size: 6 cleaned lines of code in 2 files: - dags/multipod/mxla_gpt3_6b_nightly_gke.py (83:88) - dags/multipod/mxla_gpt3_6b_nightly_gke.py (92:97) duplicated block id: 962 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (29:35) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (30:35) duplicated block id: 963 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_maxtext.py (30:36) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (28:34) duplicated block id: 964 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (29:35) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (30:35) duplicated block id: 965 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (40:45) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 966 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (139:144) - dags/pytorch_xla/pytorchxla_torchbench.py (150:155) duplicated block id: 967 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (29:35) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (30:35) duplicated block id: 968 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (29:35) - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (29:35) duplicated block id: 969 size: 6 cleaned lines of code in 2 files: - deployment/bigquery.auto.tfvars (34:39) - deployment/bigquery.auto.tfvars (55:60) duplicated block id: 970 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (72:77) - deployment/clusters.tf (216:221) duplicated block id: 971 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (33:38) - dags/map_reproducibility/internal_runs/dag_configs.py (40:45) duplicated block id: 972 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (115:121) - dags/inference/maxtext_inference.py (228:234) duplicated block id: 973 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (33:38) - dags/map_reproducibility/internal_runs/dag_configs.py (47:52) duplicated block id: 974 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/internal_aotc_workload.py (73:79) - dags/map_reproducibility/utils/internal_aotc_workload.py (215:220) duplicated block id: 975 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (43:48) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (41:46) duplicated block id: 976 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (258:263) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (305:310) duplicated block id: 977 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (120:126) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (310:316) duplicated block id: 978 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_end_to_end.py (35:40) - dags/multipod/maxtext_v5e_configs_perf.py (40:45) duplicated block id: 979 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (43:48) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (111:116) duplicated block id: 980 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (120:126) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (337:343) duplicated block id: 981 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_gpu_end_to_end.py (226:231) - dags/multipod/maxtext_v5e_configs_perf.py (40:45) duplicated block id: 982 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/internal_aotc_workload.py (215:220) - dags/multipod/maxtext_gpu_end_to_end.py (72:78) duplicated block id: 983 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (29:35) - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (29:35) duplicated block id: 984 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (43:48) - dags/multipod/configs/maxtext_gce_config.py (113:118) duplicated block id: 985 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (120:125) - dags/solutions_team/solutionsteam_tf_nightly_supported.py (122:127) duplicated block id: 986 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_maxtext.py (30:36) - dags/map_reproducibility/a4/llama3_1_70b/maxtext.py (28:34) duplicated block id: 987 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (29:35) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (30:35) duplicated block id: 988 size: 6 cleaned lines of code in 2 files: - dags/inference/jetstream_pytorch_inference.py (135:140) - dags/inference/maxtext_inference_microbenchmark.py (187:192) duplicated block id: 989 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (324:329) - dags/inference/maxtext_inference.py (361:366) duplicated block id: 990 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (44:49) - dags/inference/maxtext_inference_offline_benchmark.py (170:175) duplicated block id: 991 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (349:354) - dags/inference/maxtext_inference.py (447:452) duplicated block id: 992 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (29:35) - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (30:35) duplicated block id: 993 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (37:42) - dags/multipod/configs/mxla_collective_config.py (35:40) duplicated block id: 994 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/llama_3_1_405b/maxtext.py (47:52) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 995 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a4/mixtral_8_7b/nemo.py (40:45) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 996 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (244:249) - dags/inference/maxtext_inference.py (289:294) duplicated block id: 997 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (244:249) - dags/inference/maxtext_inference.py (281:286) duplicated block id: 998 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (217:222) - dags/multipod/configs/maxtext_gce_config.py (69:74) duplicated block id: 999 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (349:354) - dags/inference/maxtext_inference.py (367:372) duplicated block id: 1000 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (63:70) - dags/pytorch_xla/pytorchxla_torchbench.py (63:70) duplicated block id: 1001 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (200:206) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (530:536) duplicated block id: 1002 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (29:35) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (30:35) duplicated block id: 1003 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (367:372) - dags/inference/maxtext_inference.py (429:434) duplicated block id: 1004 size: 6 cleaned lines of code in 2 files: - deployment/bigquery.auto.tfvars (69:74) - deployment/bigquery.auto.tfvars (90:95) duplicated block id: 1005 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (109:114) - dags/pytorch_xla/pytorchxla2_torchbench.py (134:139) duplicated block id: 1006 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (111:116) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (380:385) duplicated block id: 1007 size: 6 cleaned lines of code in 2 files: - dags/inference/jetstream_pytorch_inference.py (34:39) - dags/inference/jetstream_pytorch_inference.py (63:68) duplicated block id: 1008 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (119:125) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (117:123) duplicated block id: 1009 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (447:452) - dags/inference/maxtext_inference.py (487:492) duplicated block id: 1010 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (139:144) - dags/pytorch_xla/pytorchxla2_torchbench.py (104:109) duplicated block id: 1011 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (252:257) - dags/inference/maxtext_inference.py (281:286) duplicated block id: 1012 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_1_70b_nemo.py (29:35) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (29:35) duplicated block id: 1013 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (139:144) - dags/pytorch_xla/pytorchxla2_torchbench.py (119:124) duplicated block id: 1014 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (252:257) - dags/inference/maxtext_inference.py (289:294) duplicated block id: 1015 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (139:144) - dags/pytorch_xla/pytorchxla2_torchbench.py (134:139) duplicated block id: 1016 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (124:129) - dags/pytorch_xla/pytorchxla_torchbench.py (150:155) duplicated block id: 1017 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_end_to_end.py (104:110) - dags/sparsity_diffusion_devx/maxtext_moe_tpu_e2e.py (97:103) duplicated block id: 1018 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (315:321) - dags/pytorch_xla/configs/pytorchxla_torchbench_config.py (628:634) duplicated block id: 1019 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference_offline_benchmark.py (163:168) - dags/multipod/configs/mxla_collective_config.py (35:40) duplicated block id: 1020 size: 6 cleaned lines of code in 2 files: - xlml/apis/task.py (418:423) - xlml/apis/task.py (455:460) duplicated block id: 1021 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/nightly.py (250:255) - dags/pytorch_xla/r2_7.py (121:126) duplicated block id: 1022 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla-torchbench-release.py (139:144) - dags/pytorch_xla/pytorchxla2_torchbench.py (89:94) duplicated block id: 1023 size: 6 cleaned lines of code in 2 files: - deployment/bigquery.auto.tfvars (27:32) - deployment/bigquery.auto.tfvars (48:53) duplicated block id: 1024 size: 6 cleaned lines of code in 2 files: - deployment/clusters.tf (143:149) - deployment/clusters.tf (188:194) duplicated block id: 1025 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (168:173) - dags/inference/maxtext_inference.py (244:249) duplicated block id: 1026 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_benchmark_serving_gce_config.py (200:206) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (69:75) duplicated block id: 1027 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (168:173) - dags/inference/maxtext_inference.py (252:257) duplicated block id: 1028 size: 6 cleaned lines of code in 2 files: - dags/framework3p/configs/microbenchmarks_config.py (144:149) - dags/multipod/configs/gke_config.py (276:281) duplicated block id: 1029 size: 6 cleaned lines of code in 2 files: - dags/mantaray/run_mantaray_jobs.py (68:73) - xlml/utils/metric.py (438:443) duplicated block id: 1030 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/trt_llm_mlperf_v41_config.py (57:62) - dags/inference/configs/trtllm_bench_inference_config.py (52:57) duplicated block id: 1031 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_multi_tier_checkpointing.py (43:48) - dags/multipod/maxtext_multi_tier_p2_checkpointing.py (43:48) duplicated block id: 1032 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (37:42) - dags/multipod/configs/mxla_collective_config.py (35:40) duplicated block id: 1033 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (310:316) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (320:326) duplicated block id: 1034 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/maxtext_inference_microbenchmark_gce_config.py (38:43) - dags/solutions_team/configs/vllm/vllm_benchmark_config.py (299:304) duplicated block id: 1035 size: 6 cleaned lines of code in 2 files: - dags/multipod/maxtext_gpu_end_to_end.py (226:231) - dags/multipod/maxtext_trillium_configs_perf.py (39:44) duplicated block id: 1036 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/gpt3_175b_nemo.py (28:35) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (29:35) duplicated block id: 1037 size: 6 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (69:75) - dags/inference/jetstream_inference_e2e.py (97:103) duplicated block id: 1038 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/internal_aotc_workload.py (63:70) - dags/map_reproducibility/utils/sample_workload_utils.py (239:246) duplicated block id: 1039 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/mixtral_8_7b_nemo.py (29:35) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (30:35) duplicated block id: 1040 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (367:372) - dags/inference/maxtext_inference.py (487:492) duplicated block id: 1041 size: 6 cleaned lines of code in 2 files: - xlml/apis/task.py (193:198) - xlml/apis/task.py (288:293) duplicated block id: 1042 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (40:45) - dags/map_reproducibility/internal_runs/dag_configs.py (47:52) duplicated block id: 1043 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/internal_runs/dag_configs.py (40:45) - dags/map_reproducibility/internal_runs/dag_configs.py (54:59) duplicated block id: 1044 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (54:59) - dags/map_reproducibility/a4/two_node_nemo.py (46:51) duplicated block id: 1045 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_70b_nemo.py (29:35) - dags/map_reproducibility/a4/llama_3_1_405b/nemo.py (30:35) duplicated block id: 1046 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/maxtext_gce_config.py (113:118) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (159:164) duplicated block id: 1047 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (205:210) - dags/inference/maxtext_inference.py (244:249) duplicated block id: 1048 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/utils/common_utils.py (981:986) - dags/map_reproducibility/utils/common_utils.py (1096:1101) duplicated block id: 1049 size: 6 cleaned lines of code in 2 files: - dags/inference/configs/jetstream_pytorch_gce_config.py (120:126) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (165:171) duplicated block id: 1050 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_nightly_supported_config.py (111:116) - dags/sparsity_diffusion_devx/configs/project_bite_config.py (60:65) duplicated block id: 1051 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/pytorchxla2_torchbench.py (60:67) - dags/pytorch_xla/pytorchxla_torchbench.py (79:86) duplicated block id: 1052 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (29:35) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (30:35) duplicated block id: 1053 size: 6 cleaned lines of code in 2 files: - dags/pytorch_xla/r2_7.py (121:126) - dags/pytorch_xla/r2_7.py (271:276) duplicated block id: 1054 size: 6 cleaned lines of code in 2 files: - dags/inference/jetstream_inference_e2e.py (69:75) - dags/inference/maxtext_inference.py (228:234) duplicated block id: 1055 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (42:47) - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (70:75) duplicated block id: 1056 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3mega/llama_3_70b_nemo.py (29:35) - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (29:35) duplicated block id: 1057 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/llama_3_1_405b_nemo.py (29:35) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (30:35) duplicated block id: 1058 size: 6 cleaned lines of code in 2 files: - dags/map_reproducibility/a3ultra/mixtral_8_7b_nemo.py (29:35) - dags/map_reproducibility/a4/llama3_1_70b/nemo.py (30:35) duplicated block id: 1059 size: 6 cleaned lines of code in 2 files: - dags/multipod/configs/gke_config.py (33:38) - dags/multipod/configs/gke_config.py (253:258) duplicated block id: 1060 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (42:47) - dags/solutions_team/solutionsteam_tf_dlrm_benchmarks.py (56:61) duplicated block id: 1061 size: 6 cleaned lines of code in 2 files: - dags/inference/maxtext_inference.py (205:210) - dags/inference/maxtext_inference.py (252:257) duplicated block id: 1062 size: 6 cleaned lines of code in 2 files: - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (56:61) - dags/solutions_team/configs/tensorflow/solutionsteam_tf_release_supported_config.py (159:164)