GoogleCloudPlatform / ml-auto-solutions

Duplication

Places in code with 6 or more lines that are exactly the same.

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,062 duplicates...

Size	#	Folders	Files	Lines	Code
141	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_nightly_supported_co... solutionsteam_tf_release_supported_co...	403:551 (29%) 183:331 (50%)	view
42	x 2	dags/solutions_team dags/solutions_team	solutionsteam_tf_nightly_supported.py solutionsteam_tf_release_supported.py	34:80 (34%) 35:81 (47%)	view
34	x 2	dags/multipod/configs dags/sparsity_diffusion_devx/configs	gke_config.py gke_config.py	146:181 (13%) 84:119 (40%)	view
33	x 2	dags/map_reproducibility/a3mega dags/map_reproducibility/a3mega	gpt3_175b_nemo.py llama_3_1_70b_nemo.py	27:63 (89%) 28:64 (86%)	view
32	x 2	dags/map_reproducibility/a3mega dags/map_reproducibility/a3mega	gpt3_175b_nemo.py llama_3_70b_nemo.py	31:64 (86%) 37:71 (74%)	view
31	x 2	dags/map_reproducibility/a3mega dags/map_reproducibility/a3mega	llama_3_1_70b_nemo.py llama_3_70b_nemo.py	31:64 (81%) 37:70 (72%)	view
30	x 2	dags/map_reproducibility/a3ultra dags/map_reproducibility/a3ultra	llama_3_1_405b_maxtext.py llama_3_1_70b_maxtext.py	38:69 (76%) 42:74 (53%)	view
30	x 2	dags/map_reproducibility/a3mega dags/map_reproducibility/a3ultra	nemo_two_node.py nemo_two_node.py	30:63 (88%) 30:63 (88%)	view
29	x 2	dags/map_reproducibility/a3ultra dags/map_reproducibility/a4/llama_3_1_405b	llama_3_1_405b_maxtext.py maxtext.py	39:69 (74%) 39:69 (74%)	view
29	x 2	dags/map_reproducibility/a3ultra dags/map_reproducibility/a4/llama_3_1_405b	llama_3_1_70b_maxtext.py maxtext.py	44:74 (51%) 39:69 (74%)	view
28	x 2	dags/inference/configs dags/inference/configs	trt_llm_inference_config.py trtllm_bench_inference_config.py	28:57 (20%) 28:57 (29%)	view
28	x 2	dags/map_reproducibility/internal_runs dags/map_reproducibility/internal_runs	sample_a3mega_maxtext_single_run.py sample_a3ultra_maxtext_single_run.py	19:65 (70%) 19:64 (70%)	view
27	x 2	dags/map_reproducibility/a4/llama3_1_70b dags/map_reproducibility/a4/llama_3_1_405b	nemo.py nemo.py	28:55 (84%) 28:56 (84%)	view
27	x 2	dags/map_reproducibility/internal_runs dags/map_reproducibility/internal_runs	sample_a3ultra_maxtext_single_run.py sample_a4_maxtext_single_run.py	19:61 (67%) 19:61 (71%)	view
27	x 2	dags/map_reproducibility/internal_runs dags/map_reproducibility/internal_runs	sample_a3mega_maxtext_single_run.py sample_a4_maxtext_single_run.py	19:62 (67%) 19:61 (71%)	view
26	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_nightly_supported_co... solutionsteam_tf_nightly_supported_co...	192:220 (5%) 364:392 (5%)	view
25	x 2	dags/map_reproducibility/a3ultra dags/map_reproducibility/a4/llama_3_1_405b	mixtral_8_7b_maxtext.py maxtext.py	49:73 (58%) 45:69 (64%)	view
25	x 2	dags/map_reproducibility/a3ultra dags/map_reproducibility/a4/llama3_1_70b	llama_3_1_405b_maxtext.py maxtext.py	45:69 (64%) 43:67 (64%)	view
25	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_nightly_supported_co... solutionsteam_tf_nightly_supported_co...	334:360 (5%) 527:553 (5%)	view
25	x 2	dags/map_reproducibility/utils dags/map_reproducibility/utils	internal_aotc_workload.py sample_workload_utils.py	177:202 (16%) 332:357 (10%)	view
25	x 2	dags/map_reproducibility/a3ultra dags/map_reproducibility/a3ultra	llama_3_1_70b_maxtext.py mixtral_8_7b_maxtext.py	50:74 (44%) 49:73 (58%)	view
25	x 2	dags/map_reproducibility/a3ultra dags/map_reproducibility/a4/llama3_1_70b	llama_3_1_70b_maxtext.py maxtext.py	50:74 (44%) 43:67 (64%)	view
25	x 2	dags/map_reproducibility/a3ultra dags/map_reproducibility/a4/llama3_1_70b	mixtral_8_7b_maxtext.py maxtext.py	49:73 (58%) 43:67 (64%)	view
25	x 2	dags/map_reproducibility/a3ultra dags/map_reproducibility/a3ultra	llama_3_1_405b_maxtext.py mixtral_8_7b_maxtext.py	45:69 (64%) 49:73 (58%)	view
25	x 2	dags/map_reproducibility/a4/llama3_1_70b dags/map_reproducibility/a4/llama_3_1_405b	maxtext.py maxtext.py	43:67 (64%) 45:69 (64%)	view
24	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_nightly_supported_co... solutionsteam_tf_nightly_supported_co...	163:188 (4%) 528:553 (4%)	view
24	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_release_supported_co... solutionsteam_tf_release_supported_co...	115:140 (8%) 308:333 (8%)	view
24	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_nightly_supported_co... solutionsteam_tf_nightly_supported_co...	163:188 (4%) 335:360 (4%)	view
23	x 2	dags/multipod/configs dags/multipod/configs	gke_config.py gke_config.py	85:108 (9%) 185:208 (9%)	view
23	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_nightly_supported_co... solutionsteam_tf_release_supported_co...	334:358 (4%) 307:331 (8%)	view
22	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_nightly_supported_co... solutionsteam_tf_release_supported_co...	335:358 (4%) 115:138 (7%)	view
22	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_nightly_supported_co... solutionsteam_tf_release_supported_co...	163:186 (4%) 115:138 (7%)	view
22	x 2	dags/multipod/configs dags/sparsity_diffusion_devx/configs	gke_config.py gke_config.py	40:62 (8%) 53:75 (26%)	view
22	x 2	dags/multipod/configs dags/multipod/configs	maxtext_gce_config.py mxla_collective_config.py	73:96 (20%) 63:86 (39%)	view
22	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_nightly_supported_co... solutionsteam_tf_release_supported_co...	528:551 (4%) 115:138 (7%)	view
22	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_nightly_supported_co... solutionsteam_tf_release_supported_co...	163:186 (4%) 308:331 (7%)	view
21	x 2	dags/map_reproducibility/a3mega dags/map_reproducibility/a3ultra	llama_3_1_70b_nemo.py llama_3_1_70b_nemo.py	43:65 (55%) 43:65 (53%)	view
21	x 2	dags/map_reproducibility/a3mega dags/map_reproducibility/a3ultra	llama_3_1_70b_nemo.py mixtral_8_7b_nemo.py	46:66 (55%) 40:60 (65%)	view
21	x 2	dags/map_reproducibility/a3mega dags/map_reproducibility/a3mega	llama_3_1_70b_nemo.py mixtral_8_7b_nemo.py	46:66 (55%) 40:60 (65%)	view
21	x 2	dags/inference/configs dags/inference/configs	trt_llm_mlperf_v40_config.py trt_llm_mlperf_v41_config.py	82:102 (17%) 91:111 (11%)	view
21	x 2	xlml/utils xlml/utils	gpu.py gpu.py	176:196 (5%) 231:251 (5%)	view
21	x 2	dags/multipod/configs dags/multipod/configs	gke_config.py gke_config.py	120:142 (8%) 220:242 (8%)	view
21	x 2	dags/map_reproducibility/a3mega dags/map_reproducibility/a3ultra	mixtral_8_7b_nemo.py mixtral_8_7b_nemo.py	40:60 (65%) 40:60 (65%)	view
20	x 2	dags/solutions_team/configs/tensorflow dags/solutions_team/configs/tensorflow	solutionsteam_tf_nightly_supported_co... solutionsteam_tf_release_supported_co...	126:145 (4%) 81:100 (7%)	view
20	x 2	dags/inference/configs dags/inference/configs	trt_llm_mlperf_v40_config.py trt_llm_mlperf_v41_config.py	110:130 (16%) 168:188 (10%)	view
20	x 2	dags/map_reproducibility/a3mega dags/map_reproducibility/a3ultra	gpt3_175b_nemo.py llama_3_1_70b_nemo.py	43:63 (54%) 43:64 (51%)	view
20	x 2	dags/map_reproducibility/a3mega dags/map_reproducibility/a3ultra	mixtral_8_7b_nemo.py llama_3_1_70b_nemo.py	40:59 (62%) 46:65 (51%)	view
20	x 2	dags/map_reproducibility/a3ultra dags/map_reproducibility/a3ultra	llama_3_1_70b_nemo.py mixtral_8_7b_nemo.py	46:65 (51%) 40:59 (62%)	view
20	x 2	dags/map_reproducibility/a3mega dags/map_reproducibility/a3ultra	llama_3_70b_nemo.py llama_3_1_70b_nemo.py	49:70 (46%) 43:64 (51%)	view
19	x 2	dags/inference/configs dags/inference/configs	trt_llm_inference_config.py trt_llm_mlperf_v40_config.py	145:166 (14%) 138:159 (15%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
11	x 2	dags/inference/configs dags/inference/configs	trtllm_bench_inference_config.py trt_llm_inference_config.py	0:0  0:0	view