GoogleCloudPlatform / professional-services

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

17% duplication:

74,487 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
13,097 duplicated lines

1,683 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,683 duplicates...

Size	#	Folders	Files	Lines	Code
441	x 2	tools/numeric-family-recommender-oracle tools/numeric-family-recommender-oracle	Oracle_Number_Recommender_GCP.sql Oracle_Number_Recommender_GCP_11g.sql	196:677 (76%) 194:675 (76%)	view
199	x 2	tools/scd-bq-to-bq tools/scd-file-to-file	scd_operations.py scd_operations.py	7:308 (100%) 7:308 (100%)	view
183	x 2	tools/airflow-v1-to-v2-migration/airflow_migration tools/cloud-composer-mig...ation/airflow_migration	migration.py migration.py	9:249 (100%) 9:249 (100%)	view
153	x 2	tools/bigquery_mdr tools/bigquery_mdr	crr_init.sql crr_init_auto_batch.sql	27:254 (49%) 26:253 (91%)	view
138	x 2	tools/airflow-v1-to-v2-migration/misc tools/cloud-composer-mig...v1-to-v2-migration/misc	migration.py migration.py	9:168 (100%) 9:168 (100%)	view
131	x 2	tools/bigquery_user_info...o_updater/updater_tools tools/bigquery_user_info...o_updater/updater_tools	query_creator.py query_creator.py	21:265 (100%) 21:265 (100%)	view
85	x 2	tools/datagen-bq-to-bq tools/datagen-gcs-to-gcs	file_processing_utils.py file_processing_utils.py	116:295 (52%) 140:319 (48%)	view
78	x 2	tools/datagen-bq-to-bq tools/datagen-gcs-to-gcs	audit_utils.py audit_utils.py	5:84 (100%) 5:84 (100%)	view
77	x 2	tools/bigquery_user_info...o_updater/updater_tools tools/bigquery_user_info...o_updater/updater_tools	user_info_updater.py user_info_updater.py	20:148 (100%) 20:148 (100%)	view
74	x 2	tools/datagen-bq-to-bq tools/datagen-gcs-to-gcs	snowfakery_gen.py snowfakery_gen.py	10:131 (100%) 10:131 (100%)	view
68	x 2	tools/datagen-bq-to-bq tools/datagen-gcs-to-gcs	bq_ops.py bq_ops.py	7:136 (100%) 7:137 (100%)	view
67	x 2	tools/datagen-bq-to-bq tools/datagen-gcs-to-gcs	gcs_ops.py gcs_ops.py	8:171 (100%) 8:171 (100%)	view
63	x 2	tools/airflow-v1-to-v2-migration tools/cloud-composer-mig...flow-v1-to-v2-migration	run_mig.py run_mig.py	10:83 (100%) 10:83 (100%)	view
63	x 2	tools/gcpviz/queries tools/gcpviz/queries	data.js instances.js	36:123 (76%) 37:124 (75%)	view
62	x 2	tools/gcpviz/queries tools/gcpviz/queries	data.js gke.js	37:123 (75%) 29:115 (83%)	view
62	x 2	tools/gcpviz/queries tools/gcpviz/queries	gke.js network-basic.js	29:115 (83%) 34:120 (78%)	view
62	x 2	tools/gcpviz/queries tools/gcpviz/queries	instances.js network-basic.js	38:124 (74%) 34:120 (78%)	view
62	x 2	tools/gcpviz/queries tools/gcpviz/queries	instances.js security.js	38:124 (74%) 36:122 (77%)	view
62	x 2	tools/gcpviz/queries tools/gcpviz/queries	data.js security.js	37:123 (75%) 36:122 (77%)	view
62	x 2	tools/gcpviz/queries tools/gcpviz/queries	gke.js instances.js	29:115 (83%) 38:124 (74%)	view
62	x 2	tools/gcpviz/queries tools/gcpviz/queries	gke.js security.js	29:115 (83%) 36:122 (77%)	view
62	x 2	tools/gcpviz/queries tools/gcpviz/queries	network-basic.js security.js	34:120 (78%) 36:122 (77%)	view
62	x 2	tools/gcpviz/queries tools/gcpviz/queries	data.js network-basic.js	37:123 (75%) 34:120 (78%)	view
59	x 2	tools/gcpviz/queries tools/gcpviz/queries	instances.js load-balancing.js	38:121 (71%) 37:120 (71%)	view
59	x 2	tools/gcpviz/queries tools/gcpviz/queries	load-balancing.js security.js	37:120 (71%) 36:119 (73%)	view
59	x 2	tools/gcpviz/queries tools/gcpviz/queries	gke.js load-balancing.js	29:112 (79%) 37:120 (71%)	view
59	x 2	tools/gcpviz/queries tools/gcpviz/queries	load-balancing.js network-basic.js	37:120 (71%) 34:117 (74%)	view
59	x 2	tools/gcpviz/queries tools/gcpviz/queries	data.js load-balancing.js	37:120 (71%) 37:120 (71%)	view
58	x 2	tools/bigquery_user_info...query_user_info_updater tools/bigquery_user_info...query_user_info_updater	update_user_info.py update_user_info.py	22:104 (100%) 22:104 (100%)	view
57	x 2	tools/gcpviz/queries tools/gcpviz/queries	gke.js one-project-example.js	29:108 (77%) 28:107 (81%)	view
57	x 2	tools/gcpviz/queries tools/gcpviz/queries	one-project-example.js security.js	28:107 (81%) 36:115 (71%)	view
57	x 2	tools/gcpviz/queries tools/gcpviz/queries	network-basic.js one-project-example.js	34:113 (72%) 28:107 (81%)	view
57	x 2	tools/gcpviz/queries tools/gcpviz/queries	load-balancing.js one-project-example.js	37:116 (69%) 28:107 (81%)	view
57	x 2	tools/gcpviz/queries tools/gcpviz/queries	data.js one-project-example.js	37:116 (69%) 28:107 (81%)	view
57	x 2	tools/gcpviz/queries tools/gcpviz/queries	instances.js one-project-example.js	38:117 (68%) 28:107 (81%)	view
53	x 2	tools/datagen-bq-to-bq tools/datagen-gcs-to-gcs	main.py main.py	45:114 (55%) 45:114 (58%)	view
50	x 2	tools/vector-search-load...vertex-ai-vector-search tools/vector-search-load...ing-framework/terraform	variables.tf variables.tf	75:132 (18%) 90:147 (15%)	view
48	x 2	tools/vector-search-load...vertex-ai-vector-search tools/vector-search-load...ing-framework/terraform	variables.tf variables.tf	195:256 (17%) 330:391 (14%)	view
45	x 2	tools/dataproc-scheduled...cheduled-cluster-sizing tools/dataproc-scheduled-cluster-sizing/terraform	variables.tf variables.tf	15:67 (100%) 15:67 (100%)	view
44	x 2	tools/scd-bq-to-bq tools/scd-bq-to-bq	scd_operations.py scd_operations.py	66:118 (22%) 214:266 (22%)	view
44	x 2	tools/scd-bq-to-bq tools/scd-file-to-file	scd_operations.py scd_operations.py	66:118 (22%) 214:266 (22%)	view
44	x 2	tools/scd-bq-to-bq tools/scd-file-to-file	scd_operations.py scd_operations.py	214:266 (22%) 66:118 (22%)	view
44	x 2	tools/scd-file-to-file tools/scd-file-to-file	scd_operations.py scd_operations.py	66:118 (22%) 214:266 (22%)	view
41	x 2	tools/datagen-bq-to-bq tools/datagen-gcs-to-gcs	file_processing_utils.py file_processing_utils.py	12:64 (25%) 13:65 (23%)	view
40	x 2	tools/bigquery_user_info...query_user_info_updater tools/bigquery_user_info...query_user_info_updater	initialize_bigquery_resources.py initialize_bigquery_resources.py	21:81 (100%) 21:81 (100%)	view
40	x 2	tools/gpudirect-webhook/src tools/gpudirect-webhook/src	webhook.rs webhook.rs	87:126 (10%) 286:325 (10%)	view
36	x 2	tools/datagen-bq-to-bq tools/datagen-gcs-to-gcs	file_processing_utils.py file_processing_utils.py	65:115 (22%) 88:138 (20%)	view
35	x 2	tools/numeric-family-recommender-oracle tools/numeric-family-recommender-oracle	Oracle_Number_Recommender_GCP.sql Oracle_Number_Recommender_GCP_11g.sql	75:111 (6%) 74:109 (6%)	view
35	x 2	tools/vector-search-load...vertex-ai-vector-search tools/vector-search-load...ing-framework/terraform	variables.tf variables.tf	35:76 (13%) 41:81 (10%)	view
32	x 2	tools/gcpviz/queries tools/gcpviz/queries	network-basic.js vpns.js	34:76 (40%) 29:71 (35%)	view

Duplicated Units

The list of top 21 duplicated units.

See data for all 21 unit duplicates...

Size	#	Folders	Files	Lines	Code
128	x 2	tools/airflow-v1-to-v2-migration/airflow_migration tools/cloud-composer-mig...ation/airflow_migration	migration.py migration.py	0:0 0:0	view
93	x 2	tools/airflow-v1-to-v2-migration/misc tools/cloud-composer-mig...v1-to-v2-migration/misc	migration.py migration.py	0:0 0:0	view
112	x 2	tools/bigquery_user_info...o_updater/updater_tools tools/bigquery_user_info...o_updater/updater_tools	query_creator.py query_creator.py	0:0 0:0	view
30	x 8	tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries	network-basic.js load-balancing.js data.js gke.js security.js instances.js one-project-example.js vpns.js	80:114 83:117 83:117 75:109 82:116 84:118 74:108 90:124	view
36	x 2	tools/bigquery_user_info...query_user_info_updater tools/bigquery_user_info...query_user_info_updater	update_user_info.py update_user_info.py	0:0 0:0	view
37	x 2	tools/bigquery_user_info...o_updater/updater_tools tools/bigquery_user_info...o_updater/updater_tools	user_info_updater.py user_info_updater.py	0:0 0:0	view
28	x 2	tools/datagen-gcs-to-gcs tools/datagen-bq-to-bq	snowfakery_gen.py snowfakery_gen.py	0:0 0:0	view
25	x 2	tools/ipam-autopilot/provider/ipam/resources tools/ipam-autopilot/provider/ipam/resources	resource_routing_domain.go resource_ip_range.go	159:188 184:213	view
38	x 2	tools/datagen-gcs-to-gcs tools/datagen-bq-to-bq	bq_ops.py bq_ops.py	0:0 0:0	view
29	x 2	tools/bigquery_user_info...query_user_info_updater tools/bigquery_user_info...query_user_info_updater	initialize_bigquery_resources.py initialize_bigquery_resources.py	0:0 0:0	view
34	x 2	tools/datagen-gcs-to-gcs tools/datagen-bq-to-bq	file_processing_utils.py file_processing_utils.py	0:0 0:0	view
37	x 2	tools/datagen-gcs-to-gcs tools/datagen-bq-to-bq	gcs_ops.py gcs_ops.py	0:0 0:0	view
17	x 2	tools/custom-organization-policy-library/scripts tools/custom-organization-policy-library/scripts	cvt-tf-constraints.py cvt-tf-policies.py	0:0 0:0	view
18	x 2	tools/bigquery_user_info...o_updater/updater_tools tools/bigquery_user_info...o_updater/updater_tools	user_schema.py user_schema.py	0:0 0:0	view
12	x 2	tools/airflow-v1-to-v2-migration tools/cloud-composer-mig...flow-v1-to-v2-migration	run_mig.py run_mig.py	0:0 0:0	view
12	x 8	tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries	network-basic.js load-balancing.js data.js gke.js security.js instances.js one-project-example.js vpns.js	48:61 51:64 51:64 43:56 50:63 52:65 42:55 43:56	view
12	x 8	tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries	network-basic.js load-balancing.js data.js gke.js security.js instances.js one-project-example.js vpns.js	64:77 67:80 67:80 59:72 66:79 68:81 58:71 59:72	view
9	x 2	tools/bigquery_user_info...o_updater/updater_tools tools/bigquery_user_info...o_updater/updater_tools	bigquery_resource_util.py bigquery_resource_util.py	0:0 0:0	view
8	x 2	tools/scd-bq-to-bq tools/scd-file-to-file	scd_operations.py scd_operations.py	0:0 0:0	view
7	x 2	tools/bqman/golang/bqhandler tools/bqman/golang/connector	bqhandler.go sqlserverhandler.go	235:243 280:288	view
6	x 10	tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries tools/gcpviz/queries	network-basic.js load-balancing.js vpc-security.js data.js gke.js security.js instances.js shared-vpc.js one-project-example.js vpns.js	38:45 41:48 25:32 41:48 33:40 40:47 42:49 34:41 32:39 33:40	view