GoogleCloudPlatform / golang-samples

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

47% duplication:

57,871 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
27,736 duplicated lines

10,571 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
dlp (1%) --> media (2%)	114	60 file pairs	details...
functions (3%) --> run (4%)	112	3 file pairs	details...
compute (1%) --> dlp (1%)	102	30 file pairs	details...
container_registry (18%) --> dlp (1%)	102	30 file pairs	details...
datacatalog (16%) --> dlp (1%)	96	15 file pairs	details...
bigquery (1%) --> dlp (1%)	96	15 file pairs	details...
aiplatform (19%) --> vertexai (4%)	93	3 file pairs	details...
appengine_flexible (3%) --> eventarc (25%)	70	16 file pairs	details...
auth (10%) --> language (15%)	66	6 file pairs	details...
eventarc (23%) --> run (2%)	64	8 file pairs	details...
endpoints (4%) --> run (2%)	59	4 file pairs	details...
appengine_flexible (3%) --> run (2%)	58	8 file pairs	details...
appengine_flexible (3%) --> getting-started (2%)	57	10 file pairs	details...
videointelligence (4%) --> vision (2%)	54	1 file pair	details...
eventarc (18%) --> getting-started (1%)	51	8 file pairs	details...
bigquery (<1%) --> internal (2%)	50	1 file pair	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 10,571 duplicates...

Size	#	Folders	Files	Lines	Code
119	x 2	cloudsql/mysql/database-sql cloudsql/postgres/database-sql	cloudsql.go cloudsql.go	54:263 (52%) 54:263 (52%)	view
118	x 2	endpoints/getting-started endpoints/getting-started	openapi-appengine.yaml openapi.yaml	29:162 (90%) 31:164 (90%)	view
93	x 2	cloudsql/mysql/database-sql cloudsql/postgres/database-sql	cloudsql.go cloudsql.go	268:368 (40%) 268:368 (40%)	view
92	x 2	appengine_flexible/go115_and_earlier/pubsub appengine_flexible/pubsub	pubsub.go pubsub.go	31:168 (100%) 31:168 (100%)	view
92	x 2	cloudsql/postgres/database-sql cloudsql/sqlserver/database-sql	cloudsql.go cloudsql.go	271:368 (40%) 259:356 (42%)	view
92	x 2	cloudsql/mysql/database-sql cloudsql/sqlserver/database-sql	cloudsql.go cloudsql.go	271:368 (40%) 259:356 (42%)	view
72	x 2	appengine_flexible/go115...rlier/websockets/static appengine_flexible/websockets/static	index.html index.html	16:101 (100%) 16:101 (100%)	view
66	x 2	compute/instances/custom-machine-type compute/instances/custom-machine-type	create_shared_with_helper.go create_with_helper.go	29:116 (43%) 29:116 (44%)	view
65	x 2	media/livestream media/livestream	create_channel.go create_channel_with_backup_input.go	51:125 (83%) 63:137 (75%)	view
58	x 2	pubsub/schemas pubsub/v1samples/schemas	subscribe_with_avro_schema_revisions.go subscribe_with_avro_schema_revisions.go	30:111 (100%) 30:111 (100%)	view
56	x 2	dlp/snippets/inspect dlp/snippets/inspect	inspect_datastore.go inspect_gcs.go	41:120 (48%) 41:120 (50%)	view
54	x 2	cloudsql/postgres/database-sql cloudsql/sqlserver/database-sql	cloudsql.go cloudsql.go	64:146 (23%) 68:149 (24%)	view
54	x 2	cloudsql/mysql/database-sql cloudsql/sqlserver/database-sql	cloudsql.go cloudsql.go	64:146 (23%) 68:149 (24%)	view
52	x 2	functions/functionsv2/ocr/app functions/ocr/app	detect.go detect.go	31:98 (92%) 31:98 (94%)	view
51	x 2	dlp/snippets/inspect dlp/snippets/inspect	inspect_bigquery.go inspect_datastore.go	129:198 (44%) 129:198 (43%)	view
51	x 2	media/transcoder media/transcoder	create_job_from_ad_hoc.go create_job_template.go	48:103 (73%) 45:100 (77%)	view
50	x 2	appengine_flexible/go115_and_earlier/storage appengine_flexible/storage	storage.go storage.go	33:105 (100%) 33:105 (100%)	view
47	x 2	pubsub/topics pubsub/v1samples/topics	publish_ordering.go publish_ordering.go	29:99 (100%) 29:99 (100%)	view
46	x 2	dlp/snippets/inspect dlp/snippets/inspect	inspect_bigquery.go inspect_datastore.go	42:105 (40%) 41:103 (39%)	view
46	x 2	media/transcoder media/transcoder	create_job_with_animated_overlay.go create_job_with_static_overlay.go	39:90 (47%) 39:90 (54%)	view
46	x 2	dlp/snippets/inspect dlp/snippets/inspect	inspect_bigquery.go inspect_gcs.go	42:105 (40%) 41:103 (41%)	view
46	x 2	media/transcoder media/transcoder	create_job_with_periodic_images_sprit... create_job_with_set_number_images_spr...	37:88 (64%) 34:85 (64%)	view
45	x 2	appengine_flexible/datastore appengine_flexible/go115_and_earlier/datastore	datastore.go datastore.go	32:105 (100%) 32:105 (100%)	view
44	x 2	pubsub/schemas pubsub/v1samples/schemas	subscribe_avro_records.go subscribe_avro_records.go	30:86 (100%) 30:86 (100%)	view
43	x 2	cloudsql/postgres/database-sql cloudsql/sqlserver/database-sql	cloudsql.go cloudsql.go	177:263 (18%) 165:251 (19%)	view
43	x 2	cloudsql/mysql/database-sql cloudsql/sqlserver/database-sql	cloudsql.go cloudsql.go	177:263 (18%) 165:251 (19%)	view
43	x 2	functions/imagemagick run/image-processing/imagemagick	imagemagick.go imagemagick.go	35:115 (100%) 35:115 (100%)	view
42	x 2	media/transcoder media/transcoder	create_job_with_animated_overlay.go create_job_with_periodic_images_sprit...	39:85 (43%) 37:83 (59%)	view
42	x 2	speech/snippets speech/snippets	transcribe_streaming_v2.go transcribe_streaming_v2_explicit_deco...	70:123 (59%) 77:130 (53%)	view
42	x 2	media/transcoder media/transcoder	create_job_with_set_number_images_spr... create_job_with_static_overlay.go	34:80 (59%) 39:85 (50%)	view
42	x 2	media/transcoder media/transcoder	create_job_with_animated_overlay.go create_job_with_set_number_images_spr...	39:85 (43%) 34:80 (59%)	view
42	x 2	media/transcoder media/transcoder	create_job_with_periodic_images_sprit... create_job_with_static_overlay.go	37:83 (59%) 39:85 (50%)	view
41	x 2	pubsub/subscriptions pubsub/v1samples/subscriptions	pull_otel_tracing.go pull_otel_tracing.go	34:95 (100%) 34:95 (100%)	view
40	x 2	videointelligence/annotate videointelligence/annotate	logo_detection.go logo_detection_gcs.go	54:125 (75%) 48:119 (80%)	view
39	x 2	dlp/snippets/risk dlp/snippets/risk	categorical.go numerical.go	88:138 (46%) 88:138 (47%)	view
39	x 2	spanner/spanner_snippets spanner/spanner_snippets/spanner	snippet.go pg_spanner_dml_getting_started_update.go	641:696 (6%) 37:92 (84%)	view
39	x 2	dlp/snippets/inspect dlp/snippets/inspect	inspect_datastore.go inspect_gcs.go	129:182 (33%) 125:178 (35%)	view
39	x 2	dlp/snippets/inspect dlp/snippets/inspect	inspect_bigquery.go inspect_gcs.go	129:182 (34%) 125:178 (35%)	view
38	x 2	dlp/snippets/deid dlp/snippets/deid	deid_table_condition_masking.go deid_table_row_suppress.go	32:86 (42%) 31:85 (52%)	view
38	x 2	dlp/snippets/deid dlp/snippets/deid	deid_table_bucketing.go deid_table_condition_masking.go	31:85 (46%) 32:86 (42%)	view
38	x 2	dlp/snippets/deid dlp/snippets/deid	deid_table_bucketing.go deid_table_row_suppress.go	31:85 (46%) 31:85 (52%)	view
38	x 2	appengine_flexible/analytics appengine_flexible/go115_and_earlier/analytics	analytics.go analytics.go	34:101 (100%) 34:101 (100%)	view
38	x 2	compute/instances/custom-machine-type compute/instances/custom-machine-type	create_shared_with_helper.go create_with_helper.go	124:184 (25%) 123:183 (25%)	view
37	x 2	functions/functionsv2/ocr/app functions/ocr/app	setup.go setup.go	51:104 (84%) 55:108 (75%)	view
37	x 2	pubsub/schemas pubsub/v1samples/schemas	publish_avro_records.go publish_avro_records.go	28:80 (100%) 28:80 (100%)	view
37	x 2	spanner/spanner_snippets spanner/spanner_snippets/spanner	snippet.go spanner_dml_getting_started_update.go	436:489 (6%) 37:90 (84%)	view
36	x 2	pubsub/topics pubsub/v1samples/topics	publish_otel_tracing.go publish_otel_tracing.go	35:84 (100%) 35:84 (100%)	view
36	x 2	vertexai/batch-predict vertexai/batch-predict	batch_code_predict.go batch_text_predict.go	44:89 (83%) 47:92 (80%)	view
36	x 2	dlp/snippets/risk dlp/snippets/risk	k_anonymity.go k_map.go	96:143 (41%) 106:154 (37%)	view
36	x 2	dlp/snippets/risk dlp/snippets/risk	k_map.go l_diversity.go	106:154 (37%) 101:147 (38%)	view

Duplicated Units

The list of top 50 duplicated units.

See data for all 137 unit duplicates...

Size	#	Folders	Files	Lines	Code
65	x 2	pubsub/v1samples/schemas pubsub/schemas	subscribe_with_avro_schema_revisions.go subscribe_with_avro_schema_revisions.go	30:112 30:112	view
55	x 2	pubsub/topics pubsub/v1samples/topics	publish_ordering.go publish_ordering.go	29:100 29:100	view
49	x 2	pubsub/v1samples/schemas pubsub/schemas	subscribe_avro_records.go subscribe_avro_records.go	30:87 30:87	view
46	x 2	compute/instances/custom-machine-type compute/instances/custom-machine-type	create_without_helper.go extra_mem_without_helper.go	30:92 30:92	view
44	x 2	pubsub/v1samples/schemas pubsub/schemas	publish_avro_records.go publish_avro_records.go	28:81 28:81	view
43	x 2	pubsub/subscriptions pubsub/v1samples/subscriptions	pull_otel_tracing.go pull_otel_tracing.go	34:96 34:96	view
39	x 2	pubsub/v1samples/schemas pubsub/schemas	publish_proto_messages.go publish_proto_messages.go	29:76 29:76	view
38	x 2	pubsub/topics pubsub/v1samples/topics	publish_otel_tracing.go publish_otel_tracing.go	35:85 35:85	view
37	x 2	pubsub/topics pubsub/v1samples/topics	publish_retry.go publish_retry.go	30:76 30:76	view
37	x 2	pubsub/v1samples/schemas pubsub/schemas	subscribe_proto_messages.go subscribe_proto_messages.go	31:77 31:77	view
36	x 2	pubsub/topics pubsub/v1samples/topics	publish_flow_control.go publish_flow_control.go	29:77 29:77	view
36	x 2	securitycenter/findings securitycenter/findingsv2	update_finding_source_properties.go update_finding_source_properties.go	33:77 33:77	view
36	x 2	cloudsql/mysql/database-sql cloudsql/postgres/database-sql	cloudsql.go cloudsql.go	136:182 136:182	view
35	x 2	pubsub/subscriptions pubsub/v1samples/subscriptions	pull_exactly_once_delivery.go pull_exactly_once_delivery.go	33:85 33:85	view
34	x 2	pubsub/subscriptions pubsub/v1samples/subscriptions	optimistic_subscribe.go optimistic_subscribe.go	32:81 32:81	view
34	x 2	spanner/spanner_snippets/spanner spanner/spanner_snippets/spanner	pg_spanner_query_data_with_new_column.go spanner_query_data_with_new_column.go	29:65 29:65	view
34	x 2	jobs/v3/howto jobs/v3/howto	featured_job_search_sample.go general_search_sample.go	51:100 29:77	view
32	x 2	pubsub/topics pubsub/v1samples/topics	publish_settings.go publish_settings.go	28:66 28:66	view
31	x 2	appengine_flexible/pubsub appengine_flexible/go115_and_earlier/pubsub	pubsub.go pubsub.go	44:83 44:83	view
31	x 2	functions/functionsv2/ocr/app functions/ocr/app	setup.go setup.go	68:105 72:109	view
30	x 2	pubsub/topics pubsub/v1samples/topics	publish_scale.go publish_scale.go	29:70 29:70	view
30	x 2	securitycenter/notificationsv2 securitycenter/notifications	update_notification_config.go update_notification_config.go	28:72 28:72	view
29	x 2	vertexai/gemma2 vertexai/gemma2	gemma2_predict_gpu.go gemma2_predict_tpu.go	29:76 29:75	view
28	x 2	pubsub/topics pubsub/v1samples/topics	create_topic_gcs_ingestion.go create_topic_gcs_ingestion.go	27:65 27:65	view
27	x 2	securitycenter/findings securitycenter/findingsv2	create_finding.go create_finding.go	32:68 32:68	view
27	x 4	genai/text_generation genai/text_generation genai/text_generation genai/text_generation	textgen_code_with_pdf.go textgen_with_txt_img.go textgen_with_mute_video.go textgen_with_youtube_video.go	28:66 28:65 28:64 28:67	view
26	x 2	pubsub/topics pubsub/v1samples/topics	create_topic_kinesis_ingestion.go create_topic_kinesis_ingestion.go	26:57 26:57	view
26	x 2	pubsub/topics pubsub/v1samples/topics	update_topic_type.go update_topic_type.go	26:58 26:58	view
26	x 2	appengine_flexible/go115_and_earlier/analytics appengine_flexible/analytics	analytics.go analytics.go	63:102 63:102	view
25	x 2	securitycenter/findings securitycenter/findingsv2	list_findings_with_security_mark.go list_findings_with_security_mark.go	31:65 31:65	view
25	x 2	securitycenter/findings securitycenter/findingsv2	list_filtered_findings.go list_filtered_findings.go	31:68 31:68	view
25	x 2	securitycenter/notificationsv2 securitycenter/notifications	create_notification_config.go create_notification_config.go	27:65 27:65	view
25	x 2	appengine_flexible/go115_and_earlier/storage appengine_flexible/storage	storage.go storage.go	55:87 55:87	view
24	x 2	spanner/spanner_snippets/spanner spanner/spanner_snippets/spanner	spanner_add_json_column.go pg_spanner_add_jsonb_column.go	30:58 30:58	view
24	x 2	securitycenter/findings securitycenter/findingsv2	list_all_findings.go list_all_findings.go	30:63 30:63	view
24	x 2	securitycenter/findings securitycenter/findingsv2	add_security_marks.go add_security_marks.go	32:68 32:68	view
24	x 2	securitycenter/assets securitycenter/securitymarksv2	add_delete_security_marks.go add_delete_security_marks.go	30:66 30:66	view
24	x 2	securitycenter/assets securitycenter/securitymarksv2	add_security_marks.go add_security_marks.go	31:67 31:67	view
24	x 2	securitycenter/muteconfig securitycenter/muteconfigv2	update_mute_rule.go update_mute_rule.go	31:71 31:71	view
23	x 2	datastore/snippets datastore/snippets	query_in.go query_not_in.go	30:58 30:58	view
23	x 2	securitycenter/findings securitycenter/findingsv2	list_sources.go list_sources.go	30:61 30:61	view
23	x 2	securitycenter/findings securitycenter/findingsv2	update_source.go update_source.go	31:61 31:61	view
23	x 2	securitycenter/assets securitycenter/securitymarksv2	delete_security_marks.go delete_security_marks.go	30:64 30:64	view
23	x 2	parametermanager/regional_samples parametermanager/regional_samples	create_structured_regional_param_vers... create_regional_param_version.go	38:69 38:69	view
23	x 2	cloudsql/mysql/database-sql cloudsql/postgres/database-sql	cloudsql.go cloudsql.go	247:276 247:276	view
22	x 2	pubsub/subscriptions pubsub/v1samples/subscriptions	dead_letter_create.go dead_letter_create.go	28:58 28:58	view
22	x 2	pubsub/subscriptions pubsub/v1samples/subscriptions	sync_pull.go sync_pull.go	28:64 28:64	view
22	x 2	pubsub/subscriptions pubsub/v1samples/subscriptions	create_cloud_storage_subscription.go create_cloud_storage_subscription.go	28:58 28:58	view
22	x 2	pubsub/subscriptions pubsub/v1samples/subscriptions	pull_concurrency.go pull_concurrency.go	28:70 28:70	view
22	x 2	parametermanager parametermanager	create_param_version.go create_structured_param_version.go	36:67 36:67	view