GoogleCloudPlatform / nodejs-docs-samples

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

47% duplication:

52,583 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
25,127 duplicated lines

8,580 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
automl (8%) --> kms (12%)	368	304 file pairs	details...
kms (10%) --> retail (10%)	312	38 file pairs	details...
appengine (16%) --> endpoints (26%)	299	12 file pairs	details...
compute (2%) --> functions (4%)	192	30 file pairs	details...
functions (3%) --> run (5%)	143	2 file pairs	details...
dialogflow (6%) --> speech (4%)	136	1 file pair	details...
ai-platform (1%) --> automl (2%)	132	16 file pairs	details...
appengine (4%) --> cloud-tasks (7%)	78	12 file pairs	details...
automl (1%) --> retail (2%)	72	8 file pairs	details...
dialogflow-cx (3%) --> dialogflow (2%)	54	6 file pairs	details...
ai-platform (<1%) --> retail (1%)	54	14 file pairs	details...
mediatranslation (14%) --> video-intelligence (2%)	54	14 file pairs	details...
functions (1%) --> texttospeech (10%)	54	8 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 8,580 duplicates...

Size	#	Folders	Files	Lines	Code
159	x 2	functions/v2/firebase/fi...restore/google/protobuf functions/v2/firebase/fi...perCase/google/protobuf	proto timestamp.proto timestamp.proto	1:164 (100%) 1:164 (100%)	view
138	x 2	functions/v2/firebase/firestore/helloFirestore functions/v2/firebase/firestore/makeUpperCase	proto data.proto data.proto	1:163 (100%) 1:163 (100%)	view
78	x 2	endpoints/getting-started endpoints/getting-started	openapi-appengine.yaml openapi.yaml	30:121 (86%) 32:123 (86%)	view
76	x 2	functions/v2/firebase/fi...loFirestore/google/type functions/v2/firebase/fi...keUpperCase/google/type	proto latlng.proto latlng.proto	1:81 (100%) 1:81 (100%)	view
75	x 2	compute/instances/custom-machine-type compute/instances/custom-machine-type	createWithHelper.js helperClass.js	39:124 (45%) 34:119 (53%)	view
72	x 2	functions/v2/firebase/fi...restore/google/protobuf functions/v2/firebase/fi...perCase/google/protobuf	proto struct.proto struct.proto	1:79 (100%) 1:79 (100%)	view
61	x 2	cloud-sql/mysql/mysql/views cloud-sql/mysql/mysql2/views	index.pug index.pug	1:68 (100%) 1:68 (100%)	view
61	x 2	cloud-sql/mysql/mysql/views cloud-sql/sqlserver/mssql/views	index.pug index.pug	1:68 (100%) 1:68 (100%)	view
61	x 2	cloud-sql/mysql/mysql2/views cloud-sql/sqlserver/mssql/views	index.pug index.pug	1:68 (100%) 1:68 (100%)	view
58	x 2	dlp dlp	inspectBigQuery.js inspectGCSFile.js	87:157 (52%) 79:150 (55%)	view
53	x 2	media/livestream media/livestream	createChannel.js createChannelWithBackupInput.js	48:107 (71%) 67:126 (58%)	view
52	x 2	recaptcha_enterprise/demosite/app/templates recaptcha_enterprise/demosite/app/templates	comment.html store.html	51:105 (61%) 54:108 (59%)	view
52	x 2	recaptcha_enterprise/demosite/app/templates recaptcha_enterprise/demosite/app/templates	signup.html store.html	47:101 (59%) 54:108 (59%)	view
52	x 2	recaptcha_enterprise/demosite/app/templates recaptcha_enterprise/demosite/app/templates	login.html signup.html	53:107 (59%) 47:101 (59%)	view
52	x 2	recaptcha_enterprise/demosite/app/templates recaptcha_enterprise/demosite/app/templates	comment.html login.html	51:105 (61%) 53:107 (59%)	view
52	x 2	recaptcha_enterprise/demosite/app/templates recaptcha_enterprise/demosite/app/templates	comment.html signup.html	51:105 (61%) 47:101 (59%)	view
52	x 2	recaptcha_enterprise/demosite/app/templates recaptcha_enterprise/demosite/app/templates	login.html store.html	53:107 (59%) 54:108 (59%)	view
48	x 2	cloud-sql/mysql/mysql cloud-sql/mysql/mysql2	index.js index.js	164:237 (35%) 174:247 (34%)	view
46	x 2	recaptcha_enterprise/demosite/app/templates recaptcha_enterprise/demosite/app/templates	home.html login.html	22:68 (86%) 61:107 (52%)	view
46	x 2	recaptcha_enterprise/demosite/app/templates recaptcha_enterprise/demosite/app/templates	home.html store.html	22:68 (86%) 62:108 (52%)	view
46	x 2	recaptcha_enterprise/demosite/app/templates recaptcha_enterprise/demosite/app/templates	home.html signup.html	22:68 (86%) 55:101 (52%)	view
46	x 2	recaptcha_enterprise/demosite/app/templates recaptcha_enterprise/demosite/app/templates	comment.html home.html	59:105 (54%) 22:68 (86%)	view
45	x 2	security-center/snippets/v2 security-center/snippets/v2	groupFindings.js groupFindingsWithFilter.js	15:96 (54%) 15:96 (52%)	view
44	x 2	dlp dlp	inspectDatastore.js inspectGCSFile.js	108:161 (38%) 95:150 (41%)	view
44	x 2	dlp dlp	inspectBigQuery.js inspectDatastore.js	103:157 (40%) 108:161 (38%)	view
43	x 2	appengine/storage/flexible appengine/storage/flexible_nodejs16_and_earlier	app.js app.js	15:90 (100%) 15:90 (100%)	view
42	x 2	media/transcoder media/transcoder	createJobFromAdHoc.js createJobTemplate.js	42:88 (68%) 40:86 (68%)	view
42	x 2	dlp dlp	categoricalRiskAnalysis.js numericalRiskAnalysis.js	77:127 (45%) 79:129 (47%)	view
41	x 2	security-center/snippets/v2 security-center/snippets/v2	setMuteFinding.js setUnmuteFinding.js	15:100 (80%) 15:100 (80%)	view
41	x 2	dlp dlp	inspectBigQueryTableWithSampling.js inspectGcsFileWithSampling.js	100:153 (45%) 90:143 (46%)	view
41	x 2	dlp dlp	categoricalRiskAnalysis.js lDiversityAnalysis.js	79:128 (44%) 84:133 (37%)	view
40	x 2	dlp dlp	kMapEstimationAnalysis.js lDiversityAnalysis.js	86:135 (38%) 85:133 (36%)	view
40	x 2	ai-platform/snippets ai-platform/snippets	imagen-edit-image-inpainting-insert-m... imagen-edit-image-inpainting-remove-m...	63:110 (57%) 63:110 (57%)	view
40	x 2	security-center/snippets/v2 security-center/snippets/v2	getIamPolicy.js testIam.js	15:86 (81%) 15:86 (67%)	view
40	x 2	dlp dlp	categoricalRiskAnalysis.js kMapEstimationAnalysis.js	80:128 (43%) 86:135 (38%)	view
40	x 2	dlp dlp	kAnonymityAnalysis.js lDiversityAnalysis.js	78:126 (40%) 85:133 (36%)	view
40	x 2	datacatalog/cloud-client datacatalog/snippets	createFilesetEntry.js createFileset.js	47:94 (71%) 80:127 (47%)	view
40	x 2	datacatalog/quickstart datacatalog/snippets	createFilesetEntry.js createFileset.js	75:123 (60%) 85:133 (47%)	view
40	x 2	ai-platform/snippets ai-platform/snippets	imagen-edit-image-inpainting-remove-m... imagen-edit-image-outpainting-mask.js	63:110 (57%) 63:110 (57%)	view
40	x 2	dlp dlp	categoricalRiskAnalysis.js kAnonymityAnalysis.js	80:128 (43%) 78:126 (40%)	view
40	x 2	dlp dlp	lDiversityAnalysis.js numericalRiskAnalysis.js	84:132 (36%) 81:129 (44%)	view
40	x 2	dlp dlp	kAnonymityAnalysis.js kMapEstimationAnalysis.js	78:126 (40%) 86:135 (38%)	view
40	x 2	ai-platform/snippets ai-platform/snippets	imagen-edit-image-inpainting-insert-m... imagen-edit-image-outpainting-mask.js	63:110 (57%) 63:110 (57%)	view
39	x 2	dlp dlp	kAnonymityAnalysis.js numericalRiskAnalysis.js	78:125 (39%) 82:129 (43%)	view
39	x 2	dlp dlp	kMapEstimationAnalysis.js numericalRiskAnalysis.js	86:133 (37%) 82:129 (43%)	view
39	x 2	cloud-sql/mysql/mysql cloud-sql/mysql/mysql2	index.js index.js	106:159 (28%) 116:169 (27%)	view
39	x 2	cloud-sql/mysql/mysql2 cloud-sql/sqlserver/tedious	deployment.yaml deployment.yaml	16:57 (100%) 16:57 (100%)	view
38	x 2	video-intelligence video-intelligence	detect_logo.js detect_logo_gcs.js	38:99 (77%) 38:99 (80%)	view
37	x 2	security-center/snippets/v2 security-center/snippets/v2	setFindingState.js setMuteFinding.js	15:83 (94%) 15:85 (72%)	view
37	x 2	dlp dlp	inspectImageFile.js inspectImageFileListedInfoTypes.js	42:90 (67%) 42:89 (67%)	view

Duplicated Units

The list of top 42 duplicated units.

See data for all 42 unit duplicates...

Size	#	Folders	Files	Lines	Code
52	x 3	ai-platform/snippets ai-platform/snippets ai-platform/snippets	imagen-edit-image-outpainting-mask.js imagen-edit-image-inpainting-insert-m... imagen-edit-image-inpainting-remove-m...	46:113 46:113 46:113	view
46	x 2	ai-platform/snippets ai-platform/snippets	get-model-evaluation-tabular-regressi... get-model-evaluation-tabular-classifi...	49:101 49:101	view
44	x 3	ai-platform/snippets ai-platform/snippets ai-platform/snippets	get-model-evaluation-text-classificat... get-model-evaluation-text-entity-extr... get-model-evaluation-text-sentiment-a...	49:99 49:99 49:99	view
39	x 2	dlp dlp	inspectImageFileListedInfoTypes.js inspectImageFile.js	41:91 41:92	view
37	x 2	security-center/snippets/v2 security-center/snippets/v2	groupFindingsWithFilter.js groupFindings.js	31:94 31:94	view
37	x 2	compute/reservations compute/reservations	createInstanceToNotConsumeReservation.js createInstanceToConsumeAnyReservation.js	43:93 43:93	view
29	x 4	security-center/snippets/v2 security-center/snippets/v2 security-center/snippets/v2 security-center/snippets/v2	updateFindingSource.js setUnmuteFinding.js setMuteFinding.js setFindingState.js	32:83 32:83 32:83 30:81	view
29	x 5	security-center/snippets/v2 security-center/snippets/v2 security-center/snippets/v2 security-center/snippets/v2 security-center/snippets/v2	setIamPolicy.js updateSource.js testIam.js getSource.js getIamPolicy.js	29:80 29:80 29:80 30:81 29:80	view
28	x 2	dlp dlp	inspectString.js inspectPhoneNumber.js	62:96 63:97	view
25	x 3	ai-platform/snippets ai-platform/snippets ai-platform/snippets	create-batch-prediction-job-text-sent... create-batch-prediction-job-text-enti... create-batch-prediction-job-text-clas...	52:83 52:83 52:83	view
21	x 8	dlp dlp dlp dlp dlp dlp dlp dlp	inspectFile.js inspectWithHotwordRules.js inspectGCSFile.js inspectBigQuery.js inspectStringRep.js inspectString.js inspectDatastore.js inspectPhoneNumber.js	119:143 150:174 165:189 173:197 113:137 107:131 176:200 108:132	view
20	x 3	ai-platform/snippets ai-platform/snippets ai-platform/snippets	create-dataset-text.js create-dataset-image.js create-dataset-video.js	41:69 41:69 41:69	view
19	x 2	automl/beta automl	batch_predict.js batch_predict.js	40:64 40:64	view
18	x 2	secret-manager secret-manager/regional_samples	iamRevokeAccess.js iamRevokeAccessWithRegionalSecret.js	37:63 43:69	view
16	x 2	automl automl/beta	list_models.js list-models.js	31:51 31:51	view
15	x 2	automl automl/beta	get_model.js get-model.js	36:55 36:55	view
13	x 2	kms kms	createKeyAsymmetricSign.js createKeyAsymmetricDecrypt.js	41:59 41:59	view
12	x 2	automl/beta automl	import-dataset.js import_dataset.js	38:56 38:56	view
12	x 2	security-center/snippets/v2 security-center/snippets/v1	receiveNotifications.js receiveNotifications.js	34:57 31:54	view
12	x 2	secret-manager secret-manager/regional_samples	iamGrantAccess.js iamGrantAccessWithRegionalSecret.js	37:56 42:61	view
12	x 2	secret-manager/regional_samples secret-manager	deleteRegionalSecretLabel.js deleteSecretLabel.js	46:60 39:53	view
12	x 2	secret-manager/regional_samples secret-manager	editRegionalSecretAnnotations.js editSecretAnnotations.js	53:67 40:54	view
12	x 2	secret-manager/regional_samples secret-manager	updateRegionalSecretWithAlias.js updateSecretWithAlias.js	38:52 30:44	view
12	x 2	secret-manager/regional_samples secret-manager	updateRegionalSecret.js updateSecret.js	38:52 30:44	view
12	x 2	secret-manager/regional_samples secret-manager	editRegionalSecretLabel.js createUpdateSecretLabel.js	47:61 40:54	view
11	x 2	dlp dlp	lDiversityAnalysis.js kAnonymityAnalysis.js	171:183 156:168	view
11	x 2	ai-platform/snippets ai-platform/snippets	get-model-evaluation-video-classifica... get-model-evaluation-video-object-tra...	49:65 49:65	view
10	x 2	security-center/snippets/v1 security-center/snippets/v1	listFilteredFindings.js listFindingsWithSecurityMarks.js	35:47 36:48	view
8	x 2	security-center/snippets/v2 security-center/snippets/v1	addSecurityMarks.js addSecurityMarks.js	28:45 28:48	view
8	x 2	security-center/snippets/v2 security-center/snippets/v1	addDeleteSecurityMarks.js addDeleteSecurityMarks.js	28:44 28:44	view
7	x 2	dialogflow/system-test dataproc/system-test	util.js util.js	18:27 18:27	view
7	x 12	batch/create batch/create batch/create batch/create batch/create batch/create batch/create batch/create batch/create batch/create ...	create_nfs_job.js create_local_ssd_job.js create_batch_labels_allocation.js create_batch_using_service_account.js create_batch_custom_events.js create_using_secret_manager.js create_batch_labels_runnable.js create_batch_labels_job.js create_batch_custom_network.js create_persistent_disk_job.js ...	113:124 106:117 104:115 89:100 96:107 89:100 109:120 94:105 114:125 134:145 ...	view
7	x 4	batch/create batch/create batch/create batch/create	create_with_script_no_mounting.js create_script_job_with_template.js create_with_container_no_mounting.js create_with_mounted_bucket.js	99:110 107:118 99:110 111:122	view
7	x 2	security-center/snippets/v2 security-center/snippets/v1	deleteAssetsSecurityMarks.js deleteSecurityMarks.js	28:45 28:48	view
7	x 2	dlp dlp	inspectStringWithExclusionDict.js deidentifyWithDictionaryReplacement.js	117:127 95:105	view
6	x 2	automl automl/beta	delete_dataset.js delete-dataset.js	36:47 36:47	view
6	x 2	workflows workflows	list-workflows.ts list-workflows.js	27:34 31:38	view
6	x 2	dialogflow-cx dialogflow-cx	detect-intent-streaming.js streaming-detect-intent-partial-respo...	112:120 96:104	view
6	x 7	dlp dlp dlp dlp dlp dlp dlp	redactImageFileListedInfoTypes.js deIdentifyWithExceptionList.js redactText.js deIdentifyWithRedaction.js createTrigger.js redactImage.js createInspectTemplate.js	82:89 125:132 73:80 94:101 131:138 89:96 95:102	view
6	x 2	secret-manager/regional_samples secret-manager	viewRegionalSecretLabels.js viewSecretLabels.js	37:45 30:38	view
6	x 2	secret-manager/regional_samples secret-manager	listRegionalSecretVersions.js listSecretVersions.js	38:46 30:38	view
6	x 2	secret-manager/regional_samples secret-manager	viewRegionalSecretAnnotations.js viewSecretAnnotations.js	37:45 30:38	view