gitlab-org / gitlab-runner

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

6% duplication:

44,986 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
3,024 duplicated lines

1,192 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
executors (1%) --> helpers (1%)	435	55 file pairs	details...
common (2%) --> helpers (1%)	337	41 file pairs	details...
helpers (1%) --> log (16%)	255	17 file pairs	details...
common (1%) --> executors (1%)	250	15 file pairs	details...
executors (<1%) --> log (12%)	192	10 file pairs	details...
helpers (<1%) --> magefiles (3%)	162	16 file pairs	details...
helpers (<1%) --> referees (5%)	120	27 file pairs	details...
helpers (<1%) --> network (3%)	114	9 file pairs	details...
common (<1%) --> log (7%)	112	5 file pairs	details...
commands (1%) --> helpers (<1%)	109	8 file pairs	details...
common (<1%) --> magefiles (2%)	96	6 file pairs	details...
commands (<1%) --> executors (<1%)	89	7 file pairs	details...
magefiles (1%) --> scripts (13%)	84	1 file pair	details...
log (4%) --> magefiles (1%)	72	2 file pairs	details...
helpers (<1%) --> session (6%)	69	7 file pairs	details...
executors (<1%) --> referees (2%)	60	5 file pairs	details...
network (1%) --> referees (2%)	60	3 file pairs	details...
log (3%) --> shells (1%)	56	1 file pair	details...
executors (<1%) --> magefiles (1%)	54	5 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,192 duplicates...

Size	#	Folders	Files	Lines	Code
38	x 2	executors/docker/internal/networks executors/docker/internal/volumes	mock_debugLogger.go mock_debugLogger.go	8:73 (100%) 8:73 (100%)	view
34	x 2	magefiles/docutils scripts/update-feature-flags-docs	block_line_replacer.go main.go	10:67 (79%) 121:178 (29%)	view
34	x 2	executors/docker/internal/pull executors/kubernetes/internal/pull	mock_pullLogger.go mock_pullLogger.go	142:199 (30%) 58:115 (54%)	view
31	x 2	helpers/usage_log/logrotate helpers/usage_log	mock_Option.go mock_Option.go	8:64 (100%) 8:64 (100%)	view
30	x 2	helpers/process helpers/ssh	job_windows.go stub_ssh_server_windows.go	85:131 (42%) 39:83 (69%)	view
25	x 2	executors helpers/docker	mock_Client.go mock_Client.go	26:67 (19%) 86:127 (2%)	view
24	x 2	executors/docker/internal/pull executors/kubernetes/internal/pull	mock_pullLogger.go mock_pullLogger.go	63:101 (21%) 21:59 (38%)	view
22	x 2	executors/parallels executors/virtualbox	parallels.go virtualbox.go	439:465 (7%) 366:392 (8%)	view
20	x 2	executors/parallels executors/virtualbox	parallels.go virtualbox.go	385:412 (7%) 327:354 (8%)	view
18	x 2	common executors	mock_WithContext.go mock_Environment.go	26:53 (37%) 89:116 (22%)	view
18	x 2	helpers/runner_wrapper/api/client helpers/usage_log/logrotate	mock_Option.go mock_Option.go	37:64 (58%) 37:64 (58%)	view
18	x 2	helpers/runner_wrapper/api/client helpers/usage_log	mock_Option.go mock_Option.go	37:64 (58%) 37:64 (58%)	view
17	x 2	executors/ssh executors/virtualbox	ssh.go virtualbox.go	49:70 (26%) 331:352 (6%)	view
17	x 2	commands/helpers commands/helpers	cache_archiver.go cache_extractor.go	105:131 (10%) 121:147 (10%)	view
17	x 2	executors/parallels executors/ssh	parallels.go ssh.go	389:410 (6%) 49:70 (26%)	view
16	x 2	common helpers/usage_log	mock_JobTrace.go mock_dummyWriteCloser.go	418:441 (6%) 67:90 (22%)	view
16	x 2	commands/helpers executors/docker/internal/exec	mock_readSeekCloser.go mock_reader.go	67:90 (15%) 22:45 (34%)	view
14	x 2	executors/docker/internal/volumes/parser shells	mock_Path.go mock_ShellWriter.go	161:180 (11%) 706:725 (1%)	view
14	x 2	log log	mock_systemService.go mock_systemService.go	76:95 (4%) 459:478 (4%)	view
14	x 2	common helpers/docker	mock_urlHelper.go mock_Machine.go	83:102 (17%) 243:262 (5%)	view
14	x 2	helpers/vault helpers/vault	mock_apiClientLogical.go mock_apiClientLogical.go	31:50 (12%) 89:108 (12%)	view
14	x 2	helpers/retry helpers/retry	mock_RunValueFunc.go mock_valueRetryable.go	28:47 (29%) 28:47 (19%)	view
13	x 2	executors/docker/internal/user executors/docker/internal/user	mock_Inspect.go mock_Inspect.go	32:49 (11%) 146:163 (11%)	view
13	x 2	commands/helpers common	mock_readSeekCloser.go mock_JobTrace.go	73:90 (12%) 424:441 (5%)	view
13	x 2	common helpers/vault	mock_SecretResolver.go mock_Result.go	118:135 (13%) 75:92 (18%)	view
13	x 2	common helpers/vault	mock_urlHelper.go mock_Result.go	28:45 (16%) 75:92 (18%)	view
13	x 2	network network	gitlab.go gitlab.go	423:435 (1%) 458:470 (1%)	view
13	x 2	common executors/docker/internal/exec	mock_JobTrace.go mock_reader.go	424:441 (5%) 28:45 (28%)	view
13	x 2	executors/docker/internal/exec executors/docker/internal/exec	mock_conn.go mock_conn.go	126:143 (5%) 367:384 (5%)	view
13	x 2	common common	mock_SecretResolver.go mock_urlHelper.go	118:135 (13%) 28:45 (16%)	view
13	x 2	commands/helpers helpers/usage_log	mock_readSeekCloser.go mock_dummyWriteCloser.go	73:90 (12%) 73:90 (18%)	view
13	x 2	executors/docker/internal/exec helpers/usage_log	mock_reader.go mock_dummyWriteCloser.go	28:45 (28%) 73:90 (18%)	view
12	x 2	dockerfiles/runner-helper dockerfiles/runner	hcl docker-bake.hcl docker-bake.hcl	1:15 (9%) 1:15 (17%)	view
12	x 2	executors/parallels executors/virtualbox	parallels.go virtualbox.go	188:207 (4%) 146:165 (4%)	view
11	x 2	executors/custom executors/shell	custom.go shell.go	392:407 (4%) 165:180 (10%)	view
10	x 2	executors/docker/internal/networks executors/kubernetes/internal/pull	mock_Manager.go mock_Manager.go	184:199 (9%) 122:137 (14%)	view
10	x 2	common executors/kubernetes/internal/watchers	mock_logger.go mock_logger.go	100:115 (16%) 58:73 (26%)	view
10	x 2	helpers/ssh helpers/usage_log/logrotate	mock_Option.go mock_Option.go	49:64 (32%) 49:64 (32%)	view
10	x 2	executors helpers/docker	mock_Client.go mock_Client.go	231:246 (7%) 1604:1619 (1%)	view
10	x 2	executors/docker/internal/volumes executors/kubernetes/internal/pull	mock_Manager.go mock_Manager.go	207:222 (8%) 122:137 (14%)	view
10	x 2	helpers/runner_wrapper/api/client helpers/ssh	mock_Option.go mock_Option.go	49:64 (32%) 49:64 (32%)	view
10	x 2	executors/docker/internal/wait helpers/process	mock_KillWaiter.go mock_KillWaiter.go	116:131 (15%) 63:78 (25%)	view
10	x 2	executors helpers/vault	mock_Client.go mock_Client.go	231:246 (7%) 225:240 (7%)	view
10	x 2	executors/docker/internal/networks executors/docker/internal/volumes	mock_Manager.go mock_Manager.go	184:199 (9%) 207:222 (8%)	view
10	x 2	apps/gitlab-runner-helper ROOT	main.go main.go	18:32 (40%) 42:56 (32%)	view
10	x 2	commands/helpers/archive/gziplegacy commands/helpers/archive/ziplegacy	gzip_legacy_archiver.go zip_legacy_archiver.go	18:34 (76%) 24:40 (66%)	view
10	x 2	helpers/ssh helpers/usage_log	mock_Option.go mock_Option.go	49:64 (32%) 49:64 (32%)	view
10	x 2	commands/helpers commands/helpers	artifacts_uploader.go cache_archiver.go	238:250 (6%) 231:243 (6%)	view
10	x 2	executors/docker/internal/pull executors/kubernetes/internal/pull	mock_Manager.go mock_Manager.go	81:96 (21%) 122:137 (14%)	view
10	x 2	executors/docker/internal/pull executors/docker/internal/volumes	mock_Manager.go mock_Manager.go	81:96 (21%) 207:222 (8%)	view

Duplicated Units

The list of top 33 duplicated units.

See data for all 33 unit duplicates...

Size	#	Folders	Files	Lines	Code
30	x 2	executors/virtualbox executors/parallels	virtualbox.go parallels.go	366:400 439:473	view
24	x 2	common executors	mock_WithContext.go mock_Environment.go	25:54 88:117	view
22	x 2	common helpers/docker	mock_urlHelper.go mock_Machine.go	76:103 236:263	view
22	x 2	helpers/retry helpers/retry	mock_RunValueFunc.go mock_valueRetryable.go	21:48 21:48	view
20	x 3	common common helpers/vault	mock_SecretResolver.go mock_urlHelper.go mock_Result.go	111:136 21:46 68:93	view
20	x 4	common commands/helpers executors/docker/internal/exec helpers/usage_log	mock_JobTrace.go mock_readSeekCloser.go mock_reader.go mock_dummyWriteCloser.go	417:442 66:91 21:46 66:91	view
17	x 2	shells executors/docker/internal/volumes/parser	mock_ShellWriter.go mock_Path.go	705:726 160:181	view
17	x 2	helpers/ssh helpers/process	stub_ssh_server_windows.go job_windows.go	39:60 85:106	view
15	x 3	executors/virtualbox executors/ssh executors/parallels	virtualbox.go ssh.go parallels.go	331:349 49:67 389:407	view
11	x 19	common common common executors/kubernetes log magefiles/build helpers/runner_wrapper/api helpers/runner_wrapper/api/server helpers/tls/ca_chain helpers/vault ...	mock_Shell.go mock_ExecutorProvider.go mock_SecretResolver.go mock_logStreamer.go mock_systemService.go mock_Component.go mock_ShutdownCallbackDef.go mock_wrapper.go mock_Builder.go mock_AuthMethod.go ...	281:296 205:220 66:81 74:89 127:142 21:36 68:83 24:39 71:86 67:82 ...	view
11	x 6	common common common common/buildlogger common magefiles/build	mock_Shell.go mock_ExecutorProvider.go mock_SecretResolver.go mock_Trace.go mock_JobTrace.go mock_Component.go	326:341 79:94 21:36 21:36 25:40 123:138	view
11	x 16	common commands/helpers executors/custom/command executors executors/kubernetes executors/docker/internal/exec log magefiles/build session/terminal helpers/retry ...	mock_JobTrace.go mock_readSeekCloser.go mock_Command.go mock_Client.go mock_podWatcher.go mock_conn.go mock_systemService.go mock_ResourceChecker.go mock_Conn.go mock_RunFunc.go ...	372:387 21:36 21:36 26:41 68:83 27:42 24:39 21:36 25:40 21:36 ...	view
11	x 2	scripts/update-feature-flags-docs magefiles/docutils	main.go block_line_replacer.go	133:148 22:37	view
11	x 4	commands/helpers/archive executors/docker/internal/networks executors/docker/internal/volumes referees	mock_Extractor.go mock_Manager.go mock_Manager.go mock_prometheusAPI.go	25:40 29:44 166:181 198:213	view
11	x 3	executors/docker/internal/wait executors/docker/internal/wait executors/docker/internal/wait	mock_Waiter.go mock_GracefulExitFunc.go mock_KillWaiter.go	25:40 25:40 74:89	view
11	x 3	helpers/retry helpers/retry helpers/retry	mock_CheckFunc.go mock_valueRetryable.go mock_retryable.go	21:36 78:93 66:81	view
11	x 2	helpers/vault helpers/vault	mock_SecretEngine.go mock_Client.go	21:36 67:82	view
10	x 10	common executors/kubernetes/internal/watchers executors/kubernetes/internal/pull executors/docker/internal/networks executors/docker/internal/volumes executors/docker/internal/pull log helpers helpers/process helpers/docker/auth	mock_logger.go mock_logger.go mock_pullLogger.go mock_debugLogger.go mock_debugLogger.go mock_pullLogger.go mock_systemLogger.go mock_RawLogger.go mock_Logger.go mock_DebugLogger.go	39:50 39:50 39:50 39:50 39:50 39:50 52:63 39:50 42:53 39:50	view
10	x 2	shells log	mock_ShellWriter.go mock_systemLogger.go	440:451 109:120	view
10	x 2	shells executors/docker/internal/volumes/parser	mock_ShellWriter.go mock_Path.go	740:751 195:206	view
9	x 2	scripts/update-feature-flags-docs magefiles/docutils	main.go block_line_replacer.go	181:191 70:80	view
9	x 2	helpers/ssh helpers/process	stub_ssh_server_windows.go job_windows.go	74:84 122:132	view
8	x 2	common executors/custom	config.go config.go	1473:1484 34:45	view
8	x 2	helpers/ssh helpers/process	stub_ssh_server_windows.go job_windows.go	62:72 110:120	view
7	x 2	common executors/kubernetes/internal/watchers	mock_logger.go mock_logger.go	106:116 64:74	view
7	x 2	common helpers/process	mock_Commander.go mock_Commander.go	58:68 163:173	view
7	x 3	executors helpers/vault helpers/docker	mock_Client.go mock_Client.go mock_Client.go	237:247 231:241 1610:1620	view
7	x 4	executors/kubernetes/internal/pull executors/docker/internal/networks executors/docker/internal/volumes executors/docker/internal/pull	mock_Manager.go mock_Manager.go mock_Manager.go mock_Manager.go	128:138 190:200 213:223 87:97	view
7	x 2	executors/kubernetes/internal/pull executors/docker/internal/pull	mock_pullLogger.go mock_pullLogger.go	106:116 190:200	view
7	x 2	executors/docker/internal/networks executors/docker/internal/volumes	mock_debugLogger.go mock_debugLogger.go	64:74 64:74	view
7	x 2	executors/docker/internal/wait helpers/process	mock_KillWaiter.go mock_KillWaiter.go	122:132 69:79	view
7	x 5	helpers/runner_wrapper/api/client helpers/ssh helpers/trace helpers/usage_log helpers/usage_log/logrotate	mock_Option.go mock_Option.go mock_Option.go mock_Option.go mock_Option.go	55:65 55:65 68:78 55:65 55:65	view
7	x 2	helpers/vault/secret_engines helpers/vault/auth_methods	mock_Factory.go mock_Factory.go	74:84 84:94	view