azure / azure-storage-azcopy

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

7% duplication:

41,357 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
3,246 duplicated lines

232 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
cmd (<1%) --> e2etest (<1%)	130	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 232 duplicates...

Size	#	Folders	Files	Lines	Code
42	x 2	ste ste	downloader-blobFS_linux.go downloader-blob_linux.go	103:173 (40%) 102:172 (40%)	view
40	x 2	cmd e2etest	zc_attr_filter_windows.go newe2e_task_runazcopy_parameters.go	77:122 (54%) 475:520 (12%)	view
37	x 2	ste ste	downloader-blobFS_linux.go downloader-blob_linux.go	37:98 (35%) 36:97 (35%)	view
25	x 2	testSuite/cmd testSuite/cmd	testblob.go testblob.go	333:374 (5%) 653:695 (5%)	view
21	x 2	common common	credCache_linux.go credCache_windows.go	67:111 (22%) 53:97 (14%)	view
21	x 2	common common	credCache_darwin.go credCache_linux.go	66:110 (19%) 67:111 (22%)	view
21	x 2	common common	credCache_darwin.go credCache_windows.go	66:110 (19%) 53:97 (14%)	view
20	x 2	common common	credCacheInternal_linux.go credCacheInternal_windows.go	50:78 (41%) 50:78 (29%)	view
19	x 2	testSuite/scripts testSuite/scripts	utility.py utility.py	211:240 (3%) 312:341 (3%)	view
19	x 2	cmd cmd	gcpNameResolver.go s3NameResolver.go	95:117 (23%) 123:149 (23%)	view
18	x 2	common common	mmf_darwin.go mmf_linux.go	59:90 (64%) 61:92 (60%)	view
18	x 2	ste ste	xfer-remoteToLocal-file.go xfer-remoteToLocal-symlink.go	72:102 (6%) 13:43 (37%)	view
17	x 2	testSuite/cmd testSuite/cmd	testblob.go testblob.go	389:417 (3%) 709:738 (3%)	view
17	x 2	cmd cmd	zc_enumerator.go zc_enumerator.go	451:473 (3%) 548:570 (3%)	view
17	x 2	e2etest ste	newe2e_resource_managers_local_window... sourceInfoProvider-Local_windows.go	36:57 (15%) 62:93 (28%)	view
17	x 2	cmd cmd	removeEnumerator.go setPropertiesEnumerator.go	94:114 (9%) 75:96 (30%)	view
17	x 2	jobsAdmin jobsAdmin	init.go init.go	449:482 (4%) 594:627 (4%)	view
16	x 2	ste ste	xfer-setProperties.go xfer-setProperties.go	81:108 (12%) 144:171 (12%)	view
16	x 2	e2etest e2etest	scenario_os_helpers.go scenario_os_helpers_for_linux.go	35:65 (69%) 35:70 (44%)	view
15	x 2	cmd cmd	copy.go jobsResume.go	1752:1774 (1%) 99:122 (5%)	view
15	x 2	testSuite/scripts testSuite/scripts	utility.py utility.py	377:393 (3%) 468:484 (3%)	view
15	x 2	cmd cmd	removeEnumerator.go setPropertiesEnumerator.go	118:143 (8%) 101:124 (26%)	view
15	x 2	ste ste	sourceInfoProvider-GCP.go sourceInfoProvider-S3.go	101:119 (12%) 118:139 (13%)	view
14	x 2	ROOT ROOT	build-1es-pipeline.yaml build-1es-pipeline.yaml	580:593 (1%) 610:623 (1%)	view
14	x 2	cmd cmd	copy.go jobsResume.go	1837:1850 (1%) 178:191 (5%)	view
14	x 2	cmd cmd	copy.go jobsResume.go	1821:1835 (1%) 162:176 (5%)	view
13	x 2	ste ste	downloader-blob.go downloader-blobFS.go	108:123 (13%) 54:69 (22%)	view
13	x 2	common common	mmf_darwin.go mmf_windows.go	69:90 (46%) 92:113 (22%)	view
13	x 2	common common	mmf_linux.go mmf_windows.go	71:92 (43%) 92:113 (22%)	view
13	x 2	ste ste	downloader-blobFS_linux.go downloader-blob_linux.go	177:198 (12%) 176:196 (12%)	view
13	x 2	ROOT ROOT	build-1es-pipeline.yaml build-1es-pipeline.yaml	700:716 (1%) 738:754 (1%)	view
12	x 2	common common	logger.go logger.go	151:169 (9%) 203:221 (9%)	view
12	x 2	common common	logger.go logger.go	151:169 (9%) 177:195 (9%)	view
12	x 2	ste ste	mgr-JobMgr.go mgr-JobMgr.go	459:473 (1%) 506:520 (1%)	view
12	x 2	ROOT ROOT	build-1es-pipeline.yaml build-1es-pipeline.yaml	129:141 (1%) 163:175 (1%)	view
12	x 2	cmd cmd	jobsResume.go sync.go	63:80 (4%) 503:520 (2%)	view
12	x 2	ROOT ROOT	build-1es-pipeline.yaml build-1es-pipeline.yaml	903:915 (1%) 964:976 (1%)	view
12	x 2	common common	logger.go logger.go	177:195 (9%) 203:221 (9%)	view
12	x 2	cmd cmd	copy.go sync.go	1694:1710 (<1%) 528:544 (2%)	view
11	x 2	cmd cmd	jobsResume.go jobsShow.go	166:176 (4%) 151:161 (10%)	view
11	x 2	testSuite/cmd testSuite/cmd	testblob.go testblob.go	165:175 (2%) 303:313 (2%)	view
11	x 2	cmd e2etest	list.go newe2e_object_content.go	451:463 (3%) 41:53 (16%)	view
11	x 2	ROOT ROOT	build-1es-pipeline.yaml build-1es-pipeline.yaml	75:87 (1%) 1199:1211 (1%)	view
11	x 2	cmd cmd	jobsResume.go jobsShow.go	181:191 (4%) 166:176 (10%)	view
11	x 2	testSuite/cmd testSuite/cmd	testblob.go testblob.go	303:313 (2%) 623:633 (2%)	view
11	x 2	testSuite/cmd testSuite/cmd	testblob.go testblob.go	165:175 (2%) 623:633 (2%)	view
11	x 2	testSuite/cmd testSuite/cmd	testblob.go testblob.go	467:477 (2%) 623:633 (2%)	view
11	x 2	e2etest e2etest	newe2e_resource_managers_blob.go newe2e_resource_managers_blob.go	549:562 (2%) 599:612 (2%)	view
11	x 2	testSuite/cmd testSuite/cmd	testblob.go testblob.go	303:313 (2%) 467:477 (2%)	view
11	x 2	testSuite/cmd testSuite/cmd	testblob.go testblob.go	165:175 (2%) 467:477 (2%)	view

Duplicated Units

The list of top 10 duplicated units.

See data for all 10 unit duplicates...

Size	#	Folders	Files	Lines	Code
55	x 2	ste ste	downloader-blob_linux.go downloader-blobFS_linux.go	100:173 101:174	view
18	x 2	cmd cmd	copy.go sync.go	1690:1713 524:547	view
17	x 2	ste ste	downloader-blob_linux.go downloader-blobFS_linux.go	175:197 176:199	view
14	x 2	cmd cmd	jobsResume.go sync.go	60:82 500:522	view
13	x 2	common common	hash_data_adapter_ads_windows.go hash_data_adapter_hidden_files.go	92:110 43:61	view
8	x 2	ste ste	downloader-blobFS.go downloader-blob.go	116:128 49:61	view
8	x 2	ste ste	downloader-azureFiles_linux.go downloader-azureFiles_windows.go	223:232 251:260	view
6	x 3	e2etest e2etest e2etest	newe2e_arm_storage_account.go newe2e_arm_resource_group.go newe2e_arm_managed_disk.go	81:89 33:41 20:28	view
6	x 3	common common common	mmf_windows.go mmf_darwin.go mmf_linux.go	97:104 74:81 76:83	view
6	x 2	common common	mmf_darwin.go mmf_linux.go	65:72 67:74	view