GoogleCloudPlatform / gcsfuse

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

6% duplication:

18,477 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,217 duplicated lines

111 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
perfmetrics (1%) --> tools (1%)	103	6 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 111 duplicates...

Size	#	Folders	Files	Lines	Code
53	x 2	internal/storage/mock internal/storage	testify_mock_bucket.go testify_mock_bucket.go	65:149 (67%) 65:149 (67%)	view
24	x 2	internal/storage/mock internal/storage	testify_mock_bucket.go testify_mock_bucket.go	25:63 (30%) 25:63 (30%)	view
17	x 2	perfmetrics/scripts perfmetrics/scripts/ls_metrics	fetch_and_upload_metrics.py listing_benchmark.py	64:81 (17%) 433:449 (5%)	view
17	x 2	internal/gcsx/client_readers internal/gcsx	range_reader.go random_reader.go	227:249 (11%) 454:476 (5%)	view
16	x 2	internal/fs internal/fs	fs.go fs.go	725:742 (1%) 768:785 (1%)	view
16	x 2	perfmetrics/scripts perfmetrics/scripts/ls_metrics	fetch_and_upload_metrics.py listing_benchmark.py	50:66 (16%) 412:427 (4%)	view
13	x 2	perfmetrics/scripts/ls_metrics tools/config-gen/templates	proto directory.proto config.tpl	1:13 (56%) 1:13 (23%)	view
13	x 2	perfmetrics/scripts/bigquery tools/cd_scripts	in requirements.in requirements.in	1:13 (81%) 1:13 (92%)	view
13	x 2	perfmetrics/scripts/bigquery perfmetrics/scripts/load_tests/python	in requirements.in requirements.in	1:13 (81%) 1:13 (92%)	view
13	x 2	perfmetrics/scripts/ls_metrics tools/cd_scripts	in requirements.in requirements.in	1:13 (68%) 1:13 (92%)	view
13	x 2	perfmetrics/scripts/load_tests/python perfmetrics/scripts	in requirements.in requirements.in	1:13 (92%) 1:13 (43%)	view
13	x 2	perfmetrics/scripts/load_tests/python perfmetrics/scripts/ls_metrics	in requirements.in requirements.in	1:13 (92%) 1:13 (68%)	view
13	x 2	internal/fs internal/fs	fs.go fs.go	1642:1666 (<1%) 1891:1915 (<1%)	view
13	x 2	internal/gcsx/client_readers internal/gcsx	range_reader.go random_reader.go	201:218 (8%) 424:441 (4%)	view
13	x 2	perfmetrics/scripts tools/cd_scripts	in requirements.in requirements.in	1:13 (43%) 1:13 (92%)	view
13	x 2	perfmetrics/scripts/bigquery perfmetrics/scripts/ls_metrics	in requirements.in requirements.in	1:13 (81%) 1:13 (68%)	view
13	x 2	perfmetrics/scripts/load_tests/python tools/cd_scripts	in requirements.in requirements.in	1:13 (92%) 1:13 (92%)	view
13	x 2	perfmetrics/scripts/ls_metrics perfmetrics/scripts	in requirements.in requirements.in	1:13 (68%) 1:13 (43%)	view
13	x 2	perfmetrics/scripts/hns_rename_folders_metrics perfmetrics/scripts/ls_metrics	in requirements.in requirements.in	2:14 (68%) 2:14 (68%)	view
13	x 2	perfmetrics/scripts/bigquery perfmetrics/scripts	in requirements.in requirements.in	1:13 (81%) 1:13 (43%)	view
12	x 2	perfmetrics/scripts/hns_rename_folders_metrics perfmetrics/scripts	in requirements.in requirements.in	2:13 (63%) 2:13 (40%)	view
12	x 2	perfmetrics/scripts/bigquery perfmetrics/scripts/hns_rename_folders_metrics	in requirements.in requirements.in	2:13 (75%) 2:13 (63%)	view
12	x 2	internal/fs internal/fs	fs.go fs.go	263:276 (<1%) 725:738 (<1%)	view
12	x 2	internal/fs internal/fs	fs.go fs.go	263:276 (<1%) 768:781 (<1%)	view
12	x 2	perfmetrics/scripts/hns_rename_folders_metrics perfmetrics/scripts/load_tests/python	in requirements.in requirements.in	2:13 (63%) 2:13 (85%)	view
12	x 2	perfmetrics/scripts/hns_rename_folders_metrics tools/cd_scripts	in requirements.in requirements.in	2:13 (63%) 2:13 (85%)	view
11	x 2	tools/build_gcsfuse tools/util	main.go build_gcsfuse.go	78:92 (10%) 110:124 (14%)	view
10	x 2	internal/storage/storageutil tools/integration_tests/util/client	control_client.go control_client.go	31:40 (32%) 38:47 (17%)	view
10	x 2	internal/storage internal/storage	mock_bucket.go mock_bucket.go	475:491 (3%) 502:518 (3%)	view
10	x 2	internal/perf internal/perf	cpu.go memory.go	31:43 (33%) 41:53 (29%)	view
10	x 2	benchmarks/write_locally benchmarks/write_to_gcs	main.go main.go	123:136 (15%) 123:137 (16%)	view
10	x 2	internal/fs internal/fs	fs.go fs.go	261:272 (<1%) 287:298 (<1%)	view
9	x 2	benchmarks/read_full_file benchmarks/write_locally	main.go main.go	159:171 (10%) 125:136 (13%)	view
9	x 2	benchmarks/read_full_file benchmarks/stat_files	main.go main.go	159:171 (10%) 167:178 (10%)	view
9	x 2	perfmetrics/scripts/hns_rename_folders_metrics perfmetrics/scripts/ls_metrics	renaming_benchmark.py listing_benchmark.py	378:386 (3%) 412:420 (2%)	view
9	x 2	benchmarks/stat_files benchmarks/write_locally	main.go main.go	167:178 (10%) 125:136 (13%)	view
9	x 2	internal/fs internal/fs	fs.go fs.go	1651:1666 (<1%) 1687:1702 (<1%)	view
9	x 2	internal/fs/inode internal/fs/inode	dir.go explicit_dir.go	257:265 (1%) 39:47 (20%)	view
9	x 2	internal/fs internal/fs	fs.go fs.go	1515:1528 (<1%) 1543:1556 (<1%)	view
9	x 2	cfg cfg	params.yaml params.yaml	528:536 (1%) 543:551 (1%)	view
9	x 2	benchmarks/read_full_file benchmarks/write_to_gcs	main.go main.go	159:171 (10%) 126:137 (14%)	view
9	x 2	perfmetrics/scripts/load_tests/python/tasks perfmetrics/scripts/load_tests/python/tasks	python_os.py tf_gfile.py	47:64 (24%) 50:67 (25%)	view
9	x 2	internal/fs internal/fs	fs.go fs.go	2631:2644 (<1%) 2693:2706 (<1%)	view
9	x 2	internal/storage/storageutil internal/storage/storageutil	object_attrs.go object_attrs.go	203:213 (5%) 233:243 (5%)	view
9	x 2	internal/fs internal/fs	fs.go fs.go	1687:1702 (<1%) 1900:1915 (<1%)	view
9	x 2	internal/fs internal/fs	fs.go fs.go	1479:1493 (<1%) 1934:1948 (<1%)	view
9	x 2	benchmarks/stat_files benchmarks/write_to_gcs	main.go main.go	167:178 (10%) 126:137 (14%)	view
9	x 2	perfmetrics/scripts perfmetrics/scripts/hns_rename_folders_metrics	fetch_and_upload_metrics.py renaming_benchmark.py	50:59 (9%) 378:386 (3%)	view
8	x 2	benchmarks/read_full_file benchmarks/read_within_file	main.go main.go	161:171 (9%) 186:196 (7%)	view
8	x 2	benchmarks/read_within_file benchmarks/stat_files	main.go main.go	186:196 (7%) 168:178 (9%)	view

Duplicated Units

The list of top 6 duplicated units.

See data for all 6 unit duplicates...

Size	#	Folders	Files	Lines	Code
16	x 2	tools/package_gcsfuse tools/package_gcsfuse	tools_linux.go tools_darwin.go	22:43 22:43	view
9	x 2	internal/gcsx/client_readers internal/gcsx	range_reader.go random_reader.go	77:92 177:192	view
7	x 2	tools/package_gcsfuse tools/prefetch_cache_gcsfuse	main.go main.go	94:103 62:71	view
7	x 5	benchmarks/write_locally benchmarks/read_full_file benchmarks/write_to_gcs benchmarks/read_within_file benchmarks/stat_files	main.go main.go main.go main.go main.go	129:138 164:173 130:139 189:198 171:180	view
7	x 2	internal/locker internal/locker	locker.go rw_locker.go	86:96 91:101	view
6	x 2	internal/storage/mock internal/storage	testify_mock_bucket.go testify_mock_bucket.go	143:150 143:150	view