deepseek-ai / 3FS - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

7% duplication:

76,647 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
5,845 duplicated lines

1,935 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,935 duplicates...

Size	#	Folders	Files	Lines	Code
97	x 2	configs configs	mgmtd_main.toml storage_main.toml	85:194 (47%) 107:216 (21%)	view
83	x 2	configs configs	meta_main_launcher.toml storage_main_launcher.toml	1:93 (100%) 1:93 (100%)	view
76	x 2	configs configs	hf3fs_fuse_main_launcher.toml meta_main_launcher.toml	6:90 (89%) 4:88 (91%)	view
76	x 2	configs configs	hf3fs_fuse_main_launcher.toml storage_main_launcher.toml	6:90 (89%) 4:88 (91%)	view
70	x 2	configs configs	hf3fs_client_agent.toml meta_main.toml	128:206 (14%) 85:163 (12%)	view
58	x 2	configs configs	admin_cli.toml hf3fs_fuse_main.toml	8:72 (19%) 33:97 (14%)	view
58	x 2	configs configs	admin_cli.toml meta_main_launcher.toml	8:72 (19%) 4:68 (69%)	view
58	x 2	configs configs	hf3fs_fuse_main.toml meta_main_launcher.toml	33:97 (14%) 4:68 (69%)	view
58	x 2	configs configs	hf3fs_fuse_main.toml hf3fs_fuse_main_launcher.toml	33:97 (14%) 6:70 (68%)	view
58	x 2	configs configs	admin_cli.toml storage_main_launcher.toml	8:72 (19%) 4:68 (69%)	view
58	x 2	configs configs	admin_cli.toml hf3fs_fuse_main_launcher.toml	8:72 (19%) 6:70 (68%)	view
58	x 2	configs configs	hf3fs_fuse_main.toml storage_main_launcher.toml	33:97 (14%) 4:68 (69%)	view
54	x 2	configs configs	hf3fs_client_agent_launcher.toml hf3fs_fuse_main_launcher.toml	8:69 (69%) 11:72 (63%)	view
54	x 2	configs configs	hf3fs_client_agent_launcher.toml storage_main_launcher.toml	8:69 (69%) 9:70 (65%)	view
54	x 2	configs configs	hf3fs_client_agent_launcher.toml meta_main_launcher.toml	8:69 (69%) 9:70 (65%)	view
53	x 2	configs configs	admin_cli.toml hf3fs_client_agent_launcher.toml	13:72 (17%) 8:67 (67%)	view
53	x 2	configs configs	hf3fs_client_agent_launcher.toml hf3fs_fuse_main.toml	8:67 (67%) 38:97 (13%)	view
50	x 2	configs configs	meta_main.toml storage_main.toml	214:270 (8%) 148:204 (11%)	view
50	x 2	configs configs	meta_main.toml mgmtd_main.toml	214:270 (8%) 126:182 (24%)	view
48	x 2	configs configs	hf3fs_client_agent.toml storage_main.toml	256:310 (9%) 148:202 (10%)	view
48	x 2	configs configs	hf3fs_client_agent.toml mgmtd_main.toml	256:310 (9%) 126:180 (23%)	view
48	x 2	configs configs	hf3fs_client_agent.toml meta_main.toml	256:310 (9%) 214:268 (8%)	view
35	x 2	configs configs	meta_main.toml storage_main.toml	173:212 (6%) 107:146 (7%)	view
35	x 2	configs configs	meta_main.toml mgmtd_main.toml	173:212 (6%) 85:124 (16%)	view
34	x 2	configs configs	mgmtd_main.toml storage_main.toml	87:124 (16%) 167:204 (7%)	view
34	x 2	configs configs	meta_main.toml storage_main.toml	175:212 (6%) 167:204 (7%)	view
34	x 2	configs configs	mgmtd_main.toml mgmtd_main.toml	87:124 (16%) 145:182 (16%)	view
34	x 2	configs configs	meta_main.toml mgmtd_main.toml	175:212 (6%) 145:182 (16%)	view
34	x 2	configs configs	meta_main.toml storage_main.toml	233:270 (6%) 109:146 (7%)	view
34	x 2	configs configs	mgmtd_main.toml storage_main.toml	145:182 (16%) 109:146 (7%)	view
34	x 2	configs configs	meta_main.toml mgmtd_main.toml	233:270 (6%) 87:124 (16%)	view
34	x 2	configs configs	storage_main.toml storage_main.toml	109:146 (7%) 167:204 (7%)	view
34	x 2	configs configs	meta_main.toml meta_main.toml	175:212 (6%) 233:270 (6%)	view
33	x 2	configs configs	hf3fs_client_agent.toml meta_main.toml	216:253 (6%) 173:210 (5%)	view
33	x 2	configs configs	hf3fs_client_agent.toml hf3fs_client_agent.toml	218:254 (6%) 275:311 (6%)	view
33	x 2	configs configs	hf3fs_client_agent.toml storage_main.toml	216:253 (6%) 107:144 (7%)	view
33	x 2	configs configs	hf3fs_client_agent.toml mgmtd_main.toml	216:253 (6%) 85:122 (16%)	view
32	x 2	configs configs	hf3fs_client_agent.toml storage_main.toml	218:253 (6%) 167:202 (7%)	view
32	x 2	configs configs	hf3fs_client_agent.toml storage_main.toml	275:310 (6%) 109:144 (7%)	view
32	x 2	configs configs	hf3fs_client_agent.toml mgmtd_main.toml	218:253 (6%) 145:180 (15%)	view
32	x 2	configs configs	hf3fs_client_agent.toml meta_main.toml	275:310 (6%) 175:210 (5%)	view
32	x 2	configs configs	hf3fs_client_agent.toml mgmtd_main.toml	275:310 (6%) 87:122 (15%)	view
32	x 2	configs configs	hf3fs_client_agent.toml meta_main.toml	218:253 (6%) 233:268 (5%)	view
26	x 2	src/client/storage src/client/storage	StorageClientBlobImpl.h StorageClientInMem.h	29:60 (55%) 31:62 (41%)	view
26	x 2	src/client/storage src/client/storage	StorageClientBlobImpl.h StorageClientImpl.h	29:60 (55%) 30:61 (15%)	view
26	x 2	src/client/storage src/client/storage	StorageClientImpl.h StorageClientInMem.h	30:61 (15%) 31:62 (41%)	view
24	x 2	configs configs	meta_main.toml mgmtd_main.toml	146:171 (4%) 58:83 (11%)	view
24	x 2	configs configs	admin_cli.toml mgmtd_main_launcher.toml	74:98 (8%) 5:29 (60%)	view
24	x 2	src/mgmtd/ops src/mgmtd/ops	RotateAsPreferredOrderOperation.cc RotateLastSrvOperation.cc	45:72 (44%) 45:72 (44%)	view
21	x 2	configs configs	meta_main.toml monitor_collector_main.toml	146:168 (3%) 53:75 (16%)	view

Duplicated Units

The list of top 11 duplicated units.

See data for all 11 unit duplicates...

Size	#	Folders	Files	Lines	Code
14	x 2	src/common/utils src/common/utils	Nameof.hpp MagicEnum.hpp	685:702 595:612	view
12	x 2	src/common/utils src/common/utils	Nameof.hpp MagicEnum.hpp	507:524 373:390	view
9	x 2	src/common/utils src/common/utils	Nameof.hpp MagicEnum.hpp	527:539 393:405	view
9	x 2	src/common/utils src/common/utils	Nameof.hpp MagicEnum.hpp	609:621 519:531	view
9	x 2	src/simple_example/service src/migration/service	Server.cc Server.cc	56:66 70:80	view
9	x 6	src/mgmtd/background src/mgmtd/background src/mgmtd/background src/mgmtd/background src/mgmtd/background src/mgmtd/background	MgmtdClientSessionsChecker.cc MgmtdTargetInfoPersister.cc MgmtdNewBornChainsChecker.cc MgmtdHeartbeatChecker.cc MgmtdRoutingInfoVersionUpdater.cc MgmtdMetricsUpdater.cc	42:53 70:81 58:69 85:96 32:43 266:277	view
8	x 5	src/storage/worker src/storage/worker src/storage/worker src/storage/worker src/storage/worker	PunchHoleWorker.cc SyncMetaKvWorker.cc CheckWorker.cc DumpWorker.cc AllocateWorker.cc	26:35 27:36 87:96 36:45 25:34	view
7	x 2	src/common/utils src/common/utils	Nameof.hpp MagicEnum.hpp	673:682 583:592	view
7	x 2	src/kv src/kv	RocksDBStore.cc LevelDBStore.cc	210:218 184:192	view
6	x 2	src/client/cli/admin src/client/cli/admin	RemoveRange.cc CreateRange.cc	11:18 12:19	view
6	x 2	src/kv src/kv	RocksDBStore.cc LevelDBStore.cc	133:140 135:142	view