apache / buildstream - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

12% duplication:

29,732 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
3,762 duplicated lines

2,155 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
src (1%) --> ROOT (22%)	628	3 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 2,155 duplicates...

Size	#	Folders	Files	Lines	Code
87	x 2	src/buildstream ROOT	_version.py versioneer.py	435:594 (21%) 1525:1684 (8%)	view
34	x 2	src/buildstream ROOT	_version.py versioneer.py	160:207 (8%) 1142:1189 (3%)	view
33	x 2	src/buildstream/_testing/_sourcetests src/buildstream/_testing/_sourcetests	mirror.py mirror.py	54:90 (15%) 195:232 (15%)	view
29	x 2	src/buildstream/_protos/...d/bazel/remote/asset/v1 src/buildstream/_protos/...d/bazel/remote/asset/v1	proto remote_asset.proto remote_asset.proto	179:211 (6%) 274:306 (6%)	view
23	x 2	src/buildstream/_frontend src/buildstream/_frontend	cli.py cli.py	451:473 (2%) 684:706 (2%)	view
22	x 2	src/buildstream ROOT	_version.py versioneer.py	298:335 (5%) 1276:1313 (2%)	view
22	x 2	src/buildstream/_protos/...d/bazel/remote/asset/v1 src/buildstream/_protos/...d/bazel/remote/asset/v1	proto remote_asset.proto remote_asset.proto	214:239 (4%) 309:334 (4%)	view
20	x 2	src/buildstream ROOT	_version.py versioneer.py	104:123 (4%) 452:471 (1%)	view
20	x 2	src/buildstream ROOT	_version.py versioneer.py	603:623 (4%) 1691:1711 (1%)	view
18	x 2	src/buildstream/data src/buildstream/data	in build-all.sh.in build-module.sh.in	1:18 (42%) 1:18 (42%)	view
17	x 2	src/buildstream ROOT	_version.py versioneer.py	406:433 (4%) 1495:1522 (1%)	view
17	x 2	ROOT ROOT	versioneer.py versioneer.py	1064:1080 (1%) 1694:1710 (1%)	view
17	x 2	src/buildstream/_protos/build/buildgrid src/buildstream/_protos/build/buildgrid	proto local_cas.proto local_cas.proto	317:337 (3%) 390:410 (3%)	view
17	x 2	src/buildstream ROOT	_version.py versioneer.py	606:622 (4%) 1064:1080 (1%)	view
16	x 2	src/buildstream/_testing/_sourcetests src/buildstream/_testing/_sourcetests	mirror.py mirror.py	214:230 (7%) 269:285 (7%)	view
16	x 2	src/buildstream/_testing/_sourcetests src/buildstream/_testing/_sourcetests	mirror.py mirror.py	72:88 (7%) 269:285 (7%)	view
15	x 2	src/buildstream/_protos/google/rpc src/buildstream/_protos/google/rpc	proto code.proto status.proto	1:17 (9%) 1:17 (17%)	view
15	x 2	doc/source/sessions-stored doc/source/sessions-stored	strict-mode-run-dynamic-no-strict.html strict-mode-run-static-no-strict.html	7:25 (88%) 7:25 (88%)	view
15	x 2	src/buildstream/_testing/_sourcetests src/buildstream/_testing/_sourcetests	mirror.py mirror.py	113:128 (7%) 265:280 (7%)	view
15	x 2	src/buildstream/_frontend src/buildstream/_frontend	cli.py cli.py	798:812 (1%) 871:885 (1%)	view
14	x 2	doc/source/sessions-stored doc/source/sessions-stored	filtering-shell-with-filter.html strict-mode-run-static-no-strict.html	7:23 (82%) 7:23 (82%)	view
14	x 2	src/buildstream/_protos/...zel/remote/execution/v2 src/buildstream/_protos/build/bazel/semver	proto remote_execution.proto semver.proto	1:15 (<1%) 1:15 (66%)	view
14	x 2	doc/source/sessions-stored doc/source/sessions-stored	filtering-shell-with-filter.html strict-mode-run-dynamic-no-strict.html	7:23 (82%) 7:23 (82%)	view
14	x 2	src/buildstream/_protos/google/api src/buildstream/_protos/google/api	proto annotations.proto http.proto	2:17 (53%) 2:17 (4%)	view
14	x 2	src/buildstream/_protos/...d/bazel/remote/asset/v1 src/buildstream/_protos/...d/bazel/remote/asset/v1	pyi remote_asset_pb2.pyi remote_asset_pb2.pyi	22:35 (12%) 54:67 (12%)	view
14	x 2	doc/source/sessions-stored doc/source/sessions-stored	filtering-shell-with-filter.html filtering-shell-without-filter.html	7:23 (82%) 7:23 (82%)	view
14	x 2	doc/source/sessions-stored doc/source/sessions-stored	filtering-shell-without-filter.html strict-mode-run-static-no-strict.html	7:23 (82%) 7:23 (82%)	view
14	x 2	src/buildstream/_protos/google/bytestream src/buildstream/_protos/google/longrunning	proto bytestream.proto operations.proto	1:15 (8%) 1:15 (10%)	view
14	x 2	doc/source/sessions-stored doc/source/sessions-stored	filtering-shell-without-filter.html strict-mode-run-dynamic-no-strict.html	7:23 (82%) 7:23 (82%)	view
13	x 2	src/buildstream/_protos/google/longrunning src/buildstream/_protos/google/rpc	proto operations.proto status.proto	2:15 (9%) 2:15 (15%)	view
13	x 2	src/buildstream/_protos/...d/bazel/remote/asset/v1 src/buildstream/_protos/google/bytestream	proto remote_asset.proto bytestream.proto	2:15 (2%) 2:15 (8%)	view
13	x 2	src/buildstream/_protos/build/buildgrid src/buildstream/_protos/google/api	proto local_cas.proto http.proto	2:15 (2%) 2:15 (4%)	view
13	x 2	src/buildstream/_protos/google/longrunning src/buildstream/_protos/google/rpc	proto operations.proto code.proto	2:15 (9%) 2:15 (7%)	view
13	x 2	src/buildstream/_protos/...zel/remote/execution/v2 src/buildstream/_protos/google/api	proto remote_execution.proto http.proto	2:15 (<1%) 2:15 (4%)	view
13	x 2	src/buildstream/_protos/...d/bazel/remote/asset/v1 src/buildstream/_protos/google/api	proto remote_asset.proto http.proto	2:15 (2%) 2:15 (4%)	view
13	x 2	src/buildstream/_protos/buildstream/v2 src/buildstream/_protos/google/bytestream	proto source.proto bytestream.proto	1:14 (52%) 2:15 (8%)	view
13	x 2	src/buildstream/_protos/buildstream/v2 src/buildstream/_protos/google/api	proto source.proto http.proto	1:14 (52%) 2:15 (4%)	view
13	x 2	doc/source/sessions-stored doc/source/sessions-stored	developing-shell-after-changes.html running-commands-shell.html	7:21 (81%) 7:21 (86%)	view
13	x 2	src/buildstream/_protos/google/api src/buildstream/_protos/google/bytestream	proto annotations.proto bytestream.proto	2:15 (50%) 2:15 (8%)	view
13	x 2	src/buildstream/_protos/build/bazel/semver src/buildstream/_protos/build/buildgrid	proto semver.proto local_cas.proto	2:15 (61%) 2:15 (2%)	view
13	x 2	src/buildstream/_protos/build/bazel/semver src/buildstream/_protos/google/rpc	proto semver.proto status.proto	2:15 (61%) 2:15 (15%)	view
13	x 2	src/buildstream/_protos/google/api src/buildstream/_protos/google/rpc	proto annotations.proto status.proto	2:15 (50%) 2:15 (15%)	view
13	x 2	src/buildstream/_protos/...d/bazel/remote/asset/v1 src/buildstream/_protos/...zel/remote/execution/v2	proto remote_asset.proto remote_execution.proto	2:15 (2%) 2:15 (<1%)	view
13	x 2	doc/source/sessions-stored doc/source/sessions-stored	filtering-shell-with-filter.html integration-commands-shell.html	7:21 (76%) 7:21 (76%)	view
13	x 2	src/buildstream/_protos/...zel/remote/execution/v2 src/buildstream/_protos/buildstream/v2	proto remote_execution.proto source.proto	2:15 (<1%) 1:14 (52%)	view
13	x 2	src/buildstream/_protos/...d/bazel/remote/asset/v1 src/buildstream/_protos/google/rpc	proto remote_asset.proto status.proto	2:15 (2%) 2:15 (15%)	view
13	x 2	src/buildstream/_protos/...d/bazel/remote/asset/v1 src/buildstream/_protos/google/rpc	proto remote_asset.proto code.proto	2:15 (2%) 2:15 (7%)	view
13	x 2	src/buildstream/_protos/build/buildgrid src/buildstream/_protos/google/rpc	proto local_cas.proto code.proto	2:15 (2%) 2:15 (7%)	view
13	x 2	src/buildstream/_protos/build/bazel/semver src/buildstream/_protos/google/longrunning	proto semver.proto operations.proto	2:15 (61%) 2:15 (9%)	view
13	x 2	src/buildstream/_protos/...zel/remote/execution/v2 src/buildstream/_protos/google/bytestream	proto remote_execution.proto bytestream.proto	2:15 (<1%) 2:15 (8%)	view