Duplication · openai/fence

Duplication Overall

5% duplication:

21,519 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,272 duplicated lines

131 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

flowchart TB
    n0["script"]
    n1["src"]
    n0 ---|"86"| n1
    classDef default fill:#00b2ee,stroke:#ffffff,color:#000000;
    classDef highlighted fill:#00b2ee,stroke:#ffffff,color:#000000;
    linkStyle 0 stroke:#DC143CFF,stroke-width:10px

Download: Mermaid (.mmd) (open online Mermaid editor)

2D force graph | 3D force graph

Show more details on duplication between components...

From Component --> To Component	Duplicated Lines	File Pairs	Details
script (<1%) --> src (<1%)	86	1 file pair	details...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 131 duplicates...

Size	#	Folders	Files	Lines	Code
16	x 2	src src	runtime.rs runtime.rs	572:587 (2%) 608:623 (2%)	view
12	x 2	src src	hostname_policy.rs hostname_policy.rs	206:217 (3%) 321:332 (3%)	view
12	x 2	script/lib src	host_observation.py local_control.rs	41:52 (<1%) 2088:2099 (<1%)	view
12	x 2	script/lib src	host_observation.py local_control.rs	55:66 (<1%) 2102:2113 (<1%)	view
11	x 2	src src	hostname_policy.rs hostname_policy.rs	179:189 (3%) 263:273 (3%)	view
11	x 2	src src	lockdown.rs lockdown.rs	2592:2602 (<1%) 2628:2640 (<1%)	view
11	x 2	src src	lockdown.rs lockdown.rs	2687:2698 (<1%) 2717:2727 (<1%)	view
11	x 2	src src	nft_backend.rs nft_backend.rs	759:769 (<1%) 800:810 (<1%)	view
10	x 2	script/lib script/lib	host_observation.py host_observation.py	44:53 (<1%) 58:67 (<1%)	view
10	x 2	src src	runtime.rs runtime.rs	88:105 (1%) 192:209 (1%)	view
10	x 2	src src	local_control.rs local_control.rs	579:588 (<1%) 595:604 (<1%)	view
10	x 2	src src	local_control.rs local_control.rs	2091:2100 (<1%) 2105:2114 (<1%)	view
10	x 2	src src	cli.rs cli.rs	306:316 (3%) 335:345 (3%)	view
10	x 2	script/lib src	host_observation.py local_control.rs	247:256 (<1%) 58:67 (<1%)	view
9	x 2	src src	lockdown.rs lockdown.rs	753:762 (<1%) 1759:1768 (<1%)	view
9	x 2	src src	lockdown.rs lockdown.rs	3068:3076 (<1%) 3086:3094 (<1%)	view
9	x 2	script/lib script/lib	host_observation.py host_observation.py	2983:2991 (<1%) 3412:3420 (<1%)	view
9	x 2	src src	attribution.rs attribution.rs	435:445 (<1%) 458:468 (<1%)	view
9	x 2	script/lib src	host_observation.py local_control.rs	44:52 (<1%) 2105:2113 (<1%)	view
9	x 2	script/lib src	host_observation.py local_control.rs	58:66 (<1%) 2091:2099 (<1%)	view
9	x 2	script/lib src	host_observation.py local_control.rs	234:242 (<1%) 44:52 (<1%)	view
9	x 2	src src	hostname_policy.rs platform_profile.rs	201:209 (2%) 239:247 (2%)	view
8	x 2	src src	hostname_policy.rs hostname_policy.rs	194:201 (2%) 313:320 (2%)	view
8	x 2	src src	nft_backend.rs nft_backend.rs	363:370 (<1%) 427:434 (<1%)	view
8	x 2	script/lib script/lib	host_observation.py host_observation.py	1161:1168 (<1%) 1175:1182 (<1%)	view
8	x 2	script/lib script/lib	host_observation.py host_observation.py	1556:1563 (<1%) 1769:1776 (<1%)	view
8	x 2	script/lib script/lib	host_observation.py host_observation.py	2479:2486 (<1%) 3332:3339 (<1%)	view
8	x 2	script/lib script/lib	host_observation.py host_observation.py	2911:2918 (<1%) 2941:2948 (<1%)	view
8	x 2	script/lib script/lib	host_observation.py host_observation.py	3249:3257 (<1%) 3288:3296 (<1%)	view
8	x 2	script/lib script/lib	host_observation.py host_observation.py	3249:3257 (<1%) 3319:3327 (<1%)	view
8	x 2	script/lib script/lib	host_observation.py host_observation.py	3288:3296 (<1%) 3319:3327 (<1%)	view
8	x 2	script/lib script/lib	host_observation.py host_observation.py	3361:3368 (<1%) 3398:3405 (<1%)	view
8	x 2	src src	runtime.rs runtime.rs	455:462 (1%) 607:614 (1%)	view
8	x 2	src src	runtime.rs runtime.rs	492:499 (1%) 589:596 (1%)	view
8	x 2	src src	local_control.rs local_control.rs	1439:1446 (<1%) 1550:1557 (<1%)	view
8	x 2	src src	local_control.rs local_control.rs	1474:1481 (<1%) 1502:1509 (<1%)	view
8	x 2	src src	local_control.rs local_control.rs	2652:2660 (<1%) 2692:2700 (<1%)	view
8	x 2	script/lib script/lib	action_bundle_host.py action_bundle_host.py	1080:1087 (<1%) 1323:1330 (<1%)	view
8	x 2	script/lib script/lib	protected_finalization.py protected_finalization.py	807:814 (1%) 829:836 (1%)	view
8	x 2	src src	platform_profile.rs platform_profile.rs	46:53 (2%) 240:247 (2%)	view
8	x 2	src src	nflog.rs nflog.rs	68:75 (2%) 77:84 (2%)	view
8	x 2	src src	hostname_policy.rs platform_profile.rs	202:209 (2%) 46:53 (2%)	view
8	x 2	src src	hostname_policy.rs platform_profile.rs	210:217 (2%) 253:260 (2%)	view
8	x 2	src src	hostname_policy.rs platform_profile.rs	325:332 (2%) 253:260 (2%)	view
7	x 2	src src	lockdown.rs lockdown.rs	2478:2484 (<1%) 2607:2613 (<1%)	view
7	x 2	src src	lockdown.rs lockdown.rs	2668:2674 (<1%) 2700:2706 (<1%)	view
7	x 2	src src	nft_backend.rs nft_backend.rs	1739:1745 (<1%) 1747:1753 (<1%)	view
7	x 2	src src	nft_backend.rs nft_backend.rs	1739:1745 (<1%) 1755:1761 (<1%)	view
7	x 2	src src	nft_backend.rs nft_backend.rs	1739:1745 (<1%) 1763:1769 (<1%)	view
7	x 2	src src	nft_backend.rs nft_backend.rs	1747:1753 (<1%) 1755:1761 (<1%)	view

Most Frequent Duplicates

The list of 29 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 6	script/lib script/lib script/lib script/lib script/lib script/lib	release-tools.bash test-tools.bash rust-dist.bash update-tools.bash release-tools.bash test-tools.bash	5:10 (4%) 5:10 (6%) 35:40 (1%) 5:10 (3%) 43:48 (4%) 44:49 (6%)	view
6	x 5	src src src src src	hosted_runner.rs hosted_runner.rs hosted_runner.rs hosted_runner.rs hosted_runner.rs	478:483 (<1%) 485:490 (<1%) 513:518 (<1%) 520:525 (<1%) 527:532 (<1%)	view
6	x 5	script/lib script/lib script/lib script/lib script/lib	release-tools.bash test-tools.bash rust-dist.bash release-tools.bash test-tools.bash	4:9 (4%) 4:9 (6%) 34:39 (1%) 42:47 (4%) 43:48 (6%)	view
6	x 4	src src src src	nft_backend.rs nft_backend.rs nft_backend.rs nft_backend.rs	1740:1745 (<1%) 1748:1753 (<1%) 1756:1761 (<1%) 1764:1769 (<1%)	view
6	x 4	script/lib script/lib script/lib script/lib	host_observation.py host_observation.py host_observation.py host_observation.py	2902:2907 (<1%) 2926:2931 (<1%) 2983:2988 (<1%) 3412:3417 (<1%)	view
6	x 4	src src src src	nft_backend.rs nft_backend.rs nft_backend.rs nft_backend.rs	1739:1744 (<1%) 1747:1752 (<1%) 1755:1760 (<1%) 1763:1768 (<1%)	view
6	x 4	script/lib src script/lib src	host_observation.py local_control.rs host_observation.py local_control.rs	46:51 (<1%) 2093:2098 (<1%) 60:65 (<1%) 2107:2112 (<1%)	view
6	x 4	script/lib src script/lib src	host_observation.py local_control.rs host_observation.py local_control.rs	47:52 (<1%) 2094:2099 (<1%) 61:66 (<1%) 2108:2113 (<1%)	view
6	x 4	script/lib src script/lib src	host_observation.py local_control.rs host_observation.py local_control.rs	44:49 (<1%) 2091:2096 (<1%) 58:63 (<1%) 2105:2110 (<1%)	view
6	x 4	script/lib src script/lib src	host_observation.py local_control.rs host_observation.py local_control.rs	45:50 (<1%) 2092:2097 (<1%) 59:64 (<1%) 2106:2111 (<1%)	view
6	x 3	src src src	local_control.rs local_control.rs local_control.rs	630:638 (<1%) 653:661 (<1%) 678:686 (<1%)	view
6	x 3	script/lib script/lib script/lib	host_observation.py host_observation.py host_observation.py	2927:2932 (<1%) 2984:2989 (<1%) 3413:3418 (<1%)	view
6	x 3	script/lib script/lib script/lib	host_observation.py host_observation.py host_observation.py	3251:3256 (<1%) 3290:3295 (<1%) 3321:3326 (<1%)	view
6	x 3	src src src	runtime.rs runtime.rs runtime.rs	457:462 (1%) 573:578 (1%) 609:614 (1%)	view
6	x 3	script/lib script/lib script/lib	action_bundle_host.py action_bundle_host.py action_bundle_host.py	1049:1054 (<1%) 1080:1085 (<1%) 1323:1328 (<1%)	view
6	x 3	script/lib script/lib script/lib	action_bundle_host.py action_bundle_host.py action_bundle_host.py	1081:1086 (<1%) 1152:1157 (<1%) 1324:1329 (<1%)	view
6	x 3	src src src	hostname_policy.rs platform_profile.rs hostname_policy.rs	212:217 (1%) 255:260 (1%) 327:332 (1%)	view
6	x 3	src src src	hostname_policy.rs platform_profile.rs platform_profile.rs	203:208 (1%) 47:52 (1%) 241:246 (1%)	view
6	x 3	src src src	hostname_policy.rs platform_profile.rs hostname_policy.rs	211:216 (1%) 254:259 (1%) 326:331 (1%)	view
6	x 3	src src src	hostname_policy.rs platform_profile.rs platform_profile.rs	204:209 (1%) 48:53 (1%) 242:247 (1%)	view
6	x 3	src src src	hostname_policy.rs platform_profile.rs hostname_policy.rs	210:215 (1%) 253:258 (1%) 325:330 (1%)	view
6	x 3	src src src	runtime.rs runtime.rs runtime.rs	456:461 (1%) 572:577 (1%) 608:613 (1%)	view
6	x 3	src src src	hostname_policy.rs hostname_policy.rs hostname_policy.rs	179:184 (1%) 224:229 (1%) 263:268 (1%)	view
6	x 3	script/lib script/lib script/lib	host_observation.py host_observation.py host_observation.py	3249:3255 (<1%) 3288:3294 (<1%) 3319:3325 (<1%)	view
6	x 3	script/lib script/lib script/lib	action_bundle_host.py action_bundle_host.py action_bundle_host.py	1082:1087 (<1%) 1153:1158 (<1%) 1325:1330 (<1%)	view
6	x 3	src src src	lockdown.rs lockdown.rs lockdown.rs	2383:2388 (<1%) 2419:2424 (<1%) 2433:2438 (<1%)	view
6	x 3	script/lib script/lib script/lib	host_observation.py host_observation.py host_observation.py	3252:3257 (<1%) 3291:3296 (<1%) 3322:3327 (<1%)	view
6	x 3	src src src	hostname_policy.rs platform_profile.rs platform_profile.rs	202:207 (1%) 46:51 (1%) 240:245 (1%)	view
6	x 3	script/lib script/lib script/lib	host_observation.py host_observation.py host_observation.py	1119:1124 (<1%) 1131:1136 (<1%) 1173:1178 (<1%)	view

About This Analysis

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."