Duplication · deepseek-ai/DeepEP

Duplication Overall

9% duplication:

11,021 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
997 duplicated lines

83 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 83 duplicates...

Size	#	Folders	Files	Lines	Code
32	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	prefetch_weights.cuh reduce_grads.cuh	30:68 (40%) 29:67 (40%)	view
25	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	dispatch.cuh hybrid_dispatch.cuh	94:121 (7%) 123:150 (4%)	view
18	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	dispatch.cuh hybrid_dispatch.cuh	232:251 (5%) 303:322 (3%)	view
17	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	dispatch.cuh hybrid_dispatch.cuh	294:311 (4%) 367:384 (2%)	view
16	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	prefetch_weights.cuh reduce_grads.cuh	1:21 (20%) 1:21 (20%)	view
15	x 2	csrc/kernels/ep csrc/kernels/ep	combine.hpp dispatch.hpp	94:110 (10%) 118:134 (8%)	view
14	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/impls/bucket/all_reduce	rdma.cuh rdma.cuh	157:171 (5%) 203:216 (5%)	view
14	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	dispatch.cuh hybrid_dispatch.cuh	77:92 (3%) 106:121 (2%)	view
13	x 2	csrc/kernels/pp csrc/kernels/pp	pp_send_recv.hpp pp_send_recv.hpp	43:57 (20%) 81:95 (20%)	view
13	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter	nvlink.cuh nvlink.cuh	20:33 (25%) 20:33 (25%)	view
12	x 2	deep_ep/buffers deep_ep/buffers	engram.py ep.py	97:112 (10%) 353:373 (2%)	view
11	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	prefetch_weights.cuh reduce_grads.cuh	83:95 (13%) 83:95 (13%)	view
10	x 2	deep_ep/include/deep_ep/common deep_ep/include/deep_ep/common	utils.cuh utils.cuh	39:48 (14%) 62:71 (14%)	view
10	x 2	csrc/kernels/bucket csrc/kernels/bucket	reduce_scatter.hpp reduce_scatter.hpp	73:82 (7%) 167:176 (7%)	view
10	x 2	csrc/kernels/ep csrc/kernels/ep	prefetch_weights.hpp reduce_grads.hpp	50:59 (28%) 55:64 (26%)	view
10	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter	nvlink.cuh nvlink.cuh	1:13 (19%) 1:13 (19%)	view
9	x 2	deep_ep/include/deep_ep/...s/bucket/reduce_scatter deep_ep/include/deep_ep/...s/bucket/reduce_scatter	rdma.cuh rdma.cuh	84:93 (1%) 338:347 (1%)	view
9	x 2	deep_ep/include/deep_ep/...s/bucket/reduce_scatter deep_ep/include/deep_ep/...s/bucket/reduce_scatter	rdma.cuh rdma.cuh	224:233 (1%) 626:635 (1%)	view
9	x 2	csrc/kernels/bucket csrc/kernels/bucket	reduce_scatter.hpp reduce_scatter.hpp	137:145 (6%) 164:172 (6%)	view
9	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter	nvlink.cuh nvlink.cuh	50:60 (17%) 49:59 (17%)	view
9	x 2	csrc/buffers deep_ep/buffers	ep.hpp ep.py	747:755 (1%) 704:712 (1%)	view
9	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter	rdma.cuh rdma.cuh	1:12 (3%) 1:13 (1%)	view
8	x 2	csrc/kernels/ep csrc/kernels/ep	dispatch.hpp dispatch.hpp	133:140 (4%) 149:156 (4%)	view
8	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/impls/bucket/all_reduce	rdma.cuh rdma.cuh	188:195 (3%) 234:241 (3%)	view
8	x 2	csrc/kernels/bucket csrc/kernels/bucket	reduce_scatter.hpp reduce_scatter.hpp	110:117 (6%) 142:149 (6%)	view
8	x 2	csrc/kernels/bucket csrc/kernels/bucket	all_reduce.hpp all_reduce.hpp	91:98 (7%) 129:136 (7%)	view
8	x 2	deep_ep/buffers deep_ep/buffers	ep.py ep.py	705:712 (1%) 723:730 (1%)	view
8	x 2	csrc/kernels/comm csrc/kernels/comm	api.hpp context.cpp	66:73 (14%) 76:83 (4%)	view
8	x 2	csrc/buffers deep_ep/buffers	ep.hpp ep.py	748:755 (1%) 723:730 (1%)	view
8	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	dispatch.cuh reduce_grads.cuh	1:10 (2%) 1:10 (10%)	view
8	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	dispatch.cuh prefetch_weights.cuh	1:10 (2%) 1:10 (10%)	view
8	x 2	csrc/kernels/ep csrc/kernels/ep	combine.hpp dispatch.hpp	182:189 (5%) 207:214 (4%)	view
8	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	dispatch.cuh hybrid_dispatch.cuh	6:15 (2%) 3:12 (1%)	view
7	x 2	csrc/kernels/pp csrc/kernels/pp	pp_send_recv.hpp pp_send_recv.hpp	29:35 (10%) 67:73 (10%)	view
7	x 2	csrc/kernels/engram csrc/kernels/engram	engram.hpp engram.hpp	68:76 (8%) 103:111 (8%)	view
7	x 2	deep_ep/include/deep_ep/common deep_ep/include/deep_ep/common	ptx.cuh ptx.cuh	230:236 (1%) 244:250 (1%)	view
7	x 2	csrc/buffers csrc/buffers	ep.hpp ep.hpp	524:530 (<1%) 886:892 (<1%)	view
7	x 2	csrc/buffers csrc/buffers	ep.hpp ep.hpp	777:786 (<1%) 971:980 (<1%)	view
7	x 2	deep_ep/include/deep_ep/impls/bucket/all_gather deep_ep/include/deep_ep/impls/bucket/all_gather	hybrid.cuh rdma.cuh	1:9 (9%) 1:9 (16%)	view
7	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	combine.cuh hybrid_combine.cuh	5:14 (3%) 3:10 (1%)	view
7	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter	nvlink.cuh rdma.cuh	1:9 (13%) 1:9 (1%)	view
7	x 2	deep_ep/include/deep_ep/...s/bucket/reduce_scatter deep_ep/include/deep_ep/...s/bucket/reduce_scatter	nvlink.cuh rdma.cuh	1:9 (13%) 1:9 (1%)	view
7	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter	rdma.cuh nvlink.cuh	1:9 (2%) 1:9 (13%)	view
7	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/impls/bucket/all_reduce	nvlink.cuh rdma.cuh	1:9 (13%) 1:9 (2%)	view
7	x 2	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	dispatch.cuh hybrid_dispatch.cuh	57:64 (1%) 66:73 (1%)	view
7	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter	hybrid.cuh hybrid.cuh	1:9 (2%) 1:9 (2%)	view
7	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter	hybrid.cuh rdma.cuh	1:9 (2%) 1:9 (1%)	view
7	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/impls/bucket/all_reduce	hybrid.cuh rdma.cuh	1:9 (2%) 1:9 (2%)	view
7	x 2	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter	nvlink.cuh hybrid.cuh	1:9 (13%) 1:9 (2%)	view
7	x 2	deep_ep/include/deep_ep/...s/bucket/reduce_scatter deep_ep/include/deep_ep/...s/bucket/reduce_scatter	hybrid.cuh nvlink.cuh	1:9 (2%) 1:9 (13%)	view

Most Frequent Duplicates

The list of 14 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 6	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter deep_ep/include/deep_ep/...s/bucket/reduce_scatter deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter deep_ep/include/deep_ep/impls/bucket/all_reduce	hybrid.cuh nvlink.cuh hybrid.cuh rdma.cuh rdma.cuh nvlink.cuh	1:7 (1%) 1:7 (11%) 1:7 (2%) 1:7 (2%) 1:7 (1%) 1:7 (11%)	view
6	x 6	deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter deep_ep/include/deep_ep/...s/bucket/reduce_scatter deep_ep/include/deep_ep/impls/bucket/all_reduce deep_ep/include/deep_ep/...s/bucket/reduce_scatter deep_ep/include/deep_ep/impls/bucket/all_reduce	hybrid.cuh nvlink.cuh hybrid.cuh rdma.cuh rdma.cuh nvlink.cuh	3:9 (1%) 3:9 (11%) 3:9 (2%) 3:9 (2%) 3:9 (1%) 3:9 (11%)	view
6	x 4	csrc/kernels/ep csrc/kernels/ep csrc/kernels/ep csrc/kernels/ep	dispatch.hpp prefetch_weights.hpp combine.hpp reduce_grads.hpp	125:130 (3%) 52:57 (17%) 101:106 (4%) 57:62 (15%)	view
6	x 4	csrc/kernels/ep csrc/kernels/ep csrc/kernels/ep csrc/kernels/ep	dispatch.hpp prefetch_weights.hpp combine.hpp reduce_grads.hpp	207:212 (3%) 50:55 (17%) 182:187 (4%) 55:60 (15%)	view
6	x 3	csrc/kernels/ep csrc/kernels/ep csrc/kernels/bucket	combine.hpp dispatch.hpp all_reduce.hpp	102:107 (4%) 126:131 (3%) 61:66 (5%)	view
6	x 3	csrc/kernels/bucket csrc/kernels/bucket csrc/kernels/bucket	reduce_scatter.hpp reduce_scatter.hpp reduce_scatter.hpp	73:78 (4%) 140:145 (4%) 167:172 (4%)	view
6	x 3	csrc/kernels/bucket csrc/kernels/bucket csrc/kernels/bucket	all_reduce.hpp all_reduce.hpp all_reduce.hpp	64:69 (5%) 93:98 (5%) 131:136 (5%)	view
6	x 3	csrc/buffers deep_ep/buffers deep_ep/buffers	ep.hpp ep.py ep.py	750:755 (<1%) 707:712 (1%) 725:730 (1%)	view
6	x 3	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	prefetch_weights.cuh reduce_grads.cuh dispatch.cuh	4:10 (7%) 4:10 (7%) 4:10 (1%)	view
6	x 3	csrc/buffers deep_ep/buffers deep_ep/buffers	ep.hpp ep.py ep.py	749:754 (<1%) 706:711 (1%) 724:729 (1%)	view
6	x 3	deep_ep/include/deep_ep/common deep_ep/include/deep_ep/common deep_ep/include/deep_ep/common	ptx.cuh ptx.cuh ptx.cuh	231:236 (1%) 245:250 (1%) 259:264 (1%)	view
6	x 3	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	prefetch_weights.cuh reduce_grads.cuh dispatch.cuh	1:8 (7%) 1:8 (7%) 1:8 (1%)	view
6	x 3	csrc/buffers deep_ep/buffers deep_ep/buffers	ep.hpp ep.py ep.py	748:753 (<1%) 705:710 (1%) 723:728 (1%)	view
6	x 3	deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep deep_ep/include/deep_ep/impls/ep	prefetch_weights.cuh reduce_grads.cuh dispatch.cuh	3:9 (7%) 3:9 (7%) 3:9 (1%)	view

About This Analysis

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."