Duplication · deepseek-ai/DeepGEMM-Ascend

Duplication Overall

6% duplication:

9,108 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
636 duplicated lines

38 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 38 longest duplicates.

See data for all 38 duplicates...

Size	#	Folders	Files	Lines	Code
43	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	fp8_dequant_gemm.hpp fp8_gemm.hpp	285:338 (12%) 191:246 (19%)	view
37	x 2	csrc/jit_kernels csrc/jit_kernels	fp8_gemm.hpp fp8_gemm.hpp	31:67 (29%) 103:139 (29%)	view
21	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	fp8_dequant_gemm.hpp fp8_gemm.hpp	221:245 (6%) 126:148 (9%)	view
16	x 2	csrc/jit_kernels csrc/jit_kernels	fp8_gemm.hpp fp8_gemm.hpp	12:30 (12%) 84:102 (12%)	view
16	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	fp8_dequant_gemm.hpp fp8_gemm.hpp	341:360 (4%) 247:266 (7%)	view
14	x 2	csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp	42:55 (23%) 38:51 (11%)	view
14	x 2	csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp	42:55 (23%) 110:123 (11%)	view
12	x 2	csrc/jit_kernels csrc/jit_kernels	fp8_dequant_gemm.hpp fp8_gemm.hpp	36:47 (17%) 19:30 (9%)	view
12	x 2	csrc/jit_kernels csrc/jit_kernels	fp8_dequant_gemm.hpp fp8_gemm.hpp	36:47 (17%) 91:102 (9%)	view
12	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	fp8_dequant_gemm.hpp fp8_gemm.hpp	95:106 (3%) 18:29 (5%)	view
10	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	fp8_dequant_gemm.hpp fp8_gemm.hpp	262:272 (2%) 166:176 (4%)	view
9	x 2	csrc/apis csrc/apis	gemm.hpp gemm.hpp	339:347 (2%) 379:387 (2%)	view
9	x 2	csrc/apis csrc/apis	gemm.hpp gemm.hpp	572:580 (2%) 582:590 (2%)	view
8	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	bf16_gemm.hpp fp8_gemm.hpp	172:180 (5%) 266:274 (3%)	view
8	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	fp8_dequant_gemm.hpp fp8_gemm.hpp	116:123 (2%) 39:46 (3%)	view
8	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	fp8_dequant_gemm.hpp fp8_gemm.hpp	138:147 (2%) 61:70 (3%)	view
8	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	fp8_dequant_gemm.hpp fp8_gemm.hpp	200:208 (2%) 103:112 (3%)	view
7	x 2	deep_gemm/tilelang_ops deep_gemm/tilelang_ops	hc_prenorm.py hc_prenorm.py	294:300 (2%) 326:332 (2%)	view
7	x 2	deep_gemm/tilelang_ops deep_gemm/tilelang_ops	hc_prenorm.py hc_prenorm.py	316:322 (2%) 348:354 (2%)	view
7	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	mqa_logits.hpp mqa_logits.hpp	115:121 (1%) 151:157 (1%)	view
7	x 2	csrc/apis csrc/apis	gemm.hpp gemm.hpp	540:546 (1%) 548:554 (1%)	view
7	x 2	csrc/apis csrc/apis	gemm.hpp gemm.hpp	556:562 (1%) 564:570 (1%)	view
7	x 2	csrc/apis csrc/apis	gemm.hpp gemm.hpp	593:599 (1%) 601:607 (1%)	view
7	x 2	csrc/jit_kernels csrc/jit_kernels	mqa_logits.hpp mqa_logits.hpp	55:61 (4%) 169:175 (4%)	view
7	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	bf16_gemm.hpp fp8_gemm.hpp	7:14 (4%) 7:23 (3%)	view
7	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	fp8_dequant_gemm.hpp fp8_gemm.hpp	424:431 (2%) 269:276 (3%)	view
7	x 2	csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_dequant_gemm.hpp	28:34 (11%) 41:47 (10%)	view
7	x 2	csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp	28:34 (11%) 24:30 (5%)	view
7	x 2	csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp	28:34 (11%) 96:102 (5%)	view
7	x 2	csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp	56:62 (11%) 54:60 (5%)	view
7	x 2	csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp	56:62 (11%) 126:132 (5%)	view
6	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	mqa_logits.hpp mqa_logits.hpp	228:233 (1%) 657:662 (1%)	view
6	x 2	csrc/apis csrc/apis	gemm.hpp gemm.hpp	642:647 (1%) 649:654 (1%)	view
6	x 2	csrc/jit_kernels csrc/jit_kernels	fp8_gemm.hpp fp8_gemm.hpp	73:78 (4%) 145:150 (4%)	view
6	x 2	deep_gemm/include/deep_gemm/ascend deep_gemm/include/deep_gemm/ascend	copy.hpp copy.hpp	181:186 (1%) 189:194 (1%)	view
6	x 2	deep_gemm/include/deep_gemm/ascend deep_gemm/include/deep_gemm/ascend	copy.hpp copy.hpp	272:277 (1%) 293:298 (1%)	view
6	x 2	csrc/jit_kernels csrc/jit_kernels	mqa_logits.hpp mqa_logits.hpp	49:54 (3%) 162:167 (3%)	view
6	x 2	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	bf16_gemm.hpp fp8_dequant_gemm.hpp	9:14 (4%) 95:100 (1%)	view

Most Frequent Duplicates

The list of 19 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 4	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	fp8_dequant_gemm.hpp fp8_gemm.hpp bf16_gemm.hpp fp8_gemm.hpp	41:46 (8%) 24:29 (4%) 28:33 (10%) 96:101 (4%)	view
6	x 4	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	fp8_dequant_gemm.hpp fp8_gemm.hpp bf16_gemm.hpp fp8_gemm.hpp	42:47 (8%) 25:30 (4%) 29:34 (10%) 97:102 (4%)	view
6	x 3	deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm deep_gemm/include/deep_gemm	bf16_gemm.hpp fp8_dequant_gemm.hpp fp8_gemm.hpp	9:14 (4%) 95:100 (1%) 18:23 (2%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	fp8_dequant_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	37:42 (8%) 20:25 (4%) 92:97 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	fp8_dequant_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	36:41 (8%) 19:24 (4%) 91:96 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	50:55 (10%) 46:51 (4%) 118:123 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	43:48 (10%) 39:44 (4%) 111:116 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	44:49 (10%) 40:45 (4%) 112:117 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	47:52 (10%) 43:48 (4%) 115:120 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	49:54 (10%) 45:50 (4%) 117:122 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	48:53 (10%) 44:49 (4%) 116:121 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	57:62 (10%) 55:60 (4%) 127:132 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	45:50 (10%) 41:46 (4%) 113:118 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	56:61 (10%) 54:59 (4%) 126:131 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	46:51 (10%) 42:47 (4%) 114:119 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	bf16_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	42:47 (10%) 38:43 (4%) 110:115 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	fp8_dequant_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	38:43 (8%) 21:26 (4%) 93:98 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	fp8_dequant_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	39:44 (8%) 22:27 (4%) 94:99 (4%)	view
6	x 3	csrc/jit_kernels csrc/jit_kernels csrc/jit_kernels	fp8_dequant_gemm.hpp fp8_gemm.hpp fp8_gemm.hpp	40:45 (8%) 23:28 (4%) 95:100 (4%)	view

About This Analysis

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."