huggingface / candle-extensions Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

20% duplication:

6,420 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,309 duplicated lines

123 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
candle-flash-attn-v1 (5%) --> candle-layer-norm (9%)	368	2 file pairs	details...
candle-flash-attn-v1 (<1%) --> candle-rotary (10%)	70	2 file pairs	details...
candle-layer-norm (1%) --> candle-rotary (8%)	54	3 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 123 duplicates...

Size	#	Folders	Files	Lines	Code
89	x 2	candle-flash-attn-v1 candle-layer-norm	build.rs build.rs	183:292 (37%) 148:257 (41%)	view
38	x 2	candle-flash-attn-v1 candle-layer-norm	build.rs build.rs	140:181 (16%) 105:146 (17%)	view
26	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	509:539 (3%) 715:745 (3%)	view
26	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	509:539 (3%) 612:642 (3%)	view
26	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	612:642 (3%) 715:745 (3%)	view
24	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	196:224 (3%) 291:319 (3%)	view
24	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	101:129 (3%) 291:319 (3%)	view
24	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	101:129 (3%) 196:224 (3%)	view
23	x 2	candle-flash-attn-v1 candle-layer-norm	build.rs build.rs	101:124 (9%) 65:89 (10%)	view
22	x 2	candle-flash-attn-v1/kernels/fmha candle-flash-attn-v1/kernels/fmha	smem_tile.h smem_tile.h	474:512 (2%) 667:704 (2%)	view
19	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	440:466 (2%) 543:569 (2%)	view
19	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	543:569 (2%) 646:672 (2%)	view
19	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	440:466 (2%) 646:672 (2%)	view
18	x 2	candle-flash-attn-v1 candle-layer-norm	build.rs build.rs	63:85 (7%) 32:54 (8%)	view
17	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	38:61 (2%) 228:251 (2%)	view
17	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	38:61 (2%) 133:156 (2%)	view
17	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	119:141 (2%) 529:551 (2%)	view
17	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	214:236 (2%) 632:654 (2%)	view
17	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	133:156 (2%) 228:251 (2%)	view
15	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	588:610 (2%) 691:713 (2%)	view
15	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	485:507 (2%) 588:610 (2%)	view
15	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	485:507 (2%) 691:713 (2%)	view
14	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	80:98 (2%) 175:193 (2%)	view
14	x 2	candle-layer-norm candle-rotary	build.rs build.rs	32:48 (6%) 16:32 (31%)	view
14	x 2	candle-flash-attn-v1 candle-rotary	build.rs build.rs	63:79 (5%) 16:32 (31%)	view
14	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	175:193 (2%) 270:288 (2%)	view
14	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	80:98 (2%) 270:288 (2%)	view
13	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	267:282 (1%) 688:703 (1%)	view
13	x 2	candle-flash-attn-v1/kernels candle-flash-attn-v1/kernels	philox.cuh philox.cuh	32:44 (9%) 56:68 (9%)	view
13	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	77:92 (1%) 482:497 (1%)	view
13	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	371:383 (1%) 799:811 (1%)	view
13	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	172:187 (1%) 585:600 (1%)	view
12	x 2	candle-flash-attn-v1 candle-rotary	Cargo.toml Cargo.toml	6:19 (54%) 4:17 (63%)	view
12	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	196:208 (1%) 511:523 (1%)	view
12	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	101:113 (1%) 511:523 (1%)	view
12	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	196:208 (1%) 614:626 (1%)	view
12	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	101:113 (1%) 614:626 (1%)	view
12	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	101:113 (1%) 717:729 (1%)	view
12	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	291:303 (1%) 614:626 (1%)	view
12	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	196:208 (1%) 717:729 (1%)	view
12	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	291:303 (1%) 511:523 (1%)	view
12	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	291:303 (1%) 717:729 (1%)	view
12	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	330:343 (1%) 363:376 (1%)	view
11	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	338:348 (1%) 764:774 (1%)	view
10	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	80:92 (1%) 588:600 (1%)	view
10	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	80:92 (1%) 691:703 (1%)	view
10	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	270:282 (1%) 588:600 (1%)	view
10	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	416:426 (1%) 846:856 (1%)	view
10	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	175:187 (1%) 485:497 (1%)	view
10	x 2	candle-cublaslt/src candle-cublaslt/src	lib.rs lib.rs	270:282 (1%) 485:497 (1%)	view

Duplicated Units

The list of top 3 duplicated units.

See data for all 3 unit duplicates...

Size	#	Folders	Files	Lines	Code
59	x 2	candle-layer-norm candle-flash-attn-v1	build.rs build.rs	189:258 224:293	view
29	x 2	candle-layer-norm candle-flash-attn-v1	build.rs build.rs	154:186 189:221	view
7	x 2	candle-cublaslt/src candle-layer-norm/src	lib.rs lib.rs	328:336 232:240	view