huggingface / bitsandbytes_testing Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

28% duplication:

12,916 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
3,659 duplicated lines

635 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 635 duplicates...

Size	#	Folders	Files	Lines	Code
59	x 2	bitsandbytes/triton bitsandbytes/triton	int8_matmul_mixed_dequantize.py int8_matmul_rowwise_dequantize.py	8:80 (35%) 8:80 (35%)	view
50	x 2	csrc csrc	kernels.cu kernels.cu	170:221 (1%) 224:276 (1%)	view
35	x 2	bitsandbytes/optim bitsandbytes/optim	optimizer.py optimizer.py	399:441 (6%) 618:660 (6%)	view
33	x 2	bitsandbytes/triton bitsandbytes/triton	int8_matmul_mixed_dequantize.py int8_matmul_rowwise_dequantize.py	92:130 (19%) 92:130 (19%)	view
31	x 2	bitsandbytes/optim bitsandbytes/optim	adagrad.py adagrad.py	9:66 (26%) 144:201 (26%)	view
30	x 2	bitsandbytes/optim bitsandbytes/optim	optimizer.py optimizer.py	469:504 (5%) 680:715 (5%)	view
27	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	78:133 (8%) 261:316 (8%)	view
27	x 2	csrc csrc	kernels.cu kernels.cu	3254:3286 (<1%) 3469:3501 (<1%)	view
27	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	139:194 (8%) 322:377 (8%)	view
27	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	17:72 (8%) 200:255 (8%)	view
25	x 2	csrc csrc	kernels.cu mps_kernels.metal	372:396 (<1%) 46:70 (24%)	view
25	x 2	bitsandbytes/optim bitsandbytes/optim	rmsprop.py rmsprop.py	73:126 (25%) 136:190 (25%)	view
24	x 2	bitsandbytes/triton bitsandbytes/triton	int8_matmul_mixed_dequantize.py int8_matmul_rowwise_dequantize.py	133:163 (14%) 133:162 (14%)	view
23	x 2	bitsandbytes/optim bitsandbytes/optim	lamb.py lamb.py	76:129 (24%) 140:193 (24%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adamw.py	85:135 (6%) 77:127 (12%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	78:128 (6%) 139:189 (6%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	78:128 (6%) 200:250 (6%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	sgd.py sgd.py	68:114 (25%) 124:170 (25%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	261:311 (6%) 322:372 (6%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	200:250 (6%) 322:372 (6%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	200:250 (6%) 261:311 (6%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	17:67 (6%) 261:311 (6%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	17:67 (6%) 322:372 (6%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adamw.py	146:196 (6%) 138:188 (12%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adamw.py adamw.py	9:59 (12%) 70:120 (12%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adamw.py adamw.py	9:59 (12%) 131:181 (12%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	139:189 (6%) 261:311 (6%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	lars.py lars.py	72:118 (13%) 129:175 (13%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	17:67 (6%) 78:128 (6%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	17:67 (6%) 139:189 (6%)	view
22	x 2	bitsandbytes bitsandbytes	functional.py functional.py	1697:1718 (1%) 1721:1742 (1%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adamw.py	24:74 (6%) 16:66 (12%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	78:128 (6%) 322:372 (6%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adam.py	139:189 (6%) 200:250 (6%)	view
22	x 2	bitsandbytes/optim bitsandbytes/optim	adamw.py adamw.py	70:120 (12%) 131:181 (12%)	view
21	x 2	bitsandbytes/optim bitsandbytes/optim	adamw.py adamw.py	252:301 (11%) 312:361 (11%)	view
21	x 2	bitsandbytes/autograd bitsandbytes/research/autograd	_functions.py _functions.py	429:456 (5%) 313:341 (7%)	view
21	x 2	bitsandbytes/triton bitsandbytes/triton	int8_matmul_mixed_dequantize.py int8_matmul_rowwise_dequantize.py	185:205 (12%) 186:206 (12%)	view
21	x 2	bitsandbytes/optim bitsandbytes/optim	adamw.py adamw.py	192:241 (11%) 312:361 (11%)	view
21	x 2	bitsandbytes/optim bitsandbytes/optim	adamw.py adamw.py	192:241 (11%) 252:301 (11%)	view
20	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adamw.py	329:377 (6%) 138:186 (11%)	view
20	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adamw.py	207:255 (6%) 16:64 (11%)	view
20	x 2	bitsandbytes/research/autograd bitsandbytes/research/autograd	_functions.py _functions.py	41:71 (7%) 125:155 (7%)	view
20	x 2	bitsandbytes/triton bitsandbytes/triton	dequantize_rowwise.py quantize_rowwise.py	10:35 (41%) 10:35 (40%)	view
20	x 2	bitsandbytes/optim bitsandbytes/optim	adam.py adamw.py	268:316 (6%) 77:125 (11%)	view
19	x 2	bitsandbytes/optim bitsandbytes/optim	lion.py lion.py	64:105 (11%) 116:157 (11%)	view
18	x 2	csrc csrc	kernels.cu kernels.cu	447:465 (<1%) 492:510 (<1%)	view
18	x 2	csrc csrc	kernels.cu kernels.cu	1028:1049 (<1%) 1193:1214 (<1%)	view
18	x 2	bitsandbytes/nn bitsandbytes/nn	modules.py modules.py	97:124 (3%) 179:206 (3%)	view
18	x 2	csrc csrc	kernels.cu kernels.cu	3175:3196 (<1%) 3398:3419 (<1%)	view