huggingface / transformers.js-benchmarking Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

90% duplication:

47,270 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
42,677 duplicated lines

431,306 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 431,306 duplicates...

Size	#	Folders	Files	Lines	Code
44	x 2	packages/core/src/architectures packages/core/src/architectures	owlv2.js owlvit.js	10:53 (25%) 10:53 (20%)	view
42	x 2	packages/core/src/architectures packages/core/src/architectures	rf_detr.js rf_detr.js	121:162 (10%) 332:373 (10%)	view
42	x 2	packages/core/src/architectures packages/core/src/architectures	rtmo.js rtmo.js	165:206 (16%) 215:256 (16%)	view
42	x 2	packages/core/src/architectures packages/core/src/architectures	gliner.js gliner.js	21:62 (8%) 194:235 (8%)	view
42	x 2	packages/core/src/architectures packages/core/src/architectures	birefnet.js swin.js	8:49 (45%) 87:128 (10%)	view
41	x 2	packages/core/src/architectures packages/core/src/architectures	rf_detr.js rf_detr.js	69:109 (9%) 279:319 (9%)	view
41	x 2	packages/core/src/architectures packages/core/src/architectures	gliner.js gliner.js	81:121 (8%) 255:295 (8%)	view
41	x 2	packages/core/src/architectures packages/core/src/architectures	rf_detr.js rf_detr.js	17:57 (9%) 226:266 (9%)	view
41	x 2	packages/core/src/architectures packages/core/src/architectures	owlv2.js owlvit.js	58:98 (23%) 58:98 (18%)	view
41	x 2	packages/core/src/architectures packages/core/src/architectures	gliner.js gliner.js	137:177 (8%) 312:352 (8%)	view
40	x 2	packages/core/src/architectures packages/core/src/architectures	swin2sr.js swinv2.js	743:782 (5%) 56:95 (43%)	view
40	x 2	packages/core/src/architectures packages/core/src/architectures	rf_detr.js rf_detr.js	174:213 (9%) 386:425 (9%)	view
39	x 2	packages/core/src/architectures packages/core/src/architectures	gpt_neox.js phi.js	522:560 (7%) 334:372 (10%)	view
38	x 2	packages/core/src/architectures packages/core/src/architectures	owlv2.js owlvit.js	104:141 (21%) 149:186 (17%)	view
38	x 2	packages/core/src/architectures packages/core/src/architectures	mt5.js t5.js	49:86 (23%) 49:86 (6%)	view
37	x 2	packages/core/src/architectures packages/core/src/architectures	owlv2.js owlvit.js	146:182 (21%) 191:227 (16%)	view
37	x 2	packages/core/src/architectures packages/core/src/architectures	detr.js table-transformer.js	10:46 (15%) 10:46 (22%)	view
37	x 2	packages/core/src/architectures packages/core/src/architectures	detr.js table-transformer.js	217:253 (15%) 131:167 (22%)	view
36	x 2	packages/core/src/architectures packages/core/src/architectures	glm.js helium.js	10:45 (19%) 10:45 (19%)	view
36	x 2	packages/core/src/architectures packages/core/src/architectures	detr.js table-transformer.js	177:212 (14%) 91:126 (22%)	view
36	x 2	packages/core/src/architectures packages/core/src/architectures	clip.js clip.js	184:219 (4%) 266:301 (4%)	view
35	x 2	packages/core/src/architectures packages/core/src/architectures	glm.js helium.js	124:158 (18%) 124:158 (18%)	view
35	x 2	packages/core/src/architectures packages/core/src/architectures	falcon.js phi.js	168:203 (14%) 295:330 (9%)	view
35	x 2	packages/core/src/architectures packages/core/src/architectures	mt5.js t5.js	10:44 (21%) 10:44 (5%)	view
35	x 2	packages/core/src/architectures packages/core/src/architectures	falcon.js gpt_neox.js	168:203 (14%) 483:518 (6%)	view
35	x 2	packages/core/src/architectures packages/core/src/architectures	donut-swin.js swin.js	10:44 (85%) 379:413 (8%)	view
35	x 2	packages/core/src/architectures packages/core/src/architectures	detr.js table-transformer.js	51:85 (14%) 51:85 (21%)	view
35	x 2	packages/core/src/architectures packages/core/src/architectures	gpt_neox.js phi.js	483:518 (6%) 295:330 (9%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	exaone.js llama.js	82:115 (23%) 568:601 (2%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	lite-whisper.js whisper.js	45:78 (23%) 480:513 (5%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	cohere.js phi.js	10:43 (80%) 295:328 (9%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	llama.js mobilellm.js	568:601 (2%) 82:115 (11%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	granite.js mobilellm.js	119:152 (18%) 82:115 (11%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	exaone.js granite.js	82:115 (23%) 119:152 (18%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	cohere.js falcon.js	10:43 (80%) 168:201 (14%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	phi.js stablelm.js	81:114 (9%) 154:187 (15%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	mobilellm.js olmo2.js	268:301 (11%) 10:43 (85%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	phi.js starcoder2.js	81:114 (9%) 10:43 (44%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	glm.js helium.js	163:196 (17%) 163:196 (17%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	vision-encoder-decoder.js whisper.js	244:277 (6%) 46:79 (5%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	moonshine.js moonshine.js	104:138 (13%) 148:182 (13%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	granite.js llama.js	119:152 (18%) 568:601 (2%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	cohere.js gpt_neox.js	10:43 (80%) 483:516 (6%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	exaone.js mobilellm.js	82:115 (23%) 82:115 (11%)	view
34	x 2	packages/core/src/architectures packages/core/src/architectures	stablelm.js starcoder2.js	154:187 (15%) 10:43 (44%)	view
33	x 2	packages/core/src/architectures packages/core/src/architectures	blenderbot-small.js marian.js	44:76 (30%) 326:358 (7%)	view
33	x 2	packages/core/src/architectures packages/core/src/architectures	metric3d.js metric3d.js	15:47 (37%) 58:90 (37%)	view
33	x 2	packages/core/src/architectures packages/core/src/architectures	glm.js helium.js	87:119 (17%) 87:119 (17%)	view
33	x 2	packages/core/src/architectures packages/core/src/architectures	mbart.js pegasus.js	269:301 (11%) 45:77 (45%)	view
33	x 2	packages/core/src/architectures packages/core/src/architectures	blenderbot.js mbart.js	44:76 (23%) 44:76 (11%)	view