huggingface / text-embeddings-inference Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

47% duplication:

18,211 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
8,687 duplicated lines

1,261 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,261 duplicates...

Size	#	Folders	Files	Lines	Code
185	x 2	backends/candle/src/models backends/candle/src/models	jina.rs jina_code.rs	464:720 (34%) 391:647 (39%)	view
121	x 2	backends/candle/src/models backends/candle/src/models	flash_mistral.rs flash_qwen2.rs	264:437 (37%) 282:455 (36%)	view
121	x 2	backends/candle/src/models backends/candle/src/models	flash_qwen2.rs flash_qwen3.rs	282:455 (36%) 330:503 (31%)	view
121	x 2	backends/candle/src/models backends/candle/src/models	flash_mistral.rs flash_qwen3.rs	264:437 (37%) 330:503 (31%)	view
106	x 2	backends/candle/src/models backends/candle/src/models	bert.rs jina.rs	118:262 (15%) 91:235 (19%)	view
91	x 2	backends/candle/src/models backends/candle/src/models	flash_jina.rs flash_jina_code.rs	294:431 (28%) 340:477 (26%)	view
89	x 2	backends/candle/src/models backends/candle/src/models	bert.rs nomic.rs	700:816 (12%) 736:852 (12%)	view
88	x 2	backends/candle/src/models backends/candle/src/models	gte.rs nomic.rs	477:590 (16%) 742:855 (12%)	view
85	x 2	backends/candle/src/models backends/candle/src/models	bert.rs gte.rs	706:816 (12%) 477:587 (16%)	view
75	x 2	backends/candle/src/models backends/candle/src/models	gte.rs nomic.rs	69:170 (14%) 466:567 (10%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_jina.rs flash_qwen2.rs	323:431 (21%) 347:455 (20%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_gte.rs flash_modernbert.rs	308:416 (22%) 358:452 (20%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_gte.rs flash_mistral.rs	308:416 (22%) 329:437 (21%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_gte.rs flash_qwen2.rs	308:416 (22%) 347:455 (20%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_modernbert.rs flash_nomic.rs	358:452 (20%) 317:425 (22%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_gte.rs flash_jina.rs	308:416 (22%) 323:431 (21%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_jina_code.rs flash_modernbert.rs	369:477 (20%) 358:452 (20%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_gte.rs flash_jina_code.rs	308:416 (22%) 369:477 (20%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_jina.rs flash_nomic.rs	323:431 (21%) 317:425 (22%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_jina.rs flash_modernbert.rs	323:431 (21%) 358:452 (20%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_modernbert.rs flash_qwen3.rs	358:452 (20%) 395:503 (18%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_gte.rs flash_nomic.rs	308:416 (22%) 317:425 (22%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_jina.rs flash_qwen3.rs	323:431 (21%) 395:503 (18%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_mistral.rs flash_nomic.rs	329:437 (21%) 317:425 (22%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_jina_code.rs flash_mistral.rs	369:477 (20%) 329:437 (21%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_gte.rs flash_qwen3.rs	308:416 (22%) 395:503 (18%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_jina_code.rs flash_qwen3.rs	369:477 (20%) 395:503 (18%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_nomic.rs flash_qwen3.rs	317:425 (22%) 395:503 (18%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_mistral.rs flash_modernbert.rs	329:437 (21%) 358:452 (20%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_jina_code.rs flash_nomic.rs	369:477 (20%) 317:425 (22%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_nomic.rs flash_qwen2.rs	317:425 (22%) 347:455 (20%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_jina.rs flash_mistral.rs	323:431 (21%) 329:437 (21%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_jina_code.rs flash_qwen2.rs	369:477 (20%) 347:455 (20%)	view
70	x 2	backends/candle/src/models backends/candle/src/models	flash_modernbert.rs flash_qwen2.rs	358:452 (20%) 347:455 (20%)	view
68	x 2	backends/candle/src/models backends/candle/src/models	flash_bert.rs flash_jina_code.rs	364:464 (17%) 340:440 (19%)	view
68	x 2	backends/candle/src/models backends/candle/src/models	flash_bert.rs flash_jina.rs	364:464 (17%) 294:394 (21%)	view
60	x 2	backends/candle/src/models backends/candle/src/models	bert.rs distilbert.rs	176:259 (8%) 117:200 (11%)	view
60	x 2	backends/candle/src/models backends/candle/src/models	distilbert.rs jina.rs	117:200 (11%) 149:232 (11%)	view
59	x 2	backends/candle/src/models backends/candle/src/models	bert.rs jina_code.rs	699:780 (8%) 391:472 (12%)	view
59	x 2	backends/candle/src/models backends/candle/src/models	bert.rs jina.rs	699:780 (8%) 464:545 (10%)	view
58	x 2	backends/candle/src/models backends/candle/src/models	jina.rs nomic.rs	465:545 (10%) 736:816 (8%)	view
58	x 2	backends/candle/src/models backends/candle/src/models	jina_code.rs nomic.rs	392:472 (12%) 736:816 (8%)	view
55	x 2	backends/candle/src/models backends/candle/src/models	gte.rs nomic.rs	609:696 (10%) 884:971 (7%)	view
54	x 2	backends/candle/src/models backends/candle/src/models	gte.rs jina.rs	477:551 (10%) 471:545 (10%)	view
54	x 2	backends/candle/src/models backends/candle/src/models	gte.rs jina_code.rs	477:551 (10%) 398:472 (11%)	view
52	x 2	backends/candle/src/models backends/candle/src/models	jina_code.rs nomic.rs	564:647 (10%) 888:971 (7%)	view
52	x 2	backends/candle/src/models backends/candle/src/models	gte.rs jina.rs	613:696 (10%) 637:720 (9%)	view
52	x 2	backends/candle/src/models backends/candle/src/models	jina.rs nomic.rs	637:720 (9%) 888:971 (7%)	view
52	x 2	backends/candle/src/models backends/candle/src/models	gte.rs jina_code.rs	613:696 (10%) 564:647 (10%)	view
50	x 2	backends/candle/src/models backends/candle/src/models	distilbert.rs jina_code.rs	130:200 (9%) 131:201 (10%)	view

Duplicated Units

The list of top 6 duplicated units.

See data for all 6 unit duplicates...

Size	#	Folders	Files	Lines	Code
71	x 2	backends/candle/src/models backends/candle/src/models	bert.rs jina.rs	170:263 143:236	view
12	x 2	backends/candle/src/models backends/candle/src/models	gte.rs nomic.rs	351:368 644:660	view
9	x 9	backends/candle/src/models backends/candle/src/models backends/candle/src/models backends/candle/src/models backends/candle/src/models backends/candle/src/models backends/candle/src/models backends/candle/src/models backends/candle/src/models	flash_modernbert.rs gte.rs flash_bert.rs modernbert.rs bert.rs jina.rs flash_jina.rs distilbert.rs flash_gte.rs	465:475 709:719 538:548 815:825 944:954 733:743 444:454 737:747 429:439	view
9	x 2	backends/candle/src/models backends/candle/src/models	bert.rs jina.rs	406:418 380:392	view
6	x 4	backends/candle/src/models backends/candle/src/models backends/candle/src/models backends/candle/src/models	jina_code.rs bert.rs jina.rs distilbert.rs	313:324 350:361 324:335 310:321	view
6	x 3	backends/candle/src/models backends/candle/src/models backends/candle/src/models	flash_bert.rs flash_jina.rs flash_jina_code.rs	203:214 208:219 261:272	view