huggingface / ai-blueprint Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

33% duplication:

616 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
206 duplicated lines

47 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 47 longest duplicates.

See data for all 47 duplicates...

Size	#	Folders	Files	Lines	Code
31	x 2	rag rag	augment.ipynb augment.ipynb	182:212 (5%) 419:449 (5%)	view
26	x 2	rag rag	augment.ipynb augment.ipynb	64:89 (4%) 182:207 (4%)	view
26	x 2	rag rag	augment.ipynb augment.ipynb	64:89 (4%) 419:444 (4%)	view
8	x 2	rag rag	augment.ipynb augment.ipynb	14:21 (1%) 30:37 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	158:163 (1%) 288:293 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	23:28 (1%) 43:48 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	370:375 (1%) 537:542 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	122:127 (1%) 246:251 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	311:316 (1%) 412:417 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	288:293 (1%) 295:300 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	110:115 (1%) 469:474 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	158:163 (1%) 295:300 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	57:62 (1%) 412:417 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	295:300 (1%) 398:403 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	43:48 (1%) 158:163 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	43:48 (1%) 398:403 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	370:375 (1%) 382:387 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	43:48 (1%) 295:300 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	158:163 (1%) 382:387 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	23:28 (1%) 382:387 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	43:48 (1%) 288:293 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	158:163 (1%) 537:542 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	23:28 (1%) 537:542 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	295:300 (1%) 537:542 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	23:28 (1%) 370:375 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	158:163 (1%) 398:403 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	295:300 (1%) 382:387 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	122:127 (1%) 497:502 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	382:387 (1%) 537:542 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	398:403 (1%) 537:542 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	288:293 (1%) 382:387 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	23:28 (1%) 158:163 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	23:28 (1%) 398:403 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	295:300 (1%) 370:375 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	288:293 (1%) 537:542 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	246:251 (1%) 497:502 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	288:293 (1%) 370:375 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	158:163 (1%) 370:375 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	43:48 (1%) 370:375 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	382:387 (1%) 398:403 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	288:293 (1%) 398:403 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	370:375 (1%) 398:403 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	43:48 (1%) 382:387 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	57:62 (1%) 311:316 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	23:28 (1%) 295:300 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	23:28 (1%) 288:293 (1%)	view
6	x 2	rag rag	augment.ipynb augment.ipynb	43:48 (1%) 537:542 (1%)	view