Duplication · Netflix/clove

Duplication Overall

4% duplication:

8,380 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
365 duplicated lines

29 duplicates

dependency graphs: 2D graph | 2D graph (with duplicates)... | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 29 longest duplicates.

See data for all 29 duplicates...

Size	#	Folders	Files	Lines	Code
13	x 2	src/open_clip src/open_clip	clip_model.py clip_model.py	15:28 (6%) 98:110 (6%)	view
12	x 2	src/open_clip src/open_clip	clip_model.py clip_model.py	80:94 (5%) 141:155 (5%)	view
10	x 2	src/open_clip src/open_clip	factory.py factory.py	451:461 (2%) 510:520 (2%)	view
9	x 2	src/open_clip src/open_clip	pretrained.py pretrained.py	131:139 (1%) 187:195 (1%)	view
9	x 2	src/open_clip src/open_clip	factory.py factory.py	199:207 (2%) 431:439 (2%)	view
8	x 2	src/open_clip src/open_clip	transformer.py transformer.py	190:197 (1%) 246:253 (1%)	view
8	x 2	src/open_clip src/open_clip	transformer.py transformer.py	608:615 (1%) 730:737 (1%)	view
8	x 2	src/open_clip src/open_clip	transformer.py transformer.py	636:643 (1%) 758:765 (1%)	view
8	x 2	src/training src/training	train.py train.py	150:160 (2%) 197:206 (2%)	view
7	x 2	src/training src/training	profiler.py profiler.py	26:32 (3%) 46:52 (3%)	view
7	x 2	src/training src/training	profiler.py profiler.py	27:33 (3%) 66:72 (3%)	view
7	x 2	src/open_clip src/open_clip	clip_model.py clip_model.py	41:49 (3%) 115:123 (3%)	view
7	x 2	src/open_clip src/open_clip	pretrained.py pretrained.py	70:76 (1%) 85:91 (1%)	view
7	x 2	src/open_clip src/open_clip	pretrained.py pretrained.py	95:101 (1%) 104:110 (1%)	view
7	x 2	src/open_clip src/open_clip	factory.py factory.py	199:205 (1%) 491:497 (1%)	view
7	x 2	src/open_clip src/open_clip	factory.py factory.py	431:437 (1%) 491:497 (1%)	view
7	x 2	src/open_clip src/open_clip	coca_model.py coca_model.py	191:197 (1%) 301:307 (1%)	view
7	x 2	src/open_clip src/open_clip	clip_model.py coca_model.py	85:94 (3%) 170:179 (1%)	view
7	x 2	src/open_clip src/open_clip	clip_model.py coca_model.py	146:155 (3%) 170:179 (1%)	view
6	x 2	src/open_clip src/open_clip	transformer.py transformer.py	218:223 (<1%) 231:236 (<1%)	view
6	x 2	src/open_clip src/open_clip	transformer.py transformer.py	399:404 (<1%) 416:421 (<1%)	view
6	x 2	src/training src/training	profiler.py profiler.py	47:52 (3%) 66:71 (3%)	view
6	x 2	src/training src/training	profiler.py profiler.py	55:60 (3%) 74:79 (3%)	view
6	x 2	src/open_clip src/open_clip	factory.py factory.py	392:397 (1%) 401:406 (1%)	view
6	x 2	src/open_clip src/open_clip	factory.py factory.py	400:405 (1%) 411:416 (1%)	view
6	x 2	src/training src/training	__main__.py __main__.py	257:262 (1%) 638:643 (1%)	view
6	x 2	src/open_clip src/open_clip	push_to_hf_hub.py push_to_hf_hub.py	100:105 (2%) 170:175 (2%)	view
6	x 2	src/training src/training	zero_shot.py zero_shot.py	295:302 (1%) 384:391 (1%)	view
6	x 2	src/training src/training	collate.py collate.py	25:30 (8%) 47:52 (8%)	view

Most Frequent Duplicates

The list of 5 most frequently found duplicates.

Size	#	Folders	Files	Lines	Code
6	x 3	src/open_clip src/open_clip src/open_clip	factory.py factory.py factory.py	199:204 (1%) 431:436 (1%) 491:496 (1%)	view
6	x 3	src/open_clip src/open_clip src/open_clip	clip_model.py coca_model.py clip_model.py	85:93 (2%) 170:178 (1%) 146:154 (2%)	view
6	x 3	src/open_clip src/open_clip src/open_clip	clip_model.py coca_model.py clip_model.py	86:94 (2%) 171:179 (1%) 147:155 (2%)	view
6	x 3	src/training src/training src/training	profiler.py profiler.py profiler.py	27:32 (3%) 47:52 (3%) 66:71 (3%)	view
6	x 3	src/open_clip src/open_clip src/open_clip	factory.py factory.py factory.py	200:205 (1%) 432:437 (1%) 492:497 (1%)	view

About This Analysis

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:

Avoid Repetition, MartinFlower.com (IEEE Software article)
Refactoring duplicated code, sourcemaking.com
Beck Design Rules, MartinFowler.com
DRY (Don't Repeat Yourself) Principle, Wikipedia
The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:

"Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"

Reducing Coupling, MartinFlower.com (IEEE Software article):

"There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."