spotify / voyager - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

76% duplication:

8,083 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
6,171 duplicated lines

178 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
cpp (100%) --> python (73%)	5760	14 file pairs	details...
java (2%) --> python (<1%)	62	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 178 duplicates...

Size	#	Folders	Files	Lines	Code
1027	x 2	cpp/src python/src/cpp/src	hnswalg.h hnswalg.h	41:1517 (100%) 41:1517 (100%)	view
476	x 2	cpp/src python/src/cpp/src	TypedIndex.h TypedIndex.h	39:783 (100%) 39:783 (100%)	view
336	x 2	cpp/src python/src/cpp/src	E4M3.h E4M3.h	26:419 (100%) 26:419 (100%)	view
203	x 2	cpp/src python/src/cpp/src	array_utils.h array_utils.h	38:337 (100%) 38:337 (100%)	view
181	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	Euclidean.h Euclidean.h	28:287 (100%) 28:287 (100%)	view
103	x 2	cpp/src python/src/cpp/src	StreamUtils.h StreamUtils.h	33:178 (100%) 33:178 (100%)	view
90	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	InnerProduct.h InnerProduct.h	28:157 (36%) 28:157 (36%)	view
82	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	InnerProduct.h InnerProduct.h	279:385 (33%) 279:385 (33%)	view
77	x 2	cpp/src python/src/cpp/src	Metadata.h Metadata.h	28:142 (100%) 28:142 (100%)	view
76	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	InnerProduct.h InnerProduct.h	159:277 (30%) 159:277 (30%)	view
53	x 2	cpp/src python/src/cpp/src	std_utils.h std_utils.h	41:141 (100%) 41:141 (100%)	view
50	x 2	cpp/src python/src/cpp/src	visited_list_pool.h visited_list_pool.h	30:100 (100%) 30:100 (100%)	view
49	x 2	cpp/src python/src/cpp/src	Index.h Index.h	45:110 (100%) 45:110 (100%)	view
47	x 2	java java	com_spotify_voyager_jni_Index.cpp com_spotify_voyager_jni_Index.cpp	799:853 (7%) 863:917 (7%)	view
36	x 2	cpp/src python/src/cpp/src	Enums.h Enums.h	8:61 (100%) 8:61 (100%)	view
35	x 2	python/src python/src	bindings.cpp bindings.cpp	969:1011 (4%) 1041:1082 (4%)	view
29	x 2	cpp/src python/src/cpp/src	hnswlib.h hnswlib.h	67:107 (100%) 67:107 (100%)	view
18	x 2	python/src/cpp/src/Spaces python/src/cpp/src/Spaces	Euclidean.h Euclidean.h	145:164 (9%) 152:171 (9%)	view
18	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	Euclidean.h Euclidean.h	145:164 (9%) 152:171 (9%)	view
18	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	Euclidean.h Euclidean.h	152:171 (9%) 145:164 (9%)	view
18	x 2	cpp/src/Spaces cpp/src/Spaces	Euclidean.h Euclidean.h	145:164 (9%) 152:171 (9%)	view
15	x 2	java java	com_spotify_voyager_jni_Index.cpp com_spotify_voyager_jni_Index.cpp	928:945 (2%) 954:970 (2%)	view
14	x 2	cpp/src cpp/src	hnswalg.h hnswalg.h	218:234 (1%) 313:329 (1%)	view
14	x 2	cpp/src python/src/cpp/src	hnswalg.h hnswalg.h	313:329 (1%) 218:234 (1%)	view
14	x 2	cpp/src python/src/cpp/src	TypedIndex.h TypedIndex.h	576:594 (2%) 614:632 (2%)	view
14	x 2	python/src/cpp/src python/src/cpp/src	TypedIndex.h TypedIndex.h	576:594 (2%) 614:632 (2%)	view
14	x 2	python/src/cpp/src python/src/cpp/src	hnswalg.h hnswalg.h	218:234 (1%) 313:329 (1%)	view
14	x 2	cpp/src python/src/cpp/src	hnswalg.h hnswalg.h	218:234 (1%) 313:329 (1%)	view
14	x 2	cpp/src python/src/cpp/src	TypedIndex.h TypedIndex.h	614:632 (2%) 576:594 (2%)	view
14	x 2	cpp/src cpp/src	TypedIndex.h TypedIndex.h	576:594 (2%) 614:632 (2%)	view
13	x 2	cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	143:157 (5%) 263:277 (5%)	view
13	x 2	python/src/cpp/src/Spaces python/src/cpp/src/Spaces	InnerProduct.h InnerProduct.h	143:157 (5%) 263:277 (5%)	view
13	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	InnerProduct.h InnerProduct.h	143:157 (5%) 263:277 (5%)	view
13	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	InnerProduct.h InnerProduct.h	263:277 (5%) 143:157 (5%)	view
12	x 2	benchmarks benchmarks	index_creation.py index_query.py	41:54 (35%) 45:58 (23%)	view
12	x 2	python/src/cpp/src/Spaces python/src/cpp/src/Spaces	Euclidean.h Euclidean.h	145:157 (6%) 159:171 (6%)	view
12	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	Euclidean.h Euclidean.h	145:157 (6%) 159:171 (6%)	view
12	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	Euclidean.h Euclidean.h	159:171 (6%) 145:157 (6%)	view
12	x 2	python/src/cpp/src/Spaces python/src/cpp/src/Spaces	InnerProduct.h InnerProduct.h	95:110 (4%) 229:244 (4%)	view
12	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	Space.h Space.h	27:48 (100%) 27:48 (100%)	view
12	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	InnerProduct.h InnerProduct.h	95:110 (4%) 229:244 (4%)	view
12	x 2	cpp/src/Spaces cpp/src/Spaces	Euclidean.h Euclidean.h	145:157 (6%) 159:171 (6%)	view
12	x 2	cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	95:110 (4%) 229:244 (4%)	view
12	x 2	cpp/src/Spaces python/src/cpp/src/Spaces	InnerProduct.h InnerProduct.h	229:244 (4%) 95:110 (4%)	view
12	x 2	java python/src	JavaInputStream.h PythonInputStream.h	125:136 (14%) 180:191 (10%)	view
11	x 2	python/src/cpp/src python/src/cpp/src	hnswalg.h hnswalg.h	621:632 (1%) 1443:1454 (1%)	view
11	x 2	cpp/src python/src/cpp/src	hnswalg.h hnswalg.h	621:632 (1%) 1443:1454 (1%)	view
11	x 2	cpp/src python/src/cpp/src	TypedIndex.h TypedIndex.h	693:706 (2%) 671:683 (2%)	view
11	x 2	cpp/src cpp/src	hnswalg.h hnswalg.h	621:632 (1%) 1443:1454 (1%)	view
11	x 2	cpp/src cpp/src	TypedIndex.h TypedIndex.h	671:683 (2%) 693:706 (2%)	view

Duplicated Units

The list of top 50 duplicated units.

See data for all 58 unit duplicates...

Size	#	Folders	Files	Lines	Code
192	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	725:955 725:955	view
110	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	1280:1418 1280:1418	view
96	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	466:598 466:598	view
70	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	1105:1195 1105:1195	view
60	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	1197:1268 1197:1268	view
40	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	133:184 133:184	view
38	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	397:440 397:440	view
38	x 2	python/src/cpp/src cpp/src	std_utils.h std_utils.h	42:94 42:94	view
38	x 2	python/src/cpp/src cpp/src	array_utils.h array_utils.h	83:134 83:134	view
34	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	Euclidean.h Euclidean.h	133:176 133:176	view
33	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	85:129 85:129	view
32	x 2	python/src/cpp/src cpp/src	array_utils.h array_utils.h	137:178 137:178	view
31	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	256:295 256:295	view
30	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	1485:1516 1485:1516	view
26	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	654:690 654:690	view
26	x 2	python/src/cpp/src cpp/src	TypedIndex.h TypedIndex.h	253:285 253:285	view
23	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	696:723 696:723	view
23	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	Euclidean.h Euclidean.h	100:129 100:129	view
22	x 2	python/src/cpp/src cpp/src	array_utils.h array_utils.h	227:250 227:250	view
21	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	221:252 221:252	view
20	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	Euclidean.h Euclidean.h	68:95 68:95	view
18	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	959:980 959:980	view
18	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	190:217 190:217	view
17	x 2	python/src/cpp/src cpp/src	std_utils.h std_utils.h	118:142 118:142	view
17	x 2	python/src/cpp/src cpp/src	array_utils.h array_utils.h	199:223 199:223	view
16	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	Euclidean.h Euclidean.h	193:213 193:213	view
16	x 2	python/src/cpp/src cpp/src	array_utils.h array_utils.h	286:304 286:304	view
16	x 2	python/src/cpp/src cpp/src	array_utils.h array_utils.h	314:338 314:338	view
15	x 2	java python/src	JavaInputStream.h PythonInputStream.h	124:140 179:195	view
13	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	993:1009 993:1009	view
12	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	37:52 37:52	view
12	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	Euclidean.h Euclidean.h	37:52 37:52	view
12	x 2	python/src/cpp/src cpp/src	array_utils.h array_utils.h	181:196 181:196	view
11	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	68:80 68:80	view
11	x 2	python/src/cpp/src cpp/src	array_utils.h array_utils.h	254:266 254:266	view
11	x 2	python/src/cpp/src cpp/src	array_utils.h array_utils.h	270:282 270:282	view
11	x 2	python/src/cpp/src cpp/src	StreamUtils.h StreamUtils.h	79:91 79:91	view
10	x 2	python/src/cpp/src cpp/src	Enums.h Enums.h	28:39 28:39	view
10	x 2	python/src/cpp/src cpp/src	Enums.h Enums.h	41:52 41:52	view
10	x 2	python/src/cpp/src cpp/src	TypedIndex.h TypedIndex.h	194:206 194:206	view
9	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	1018:1029 1018:1029	view
9	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	1037:1047 1037:1047	view
9	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	1067:1077 1067:1077	view
8	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	300:310 300:310	view
8	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	312:324 312:324	view
7	x 2	python/src/cpp/src cpp/src	hnswalg.h hnswalg.h	1270:1278 1270:1278	view
7	x 2	python/src/cpp/src cpp/src	Metadata.h Metadata.h	74:82 74:82	view
7	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	InnerProduct.h InnerProduct.h	56:64 56:64	view
7	x 2	python/src/cpp/src/Spaces cpp/src/Spaces	Euclidean.h Euclidean.h	180:189 180:189	view
7	x 2	python/src/cpp/src cpp/src	TypedIndex.h TypedIndex.h	486:496 486:496	view