apache / fury - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

10% duplication:

68,185 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
6,949 duplicated lines

933 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
integration_tests (10%) --> java (<1%)	132	15 file pairs	details...
bazel (13%) --> rust (2%)	128	12 file pairs	details...
ROOT (96%) --> rust (2%)	112	6 file pairs	details...
python (<1%) --> rust (2%)	112	6 file pairs	details...
java (<1%) --> javascript (<1%)	50	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 933 duplicates...

Size	#	Folders	Files	Lines	Code
78	x 2	dart/example dart/packages/fury/example	example.g.dart example.g.dart	22:105 (100%) 22:105 (100%)	view
43	x 2	java/fury-core/src/main/.../apache/fury/serializer java/fury-core/src/main/.../apache/fury/serializer	AbstractObjectSerializer.java AbstractObjectSerializer.java	735:778 (5%) 785:828 (5%)	view
41	x 2	cpp/fury/benchmark cpp/fury/util	benchmark_string_util.cc string_util.cc	403:470 (15%) 442:509 (12%)	view
40	x 2	python/pyfury/includes python/pyfury	pxd libserialization.pxd type.py	26:65 (86%) 136:220 (13%)	view
29	x 2	java/fury-core/src/main/java/org/apache/fury/io java/fury-core/src/main/.../apache/fury/serializer	MemoryBufferObjectOutput.java ObjectStreamSerializer.java	61:106 (39%) 596:641 (4%)	view
28	x 2	python/pyfury python/pyfury	_serialization.pyx _serializer.py	2140:2170 (1%) 715:745 (4%)	view
27	x 2	bazel/arrow bazel/arrow	BUILD.tpl.bzl BUILD.windows.bzl	1:31 (54%) 1:31 (50%)	view
26	x 2	dart/packages/fury/lib/src/datatype dart/packages/fury/lib/src/datatype	float16.dart float32.dart	122:158 (29%) 75:111 (40%)	view
24	x 2	java/benchmark/src/main/...che/fury/benchmark/data java/benchmark/src/main/...che/fury/benchmark/data	Data.java Data.java	31:54 (31%) 58:81 (31%)	view
22	x 2	python/pyfury python/pyfury	serializer.py serializer.py	52:73 (4%) 76:97 (4%)	view
21	x 2	dart/packages/fury/lib/src/datatype dart/packages/fury/lib/src/datatype	int16.dart int32.dart	90:121 (30%) 90:121 (30%)	view
21	x 2	javascript/packages/fury/lib javascript/packages/fury/lib	typeInfo.ts typeInfo.ts	105:129 (4%) 159:183 (4%)	view
21	x 2	java/fury-core/src/main/...org/apache/fury/codegen java/fury-core/src/main/...org/apache/fury/codegen	Expression.java Expression.java	1100:1123 (1%) 1267:1290 (1%)	view
21	x 2	dart/packages/fury/lib/src/codegen/exception dart/packages/fury/lib/src/codegen/exception	constraint_violation_exception.dart field_exception.dart	48:72 (16%) 22:46 (51%)	view
20	x 2	dart/packages/fury/lib/src/datatype dart/packages/fury/lib/src/datatype	int32.dart int8.dart	90:120 (29%) 91:121 (29%)	view
20	x 2	javascript/packages/fury/lib javascript/packages/fury/lib	typeInfo.ts typeInfo.ts	350:376 (3%) 419:445 (3%)	view
20	x 2	java/fury-core/src/main/.../apache/fury/serializer java/fury-core/src/main/.../apache/fury/serializer	CompatibleSerializer.java Serializers.java	591:611 (4%) 151:171 (6%)	view
20	x 2	dart/packages/fury/lib/src/datatype dart/packages/fury/lib/src/datatype	int16.dart int8.dart	90:120 (29%) 91:121 (29%)	view
19	x 2	java/benchmark/src/main/proto javascript/benchmark	proto bench.proto sample.proto	1:20 (17%) 1:20 (34%)	view
19	x 2	javascript/packages/fury/lib javascript/packages/fury/lib	typeInfo.ts typeInfo.ts	324:347 (3%) 394:417 (3%)	view
19	x 2	python/pyfury python/pyfury	_fury.py _serialization.pyx	226:249 (4%) 664:687 (1%)	view
18	x 2	python/pyfury python/pyfury	_serialization.pyx _serializer.py	1790:1807 (<1%) 513:533 (2%)	view
18	x 2	java/fury-core/src/main/java/org/apache/fury java/fury-core/src/main/java/org/apache/fury	Fury.java Fury.java	1386:1403 (1%) 1450:1467 (1%)	view
18	x 2	java/fury-core/src/main/...org/apache/fury/builder java/fury-core/src/main/...org/apache/fury/builder	ObjectCodecBuilder.java ObjectCodecBuilder.java	257:276 (3%) 339:358 (3%)	view
17	x 2	python/pyfury python/pyfury	_util.pyx _util.pyx	392:408 (2%) 511:527 (2%)	view
17	x 2	rust/fury-derive rust/fury	Cargo.toml Cargo.toml	1:18 (50%) 1:19 (58%)	view
17	x 2	python/pyfury python/pyfury	_serialization.pyx _serializer.py	1939:1955 (<1%) 624:641 (2%)	view
17	x 2	dart/example dart/packages/fury/example	example.dart example.dart	20:46 (100%) 20:46 (100%)	view
17	x 2	java/fury-core/src/main/...org/apache/fury/builder java/fury-core/src/main/...org/apache/fury/builder	ObjectCodecBuilder.java ObjectCodecBuilder.java	634:650 (3%) 701:717 (3%)	view
17	x 2	java/fury-core/src/main/.../apache/fury/serializer java/fury-core/src/main/.../apache/fury/serializer	SerializationBinding.java SerializationBinding.java	257:279 (5%) 457:479 (5%)	view
17	x 2	rust/fury-core rust/fury-derive	Cargo.toml Cargo.toml	1:18 (47%) 1:18 (50%)	view
17	x 2	rust/fury-core rust/fury	Cargo.toml Cargo.toml	1:18 (47%) 1:19 (58%)	view
17	x 2	cpp/fury/util cpp/fury/util	string_util.cc string_util.cc	294:321 (5%) 376:404 (5%)	view
17	x 2	java/fury-core/src/main/...org/apache/fury/builder java/fury-core/src/main/...org/apache/fury/builder	CompatibleCodecBuilder.java CompatibleCodecBuilder.java	202:219 (2%) 224:241 (2%)	view
16	x 2	java/fury-format/src/mai...che/fury/format/encoder java/fury-format/src/mai...che/fury/format/encoder	ArrayDataForEach.java ArrayDataForEach.java	114:129 (15%) 145:160 (15%)	view
16	x 2	rust/fury-derive rust	Cargo.toml rust-toolchain.toml	1:16 (47%) 1:16 (84%)	view
16	x 2	rust rust	rust-toolchain.toml rustfmt.toml	1:16 (84%) 1:16 (88%)	view
16	x 2	ROOT rust	licenserc.toml Cargo.toml	1:16 (27%) 1:16 (44%)	view
16	x 2	ROOT rust/fury	licenserc.toml Cargo.toml	1:16 (27%) 1:16 (55%)	view
16	x 2	rust rust/fury	Cargo.toml Cargo.toml	1:16 (44%) 1:16 (55%)	view
16	x 2	rust/fury rust	Cargo.toml rust-toolchain.toml	1:16 (55%) 1:16 (84%)	view
16	x 2	ROOT rust	licenserc.toml rustfmt.toml	1:16 (27%) 1:16 (88%)	view
16	x 2	ROOT rust	licenserc.toml rust-toolchain.toml	1:16 (27%) 1:16 (84%)	view
16	x 2	bazel/arrow rust	BUILD.windows.bzl Cargo.toml	1:16 (29%) 1:16 (44%)	view
16	x 2	bazel/arrow bazel/arrow	BUILD.tpl.bzl BUILD.windows.bzl	38:56 (32%) 40:58 (29%)	view
16	x 2	bazel/arrow rust	BUILD.tpl.bzl rustfmt.toml	1:16 (32%) 1:16 (88%)	view
16	x 2	rust rust/fury-core	Cargo.toml Cargo.toml	1:16 (44%) 1:16 (44%)	view
16	x 2	bazel/arrow rust	BUILD.windows.bzl rustfmt.toml	1:16 (29%) 1:16 (88%)	view
16	x 2	rust/fury-core rust	Cargo.toml rustfmt.toml	1:16 (44%) 1:16 (88%)	view
16	x 2	ROOT rust/fury-core	licenserc.toml Cargo.toml	1:16 (27%) 1:16 (44%)	view

Duplicated Units

The list of top 15 duplicated units.

See data for all 15 unit duplicates...

Size	#	Folders	Files	Lines	Code
16	x 2	java/fury-core/src/main/...y/serializer/collection java/fury-core/src/main/...y/serializer/collection	UnmodifiableSerializers.java SynchronizedSerializers.java	58:77 58:75	view
10	x 2	go/fury go/fury	serializer.go slice.go	254:265 32:43	view
10	x 2	go/fury go/fury	serializer.go slice.go	288:299 72:83	view
9	x 2	java/fury-core/src/main/.../apache/fury/collection java/fury-core/src/main/.../apache/fury/collection	ObjectIntMap.java FuryObjectMap.java	95:105 182:192	view
9	x 2	dart/packages/fury/lib/src/codegen/exception dart/packages/fury/lib/src/codegen/exception	field_exception.dart constraint_violation_exception.dart	30:40 56:66	view
8	x 3	java/benchmark/src/main/...g/apache/fury/benchmark java/benchmark/src/main/...g/apache/fury/benchmark java/benchmark/src/main/...g/apache/fury/benchmark	UserTypeDeserializeSuite.java CopyBenchmark.java UserTypeSerializeSuite.java	132:141 85:94 142:151	view
7	x 7	java/benchmark/src/main/...g/apache/fury/benchmark java/benchmark/src/main/...g/apache/fury/benchmark java/benchmark/src/main/...g/apache/fury/benchmark java/benchmark/src/main/...g/apache/fury/benchmark java/benchmark/src/main/...g/apache/fury/benchmark java/benchmark/src/main/...g/apache/fury/benchmark java/benchmark/src/main/...g/apache/fury/benchmark	CollectionSuite.java NewStringSuite.java StructBenchmark.java MapSerializationSuite.java Benchmark.java MemorySuite.java ThreadPoolFurySuite.java	34:42 94:102 122:130 40:48 30:38 241:249 83:91	view
7	x 2	java/benchmark/src/main/...he/fury/benchmark/state integration_tests/graalv...org/apache/fury/graalvm	JDKState.java Benchmark.java	115:123 52:60	view
7	x 3	java/fury-core/src/main/...e/fury/serializer/scala java/fury-core/src/main/...e/fury/serializer/scala java/fury-core/src/main/...e/fury/serializer/scala	SingletonMapSerializer.java SingletonObjectSerializer.java SingletonCollectionSerializer.java	60:68 53:61 60:68	view
7	x 2	dart/packages/fury/example dart/example	example.dart example.dart	35:47 35:47	view
6	x 2	java/benchmark/src/main/...g/apache/fury/benchmark java/benchmark/src/main/...g/apache/fury/benchmark	MapSuite.java ArraySuite.java	38:45 234:241	view
6	x 2	java/fury-core/src/main/...e/fury/serializer/scala java/fury-core/src/main/...e/fury/serializer/scala	SingletonMapSerializer.java SingletonCollectionSerializer.java	42:49 42:49	view
6	x 2	java/fury-core/src/main/...y/serializer/collection java/fury-core/src/main/...y/serializer/collection	CollectionSerializers.java MapSerializers.java	740:749 434:443	view
6	x 2	integration_tests/graalv...org/apache/fury/graalvm integration_tests/graalv...org/apache/fury/graalvm	CompatibleExample.java ScopedCompatibleExample.java	44:52 45:52	view
6	x 2	integration_tests/graalv...che/fury/graalvm/record integration_tests/graalv...che/fury/graalvm/record	RecordExample.java RecordExample2.java	56:63 58:65	view