apache / hudi-rs - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

17% duplication:

9,852 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,758 duplicated lines

1,211 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
crates (5%) --> python (60%)	954	96 file pairs	details...
ROOT (22%) --> crates (<1%)	96	9 file pairs	details...
ROOT (19%) --> python (5%)	80	6 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,211 duplicates...

Size	#	Folders	Files	Lines	Code
22	x 2	crates/core/src/config crates/core/src/config	internal.rs read.rs	1:25 (64%) 1:25 (52%)	view
21	x 2	crates/core/src/config crates/core/src/config	internal.rs table.rs	1:23 (61%) 1:23 (11%)	view
21	x 2	crates/core/src/file_group/log_file crates/core/src/timeline	reader.rs selector.rs	1:22 (7%) 1:21 (4%)	view
21	x 2	crates/core/src/config crates/core/src/config	read.rs table.rs	1:23 (50%) 1:23 (11%)	view
21	x 2	crates/core/src/file_group crates/core/src/file_group/log_file	base_file.rs mod.rs	1:21 (31%) 1:21 (19%)	view
20	x 2	crates/core/src/file_group/log_file crates/core/src/metadata	log_format.rs meta_field.rs	1:20 (14%) 1:20 (45%)	view
20	x 2	crates/core/src/table crates/core/src/timeline	partition.rs selector.rs	1:20 (7%) 1:20 (4%)	view
20	x 2	crates/core/src/file_group/log_file crates/core/src/table	reader.rs partition.rs	1:21 (7%) 1:20 (7%)	view
19	x 2	crates/core/src/file_group crates/core/src/file_group/log_file	file_slice.rs log_block.rs	1:19 (10%) 1:20 (6%)	view
19	x 2	crates/core/src/file_group crates/core/src/file_group/log_file	base_file.rs log_block.rs	1:19 (28%) 1:20 (6%)	view
19	x 2	crates/core/src/file_group crates/core/src/file_group	base_file.rs file_slice.rs	1:19 (28%) 1:19 (10%)	view
19	x 2	crates/core/src/file_group crates/core/src/file_group/log_file	file_slice.rs mod.rs	1:19 (10%) 1:19 (17%)	view
19	x 2	crates/core/src/file_group/log_file crates/core/src/metadata	log_block.rs meta_field.rs	1:20 (6%) 1:19 (43%)	view
19	x 2	crates/core/src/file_group crates/core/src/metadata	file_slice.rs meta_field.rs	1:19 (10%) 1:19 (43%)	view
19	x 2	crates/core/src/expr crates/core/src/metadata	filter.rs meta_field.rs	1:20 (7%) 1:19 (43%)	view
19	x 2	crates/core/src/config crates/core/src/storage	read.rs mod.rs	1:21 (45%) 1:21 (36%)	view
19	x 2	crates/core/src/config crates/core/src/storage	internal.rs mod.rs	1:21 (55%) 1:21 (36%)	view
19	x 2	crates/core/src/file_group crates/core/src/file_group/log_file	builder.rs mod.rs	1:19 (5%) 1:19 (17%)	view
19	x 2	crates/core/src/file_group crates/core/src/file_group/log_file	base_file.rs log_format.rs	1:19 (28%) 1:19 (13%)	view
19	x 2	crates/core/src/expr crates/core/src/file_group	filter.rs builder.rs	1:20 (7%) 1:19 (5%)	view
19	x 2	crates/core/src/expr crates/core/src/file_group/log_file	filter.rs mod.rs	1:20 (7%) 1:19 (17%)	view
19	x 2	crates/core/src/file_group/log_file crates/core/src/file_group/log_file	log_block.rs log_format.rs	1:20 (6%) 1:19 (13%)	view
19	x 2	crates/core/src/file_group/log_file crates/core/src/file_group/log_file	log_block.rs mod.rs	1:20 (6%) 1:19 (17%)	view
19	x 2	crates/core/src/file_group crates/core/src/file_group	builder.rs file_slice.rs	1:19 (5%) 1:19 (10%)	view
19	x 2	crates/core/src/file_group crates/core/src/file_group/log_file	builder.rs log_format.rs	1:19 (5%) 1:19 (13%)	view
19	x 2	crates/core/src crates/core/src/merge	error.rs record_merger.rs	1:19 (31%) 1:19 (6%)	view
19	x 2	crates/core/src/expr crates/core/src/file_group/log_file	filter.rs log_format.rs	1:20 (7%) 1:19 (13%)	view
19	x 2	crates/core/src/file_group crates/core/src/file_group/log_file	builder.rs log_block.rs	1:19 (5%) 1:20 (6%)	view
19	x 2	crates/core/src/file_group crates/core/src/metadata	builder.rs meta_field.rs	1:19 (5%) 1:19 (43%)	view
19	x 2	crates/core/src/expr crates/core/src/file_group	filter.rs base_file.rs	1:20 (7%) 1:19 (28%)	view
19	x 2	crates/core/src/file_group/log_file crates/core/src/file_group/log_file	log_format.rs mod.rs	1:19 (13%) 1:19 (17%)	view
19	x 2	crates/core/src/file_group/log_file crates/core/src/metadata	mod.rs meta_field.rs	1:19 (17%) 1:19 (43%)	view
19	x 2	crates/core/src/expr crates/core/src/file_group/log_file	filter.rs log_block.rs	1:20 (7%) 1:20 (6%)	view
19	x 2	crates/core/src/file_group crates/core/src/file_group/log_file	file_slice.rs log_format.rs	1:19 (10%) 1:19 (13%)	view
19	x 2	crates/core/src/expr crates/core/src/file_group	filter.rs file_slice.rs	1:20 (7%) 1:19 (10%)	view
19	x 2	crates/core/src/file_group crates/core/src/metadata	base_file.rs meta_field.rs	1:19 (28%) 1:19 (43%)	view
19	x 2	crates/core/src/file_group crates/core/src/file_group	base_file.rs builder.rs	1:19 (28%) 1:19 (5%)	view
19	x 2	crates/core/src/config crates/core/src/storage	table.rs mod.rs	1:21 (10%) 1:21 (36%)	view
18	x 2	crates/core/src/table crates/core/src/table	fs_view.rs listing.rs	1:18 (9%) 1:18 (9%)	view
18	x 2	crates/core/src/storage crates/core/src/util	error.rs arrow.rs	1:18 (47%) 1:18 (15%)	view
18	x 2	crates/core/src/file_group/log_file crates/core/src/merge	avro.rs record_merger.rs	1:18 (39%) 1:18 (5%)	view
18	x 2	crates/core/src/metadata crates/datafusion/src	mod.rs lib.rs	1:18 (66%) 1:18 (4%)	view
18	x 2	crates/core/src/table crates/datafusion/src	listing.rs lib.rs	1:18 (9%) 1:18 (4%)	view
18	x 2	crates/core/src/table crates/core/src/timeline	mod.rs instant.rs	1:18 (1%) 1:18 (6%)	view
18	x 2	crates/core/src/config crates/core/src/file_group	read.rs mod.rs	1:18 (42%) 1:18 (8%)	view
18	x 2	crates/core/src/file_group crates/core/src/metadata	reader.rs meta_field.rs	1:18 (6%) 1:18 (40%)	view
18	x 2	crates/core/src/file_group/log_file python/src	log_block.rs lib.rs	1:18 (6%) 1:18 (78%)	view
18	x 2	crates/core/src/expr crates/core/src/storage	mod.rs reader.rs	1:18 (19%) 1:18 (47%)	view
18	x 2	crates/core/src/util python/src	mod.rs internal.rs	1:18 (94%) 1:18 (3%)	view
18	x 2	crates/core/src/table python/src	builder.rs internal.rs	1:18 (6%) 1:18 (3%)	view