apache / iceberg-python

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

11% duplication:

19,917 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
2,344 duplicated lines

322 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 322 duplicates...

Size	#	Folders	Files	Lines	Code
115	x 2	ROOT ROOT	pyproject.toml pyproject.toml	123:275 (27%) 354:506 (27%)	view
53	x 2	pyiceberg pyiceberg	manifest.py manifest.py	142:194 (6%) 224:276 (6%)	view
27	x 2	pyiceberg/avro pyiceberg/io	resolver.py pyarrow.py	85:113 (7%) 141:174 (1%)	view
26	x 2	pyiceberg/io pyiceberg	pyarrow.py schema.py	143:184 (1%) 37:69 (2%)	view
25	x 2	pyiceberg/avro pyiceberg	resolver.py schema.py	87:113 (7%) 37:67 (2%)	view
22	x 2	pyiceberg/catalog pyiceberg/catalog	glue.py hive.py	71:97 (4%) 88:113 (4%)	view
20	x 2	pyiceberg pyiceberg	manifest.py manifest.py	116:135 (2%) 206:225 (2%)	view
18	x 2	pyiceberg/table pyiceberg/table	inspect.py inspect.py	102:122 (3%) 531:550 (3%)	view
18	x 2	pyiceberg pyiceberg/utils	schema.py schema_conversion.py	36:59 (1%) 26:46 (6%)	view
17	x 2	pyiceberg/io pyiceberg/utils	pyarrow.py schema_conversion.py	143:166 (<1%) 27:46 (6%)	view
17	x 2	pyiceberg/avro pyiceberg/utils	resolver.py schema_conversion.py	87:105 (4%) 27:46 (6%)	view
16	x 2	ROOT ROOT	pyproject.toml ruff.toml	1:16 (3%) 1:16 (21%)	view
16	x 2	pyiceberg/catalog pyiceberg/catalog	dynamodb.py dynamodb.py	661:677 (3%) 701:717 (3%)	view
15	x 2	pyiceberg/catalog pyiceberg/catalog	sql.py sql.py	219:234 (3%) 256:271 (3%)	view
15	x 2	pyiceberg/table pyiceberg/table	metadata.py metadata.py	480:498 (4%) 524:542 (4%)	view
15	x 2	pyiceberg/table pyiceberg/table	__init__.py __init__.py	459:478 (1%) 570:589 (1%)	view
15	x 2	pyiceberg/table pyiceberg/table	inspect.py inspect.py	171:186 (2%) 595:609 (2%)	view
14	x 2	pyiceberg/catalog pyiceberg/utils	hive.py schema_conversion.py	103:116 (2%) 39:52 (5%)	view
13	x 2	pyiceberg/catalog pyiceberg/catalog	glue.py hive.py	170:187 (2%) 259:277 (2%)	view
12	x 2	pyiceberg/catalog pyiceberg/catalog	glue.py hive.py	50:62 (2%) 65:77 (2%)	view
12	x 2	pyiceberg/expressions pyiceberg/expressions	visitors.py visitors.py	233:250 (1%) 875:892 (1%)	view
12	x 2	pyiceberg/table pyiceberg/table	metadata.py metadata.py	603:614 (3%) 617:628 (3%)	view
12	x 2	pyiceberg pyiceberg	transforms.py transforms.py	502:516 (1%) 664:678 (1%)	view
12	x 2	pyiceberg/io pyiceberg/io	fsspec.py fsspec.py	232:247 (5%) 276:291 (5%)	view
12	x 2	pyiceberg pyiceberg/table	partitioning.py sorting.py	106:117 (4%) 97:108 (10%)	view
12	x 2	pyiceberg/table pyiceberg/table	inspect.py inspect.py	141:152 (2%) 558:569 (2%)	view
12	x 2	pyiceberg pyiceberg	transforms.py transforms.py	502:516 (1%) 576:590 (1%)	view
12	x 2	pyiceberg pyiceberg	transforms.py transforms.py	576:590 (1%) 664:678 (1%)	view
12	x 2	pyiceberg/expressions pyiceberg/expressions	visitors.py visitors.py	1238:1254 (1%) 1301:1317 (1%)	view
11	x 2	pyiceberg/catalog pyiceberg/utils	glue.py schema_conversion.py	87:97 (2%) 39:49 (4%)	view
11	x 2	pyiceberg/expressions pyiceberg/expressions	visitors.py visitors.py	83:123 (<1%) 306:326 (<1%)	view
11	x 2	pyiceberg/io pyiceberg/io	pyarrow.py pyarrow.py	413:428 (<1%) 456:471 (<1%)	view
10	x 2	pyiceberg/expressions pyiceberg/expressions	visitors.py visitors.py	1216:1230 (<1%) 1238:1251 (<1%)	view
10	x 2	pyiceberg/catalog pyiceberg/catalog	glue.py hive.py	441:451 (2%) 405:415 (1%)	view
10	x 2	pyiceberg/io pyiceberg/io	__init__.py __init__.py	164:184 (5%) 211:231 (5%)	view
10	x 2	pyiceberg/catalog pyiceberg/catalog	dynamodb.py dynamodb.py	409:418 (1%) 454:463 (1%)	view
10	x 2	pyiceberg/catalog pyiceberg/catalog	dynamodb.py sql.py	144:172 (1%) 174:202 (2%)	view
10	x 2	pyiceberg/catalog/rest pyiceberg/catalog/rest	__init__.py __init__.py	860:872 (1%) 886:898 (1%)	view
10	x 2	pyiceberg/expressions pyiceberg/expressions	visitors.py visitors.py	1216:1230 (<1%) 1301:1314 (<1%)	view
9	x 2	pyiceberg/catalog pyiceberg	glue.py conversions.py	77:87 (1%) 43:54 (2%)	view
9	x 2	pyiceberg/catalog pyiceberg/catalog/rest	dynamodb.py __init__.py	144:152 (1%) 594:602 (1%)	view
9	x 2	pyiceberg/catalog pyiceberg/catalog	glue.py sql.py	413:421 (1%) 174:182 (1%)	view
9	x 2	pyiceberg/catalog pyiceberg/catalog	__init__.py hive.py	346:354 (1%) 378:386 (1%)	view
9	x 2	pyiceberg pyiceberg/utils	conversions.py schema_conversion.py	42:53 (2%) 26:37 (3%)	view
9	x 2	pyiceberg/catalog pyiceberg/catalog/rest	__init__.py __init__.py	373:381 (1%) 615:623 (1%)	view
9	x 2	pyiceberg/expressions pyiceberg	literals.py schema.py	35:43 (1%) 44:52 (<1%)	view
9	x 2	pyiceberg/catalog pyiceberg/catalog	hive.py noop.py	378:386 (1%) 46:54 (12%)	view
9	x 2	pyiceberg/catalog pyiceberg/catalog/rest	__init__.py __init__.py	784:792 (1%) 615:623 (1%)	view
9	x 2	pyiceberg/expressions pyiceberg/io	literals.py pyarrow.py	35:43 (1%) 151:159 (<1%)	view
9	x 2	pyiceberg/table pyiceberg/table	__init__.py __init__.py	930:938 (<1%) 1425:1433 (<1%)	view