netflix / iceberg-python

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

11% duplication:

19,088 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
2,262 duplicated lines

321 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 321 duplicates...

Size	#	Folders	Files	Lines	Code
115	x 2	ROOT ROOT	pyproject.toml pyproject.toml	121:273 (27%) 352:504 (27%)	view
53	x 2	pyiceberg pyiceberg	manifest.py manifest.py	141:193 (6%) 223:275 (6%)	view
25	x 2	pyiceberg/catalog pyiceberg/catalog	glue.py hive.py	71:102 (5%) 87:117 (5%)	view
24	x 2	pyiceberg/avro pyiceberg/io	resolver.py pyarrow.py	79:104 (7%) 140:169 (1%)	view
23	x 2	pyiceberg pyiceberg/utils	schema.py schema_conversion.py	36:64 (2%) 26:51 (9%)	view
23	x 2	pyiceberg/io pyiceberg	pyarrow.py schema.py	142:177 (1%) 37:66 (2%)	view
22	x 2	pyiceberg/avro pyiceberg	resolver.py schema.py	81:104 (6%) 37:64 (2%)	view
22	x 2	pyiceberg/avro pyiceberg/utils	resolver.py schema_conversion.py	81:104 (6%) 27:51 (8%)	view
22	x 2	pyiceberg/io pyiceberg/utils	pyarrow.py schema_conversion.py	142:169 (1%) 27:51 (8%)	view
20	x 2	pyiceberg pyiceberg	manifest.py manifest.py	115:134 (2%) 205:224 (2%)	view
18	x 2	pyiceberg/table pyiceberg/table	inspect.py inspect.py	102:122 (3%) 531:550 (3%)	view
16	x 2	ROOT ROOT	pyproject.toml ruff.toml	1:16 (3%) 1:16 (21%)	view
16	x 2	pyiceberg/catalog pyiceberg/catalog	dynamodb.py dynamodb.py	661:677 (3%) 701:717 (3%)	view
15	x 2	pyiceberg/catalog pyiceberg/catalog	sql.py sql.py	219:234 (3%) 256:271 (3%)	view
15	x 2	pyiceberg/table pyiceberg/table	metadata.py metadata.py	480:498 (4%) 524:542 (4%)	view
15	x 2	pyiceberg/table pyiceberg/table	inspect.py inspect.py	171:186 (2%) 595:609 (2%)	view
15	x 2	pyiceberg/table pyiceberg/table	__init__.py __init__.py	450:469 (1%) 561:580 (1%)	view
14	x 2	pyiceberg/catalog pyiceberg	glue.py schema.py	87:102 (2%) 52:66 (1%)	view
14	x 2	pyiceberg/io pyiceberg/io	pyarrow.py pyarrow.py	394:414 (<1%) 441:461 (<1%)	view
14	x 2	pyiceberg/catalog pyiceberg/io	glue.py pyarrow.py	87:102 (2%) 157:177 (<1%)	view
14	x 2	pyiceberg/catalog pyiceberg	hive.py schema.py	102:117 (2%) 52:66 (1%)	view
14	x 2	pyiceberg/catalog pyiceberg/io	hive.py pyarrow.py	102:117 (2%) 157:177 (<1%)	view
13	x 2	pyiceberg/avro pyiceberg/catalog	resolver.py hive.py	92:104 (4%) 102:114 (2%)	view
13	x 2	pyiceberg/avro pyiceberg/catalog	resolver.py glue.py	92:104 (4%) 87:99 (2%)	view
13	x 2	pyiceberg/catalog pyiceberg/utils	glue.py schema_conversion.py	87:99 (2%) 39:51 (5%)	view
13	x 2	pyiceberg/catalog pyiceberg/utils	hive.py schema_conversion.py	102:114 (2%) 39:51 (5%)	view
13	x 2	pyiceberg/catalog pyiceberg/catalog	glue.py hive.py	170:187 (2%) 248:266 (2%)	view
12	x 2	pyiceberg/catalog pyiceberg/catalog	glue.py hive.py	50:62 (2%) 64:76 (2%)	view
12	x 2	pyiceberg/expressions pyiceberg/expressions	visitors.py visitors.py	233:250 (1%) 875:892 (1%)	view
12	x 2	pyiceberg/io pyiceberg/io	fsspec.py fsspec.py	233:248 (5%) 277:292 (5%)	view
12	x 2	pyiceberg/table pyiceberg/table	metadata.py metadata.py	607:618 (3%) 621:632 (3%)	view
12	x 2	pyiceberg pyiceberg/table	partitioning.py sorting.py	106:117 (4%) 97:108 (10%)	view
12	x 2	pyiceberg/table pyiceberg/table	inspect.py inspect.py	141:152 (2%) 558:569 (2%)	view
12	x 2	pyiceberg/expressions pyiceberg/expressions	visitors.py visitors.py	1238:1254 (1%) 1301:1317 (1%)	view
11	x 2	pyiceberg/expressions pyiceberg/expressions	visitors.py visitors.py	83:123 (<1%) 306:326 (<1%)	view
10	x 2	pyiceberg/expressions pyiceberg/expressions	visitors.py visitors.py	1216:1230 (<1%) 1238:1251 (<1%)	view
10	x 2	pyiceberg/catalog pyiceberg/catalog	rest.py rest.py	868:880 (1%) 894:906 (1%)	view
10	x 2	pyiceberg/io pyiceberg/io	__init__.py __init__.py	162:182 (5%) 209:229 (5%)	view
10	x 2	pyiceberg/catalog pyiceberg/catalog	glue.py hive.py	427:437 (2%) 394:404 (2%)	view
10	x 2	pyiceberg/catalog pyiceberg/catalog	dynamodb.py dynamodb.py	409:418 (1%) 454:463 (1%)	view
10	x 2	pyiceberg/catalog pyiceberg/catalog	dynamodb.py sql.py	144:172 (1%) 174:202 (2%)	view
10	x 2	pyiceberg/expressions pyiceberg/expressions	visitors.py visitors.py	1216:1230 (<1%) 1301:1314 (<1%)	view
9	x 2	pyiceberg/catalog pyiceberg/catalog	glue.py noop.py	399:407 (1%) 46:54 (12%)	view
9	x 2	pyiceberg/catalog pyiceberg/catalog	__init__.py rest.py	784:792 (1%) 623:631 (1%)	view
9	x 2	pyiceberg/catalog pyiceberg	glue.py conversions.py	77:87 (1%) 41:52 (5%)	view
9	x 2	pyiceberg/catalog pyiceberg/catalog	__init__.py rest.py	346:354 (1%) 602:610 (1%)	view
9	x 2	pyiceberg/catalog pyiceberg/catalog	glue.py hive.py	399:407 (1%) 367:375 (1%)	view
9	x 2	pyiceberg/catalog pyiceberg/catalog	__init__.py hive.py	346:354 (1%) 367:375 (1%)	view
9	x 2	pyiceberg pyiceberg/utils	conversions.py schema_conversion.py	40:51 (5%) 26:37 (3%)	view
9	x 2	pyiceberg/expressions pyiceberg	literals.py schema.py	35:43 (1%) 44:52 (<1%)	view