huggingface / huggingface

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

9% duplication:

17,572 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,730 duplicated lines

204 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 204 duplicates...

Size	#	Folders	Files	Lines	Code
49	x 2	src/huggingface_hub src/huggingface_hub	__init__.py __init__.py	378:426 (3%) 702:750 (3%)	view
35	x 2	src/huggingface_hub src/huggingface_hub	__init__.py __init__.py	300:334 (2%) 551:585 (2%)	view
25	x 2	src/huggingface_hub/commands src/huggingface_hub/utils	scan_cache.py _cache_manager.py	143:167 (25%) 542:566 (7%)	view
24	x 2	src/huggingface_hub src/huggingface_hub	__init__.py __init__.py	170:193 (1%) 798:821 (1%)	view
23	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	500:522 (1%) 525:548 (1%)	view
21	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1926:1947 (1%) 1956:1977 (1%)	view
21	x 2	src/huggingface_hub src/huggingface_hub	__init__.py __init__.py	213:233 (1%) 855:875 (1%)	view
21	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1866:1887 (1%) 1896:1917 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1897:1917 (1%) 2016:2036 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1987:2007 (1%) 2016:2036 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1897:1917 (1%) 1987:2007 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1867:1887 (1%) 1927:1947 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1957:1977 (1%) 2016:2036 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1957:1977 (1%) 1987:2007 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1927:1947 (1%) 2016:2036 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1867:1887 (1%) 1957:1977 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1897:1917 (1%) 1957:1977 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1897:1917 (1%) 1927:1947 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1867:1887 (1%) 1987:2007 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1927:1947 (1%) 1987:2007 (1%)	view
20	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	1867:1887 (1%) 2016:2036 (1%)	view
17	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	480:496 (1%) 506:522 (1%)	view
17	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	454:470 (1%) 480:496 (1%)	view
17	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	454:470 (1%) 506:522 (1%)	view
17	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	480:496 (1%) 532:548 (1%)	view
17	x 2	src/huggingface_hub src/huggingface_hub	__init__.py __init__.py	346:362 (1%) 634:650 (1%)	view
17	x 2	src/huggingface_hub/inference src/huggingface_hub/inference	_client.py _client.py	454:470 (1%) 532:548 (1%)	view
13	x 2	src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers	cohere.py together.py	19:32 (65%) 54:67 (20%)	view
13	x 2	src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers	cohere.py fireworks_ai.py	19:32 (65%) 15:27 (72%)	view
13	x 2	src/huggingface_hub/commands src/huggingface_hub/utils	scan_cache.py _cache_manager.py	169:181 (13%) 568:580 (3%)	view
13	x 2	src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers	fireworks_ai.py together.py	15:27 (72%) 54:67 (20%)	view
13	x 2	src/huggingface_hub/commands src/huggingface_hub/utils	scan_cache.py _cache_manager.py	129:141 (13%) 528:540 (3%)	view
12	x 2	src/huggingface_hub src/huggingface_hub	__init__.py __init__.py	288:299 (<1%) 533:544 (<1%)	view
11	x 2	src/huggingface_hub src/huggingface_hub	file_download.py file_download.py	1071:1081 (1%) 1222:1232 (1%)	view
11	x 2	src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers	_common.py hf_inference.py	212:228 (6%) 66:77 (7%)	view
11	x 2	src/huggingface_hub src/huggingface_hub	__init__.py __init__.py	243:253 (<1%) 899:909 (<1%)	view
10	x 2	src/huggingface_hub src/huggingface_hub	__init__.py __init__.py	258:267 (<1%) 923:932 (<1%)	view
10	x 2	src/huggingface_hub src/huggingface_hub	__init__.py __init__.py	435:444 (<1%) 773:782 (<1%)	view
10	x 2	src/huggingface_hub src/huggingface_hub	hf_file_system.py hf_file_system.py	1063:1072 (1%) 1085:1094 (1%)	view
9	x 2	src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers	featherless_ai.py nebius.py	25:33 (39%) 18:26 (15%)	view
9	x 2	src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers	nebius.py together.py	18:26 (15%) 39:47 (14%)	view
9	x 2	src/huggingface_hub src/huggingface_hub	_local_folder.py _local_folder.py	295:304 (4%) 369:378 (4%)	view
9	x 2	src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers	featherless_ai.py novita.py	25:33 (39%) 26:34 (19%)	view
9	x 2	src/huggingface_hub src/huggingface_hub	dataclasses.py dataclasses.py	272:280 (3%) 304:312 (3%)	view
9	x 2	src/huggingface_hub src/huggingface_hub	hf_file_system.py hf_file_system.py	1074:1082 (1%) 1096:1104 (1%)	view
9	x 2	src/huggingface_hub src/huggingface_hub	file_download.py file_download.py	1164:1172 (<1%) 1293:1301 (<1%)	view
9	x 2	src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers	novita.py together.py	26:34 (19%) 39:47 (14%)	view
9	x 2	src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers	nebius.py novita.py	18:26 (15%) 26:34 (19%)	view
9	x 2	src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers	featherless_ai.py together.py	25:33 (39%) 39:47 (14%)	view
9	x 2	src/huggingface_hub src/huggingface_hub	__init__.py __init__.py	94:102 (<1%) 762:770 (<1%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
7	x 3	src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers src/huggingface_hub/inference/_providers	featherless_ai.py together.py nebius.py	0:0 0:0 0:0	view