apache / incubator-hugegraph-ai

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

15% duplication:

11,619 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
1,769 duplicated lines

252 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
hugegraph-llm (<1%) --> hugegraph-ml (<1%)	56	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 252 duplicates...

Size	#	Folders	Files	Lines	Code
33	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	322:358 (3%) 833:869 (3%)	view
29	x 2	hugegraph-ml/src/hugegraph_ml/models hugegraph-ml/src/hugegraph_ml/models	seal.py seal.py	91:122 (5%) 224:256 (5%)	view
21	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	openai.py openai.py	68:91 (13%) 103:126 (13%)	view
18	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	54:71 (1%) 425:442 (1%)	view
16	x 2	hugegraph-llm/src/hugegraph_llm/models/embeddings hugegraph-llm/src/hugegraph_llm/models/embeddings	base.py base.py	33:50 (33%) 71:88 (33%)	view
16	x 2	hugegraph-llm hugegraph-ml	pyproject.toml pyproject.toml	1:16 (20%) 1:16 (84%)	view
14	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	705:718 (1%) 718:731 (1%)	view
14	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	249:265 (1%) 322:338 (1%)	view
14	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	504:517 (1%) 608:621 (1%)	view
14	x 2	hugegraph-ml/src/hugegraph_ml/tasks hugegraph-ml/src/hugegraph_ml/tasks	fraud_detector_caregnn.py link_prediction_pgnn.py	28:43 (16%) 31:45 (22%)	view
14	x 2	hugegraph-ml/src/hugegraph_ml/models hugegraph-ml/src/hugegraph_ml/models	seal.py seal.py	144:171 (2%) 284:307 (2%)	view
14	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	249:265 (1%) 833:849 (1%)	view
13	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	ollama.py ollama.py	48:60 (12%) 74:86 (12%)	view
13	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	ollama.py qianfan.py	105:120 (12%) 85:99 (15%)	view
13	x 2	hugegraph-ml/src/hugegraph_ml/tasks hugegraph-ml/src/hugegraph_ml/tasks	node_classify.py node_classify_with_edge.py	49:62 (19%) 57:70 (15%)	view
12	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	litellm.py litellm.py	60:72 (8%) 114:126 (8%)	view
12	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	474:485 (1%) 566:577 (1%)	view
12	x 2	hugegraph-python-client/src/pyhugegraph/structure hugegraph-python-client/src/pyhugegraph/structure	edge_label_data.py vertex_label_data.py	27:41 (23%) 25:39 (27%)	view
12	x 2	hugegraph-llm hugegraph-python-client	setup.py setup.py	36:47 (50%) 36:47 (52%)	view
12	x 2	hugegraph-llm hugegraph-ml	setup.py setup.py	36:47 (50%) 35:46 (50%)	view
12	x 2	hugegraph-ml hugegraph-python-client	setup.py setup.py	35:46 (50%) 36:47 (52%)	view
12	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	733:744 (1%) 746:757 (1%)	view
11	x 2	hugegraph-python-client/src/pyhugegraph/api hugegraph-python-client/src/pyhugegraph/api	auth.py auth.py	36:46 (6%) 60:70 (6%)	view
11	x 2	hugegraph-ml/src/hugegraph_ml/tasks hugegraph-ml/src/hugegraph_ml/tasks	node_classify.py node_classify_with_edge.py	30:41 (16%) 30:41 (13%)	view
11	x 2	hugegraph-ml/src/hugegraph_ml/data hugegraph-ml/src/hugegraph_ml/data	hugegraph2dgl.py hugegraph2dgl.py	294:305 (2%) 346:357 (2%)	view
11	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	522:532 (1%) 634:644 (1%)	view
11	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	440:452 (1%) 531:543 (1%)	view
11	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	litellm.py litellm.py	91:101 (7%) 147:157 (7%)	view
11	x 2	hugegraph-python-client/src/pyhugegraph/api hugegraph-python-client/src/pyhugegraph/api	auth.py auth.py	145:155 (6%) 169:179 (6%)	view
11	x 2	hugegraph-python-client/src/pyhugegraph/structure hugegraph-python-client/src/pyhugegraph/structure	edge_data.py vertex_data.py	28:42 (29%) 24:38 (52%)	view
10	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	508:517 (1%) 916:925 (1%)	view
10	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	litellm.py openai.py	55:65 (7%) 56:66 (6%)	view
10	x 2	hugegraph-llm/src/hugegraph_llm/operators hugegraph-llm/src/hugegraph_llm/operators	gremlin_generate_task.py kg_construction_task.py	46:55 (22%) 46:55 (16%)	view
10	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	461:471 (1%) 550:561 (1%)	view
10	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	litellm.py qianfan.py	140:150 (7%) 89:99 (12%)	view
10	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	ollama.py openai.py	109:120 (9%) 169:180 (6%)	view
10	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	706:715 (1%) 745:754 (1%)	view
10	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	openai.py openai.py	152:162 (6%) 189:201 (6%)	view
10	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	litellm.py litellm.py	67:76 (7%) 96:105 (7%)	view
10	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	litellm.py openai.py	84:94 (7%) 91:101 (6%)	view
10	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	litellm.py ollama.py	140:150 (7%) 109:120 (9%)	view
10	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	719:728 (1%) 745:754 (1%)	view
10	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	litellm.py openai.py	140:150 (7%) 169:180 (6%)	view
10	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	612:621 (1%) 916:925 (1%)	view
10	x 2	hugegraph-llm/src/hugegraph_llm/models/llms hugegraph-llm/src/hugegraph_llm/models/llms	openai.py qianfan.py	169:180 (6%) 89:99 (12%)	view
9	x 2	hugegraph-llm/src/hugegr...m/operators/document_op hugegraph-llm/src/hugegraph_llm/operators/llm_op	word_extract.py keyword_extract.py	40:49 (20%) 47:56 (15%)	view
9	x 2	hugegraph-llm/src/hugegraph_llm/operators/llm_op hugegraph-llm/src/hugegraph_llm/operators/llm_op	unstructured_data_utils.py unstructured_data_utils.py	101:109 (8%) 125:133 (8%)	view
9	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	720:728 (<1%) 733:741 (<1%)	view
9	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	98:107 (<1%) 482:491 (<1%)	view
9	x 2	hugegraph-ml/src/hugegraph_ml/utils hugegraph-ml/src/hugegraph_ml/utils	dgl2hugegraph_utils.py dgl2hugegraph_utils.py	125:133 (<1%) 206:214 (<1%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
8	x 2	hugegraph-llm/src/hugegraph_llm/operators hugegraph-llm/src/hugegraph_llm/operators	gremlin_generate_task.py kg_construction_task.py	0:0 0:0	view