alibaba / higress - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

27% duplication:

82,998 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
22,708 duplicated lines

16,000 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
helm (27%) --> hgctl (4%)	1413	8 file pairs	details...
api (17%) --> helm (14%)	762	3 file pairs	details...
api (15%) --> hgctl (2%)	664	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 16,000 duplicates...

Size	#	Folders	Files	Lines	Code
1392	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	181:1572 (19%) 1590:2981 (19%)	view
762	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	4244:5005 (10%) 5027:5788 (10%)	view
290	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	1618:1907 (4%) 2590:2879 (4%)	view
290	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	1181:1470 (4%) 1618:1907 (4%)	view
290	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	209:498 (4%) 2590:2879 (4%)	view
290	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	209:498 (4%) 1181:1470 (4%)	view
262	x 2	api/kubernetes helm/core/crds	customresourcedefinitions.gen.yaml customresourcedefinitions.gen.yaml	2:265 (83%) 2:265 (85%)	view
231	x 2	helm/core/crds hgctl/pkg/manifests/istiobase/crds	istio-envoyfilter.yaml crd-all.gen.yaml	7:237 (97%) 2997:3227 (3%)	view
178	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	6275:6452 (2%) 6457:6634 (2%)	view
169	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	3854:4022 (2%) 4027:4195 (2%)	view
166	x 2	plugins/wasm-go/mcp-servers/mcp-firecrawl plugins/wasm-go/mcp-servers/mcp-firecrawl	mcp-server.yaml mcp-server.yaml	11:176 (17%) 241:406 (17%)	view
132	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	5964:6095 (1%) 6113:6244 (1%)	view
124	x 2	plugins/wasm-go/extensions/ai-token-ratelimit plugins/wasm-go/extensions/cluster-key-rate-limit	config.go config.go	138:302 (57%) 135:299 (58%)	view
115	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	948:1062 (1%) 2647:2761 (1%)	view
115	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	948:1062 (1%) 1675:1789 (1%)	view
115	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	948:1062 (1%) 1238:1352 (1%)	view
115	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	1675:1789 (1%) 2357:2471 (1%)	view
115	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	1238:1352 (1%) 2357:2471 (1%)	view
115	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	266:380 (1%) 948:1062 (1%)	view
115	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	266:380 (1%) 2357:2471 (1%)	view
115	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	2357:2471 (1%) 2647:2761 (1%)	view
112	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	3256:3367 (1%) 3372:3483 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	962:1059 (1%) 1985:2082 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	1985:2082 (1%) 2371:2468 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	1689:1786 (1%) 1985:2082 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	1252:1349 (1%) 1985:2082 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	1985:2082 (1%) 2661:2758 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	3603:3700 (1%) 3727:3824 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	280:377 (1%) 576:673 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	576:673 (1%) 1252:1349 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	576:673 (1%) 1689:1786 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	576:673 (1%) 962:1059 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	280:377 (1%) 1985:2082 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	576:673 (1%) 2371:2468 (1%)	view
98	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	576:673 (1%) 2661:2758 (1%)	view
84	x 2	pkg/ingress/kube/ingress pkg/ingress/kube/ingressv1	controller.go controller.go	530:657 (9%) 500:628 (10%)	view
81	x 2	plugins/wasm-go/extensions/ai-token-ratelimit plugins/wasm-go/extensions/cluster-key-rate-limit	main.go main.go	192:308 (35%) 130:246 (50%)	view
80	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	6760:6839 (1%) 6844:6923 (1%)	view
77	x 2	plugins/wasm-go/mcp-servers/mcp-firecrawl plugins/wasm-go/mcp-servers/mcp-firecrawl	mcp-server.yaml mcp-server.yaml	303:379 (8%) 516:592 (8%)	view
77	x 2	plugins/wasm-go/mcp-servers/mcp-firecrawl plugins/wasm-go/mcp-servers/mcp-firecrawl	mcp-server.yaml mcp-server.yaml	73:149 (8%) 516:592 (8%)	view
70	x 2	pkg/ingress/kube/ingress pkg/ingress/kube/ingressv1	controller.go controller.go	768:870 (8%) 761:865 (8%)	view
70	x 2	pkg/ingress/kube/ingress pkg/ingress/kube/ingressv1	controller.go controller.go	1107:1212 (8%) 1086:1192 (8%)	view
68	x 2	plugins/wasm-rust/example/wrapper-say-hello plugins/wasm-rust/extensions/say-hello	envoy.yaml envoy.yaml	15:82 (94%) 15:82 (94%)	view
65	x 2	pkg/ingress/kube/ingress pkg/ingress/kube/ingressv1	controller.go controller.go	1261:1363 (7%) 1197:1299 (8%)	view
61	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	3417:3477 (<1%) 3924:3984 (<1%)	view
61	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	3301:3361 (<1%) 4097:4157 (<1%)	view
61	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	3417:3477 (<1%) 4097:4157 (<1%)	view
61	x 2	hgctl/pkg/manifests/istiobase/crds hgctl/pkg/manifests/istiobase/crds	crd-all.gen.yaml crd-all.gen.yaml	3301:3361 (<1%) 3924:3984 (<1%)	view
48	x 2	pkg/ingress/kube/ingress pkg/ingress/kube/ingressv1	controller.go controller.go	210:284 (5%) 186:260 (5%)	view
46	x 2	pkg/ingress/config pkg/ingress/config	ingress_config.go kingress_config.go	875:929 (3%) 401:455 (13%)	view

Duplicated Units

The list of top 50 duplicated units.

See data for all 70 unit duplicates...

Size	#	Folders	Files	Lines	Code
68	x 2	plugins/wasm-go/extensions/cluster-key-rate-limit plugins/wasm-go/extensions/ai-token-ratelimit	config.go config.go	150:227 153:230	view
54	x 2	pkg/ingress/config pkg/ingress/config	ingress_config.go kingress_config.go	874:931 400:457	view
54	x 2	plugins/wasm-go/extensions/cluster-key-rate-limit plugins/wasm-go/extensions/ai-token-ratelimit	config.go config.go	229:286 232:289	view
51	x 2	plugins/wasm-go/extensions/cluster-key-rate-limit plugins/wasm-go/extensions/ai-token-ratelimit	main.go main.go	140:197 202:259	view
50	x 3	pkg/ingress/kube/ingress pkg/ingress/kube/kingress pkg/ingress/kube/ingressv1	controller.go controller.go controller.go	1305:1364 659:718 1241:1300	view
44	x 2	hgctl/pkg hgctl/cmd/hgctl/config	utils.go gateway_config.go	33:81 212:260	view
35	x 3	pkg/ingress/kube/ingress pkg/ingress/kube/kingress pkg/ingress/kube/ingressv1	controller.go controller.go controller.go	1169:1213 612:656 1148:1193	view
34	x 2	pkg/ingress/config pkg/ingress/config	ingress_config.go kingress_config.go	385:425 163:203	view
33	x 2	pkg/ingress/kube/ingress pkg/ingress/kube/ingressv1	controller.go controller.go	1215:1253 635:673	view
28	x 2	pkg/ingress/kube/ingress pkg/ingress/kube/ingressv1	controller.go controller.go	1113:1142 1092:1121	view
25	x 2	pkg/ingress/config pkg/ingress/config	ingress_config.go kingress_config.go	846:872 372:398	view
23	x 2	plugins/wasm-go/extensions/ai-cache/vector plugins/wasm-go/extensions/ai-cache/vector	pinecone.go milvus.go	166:194 178:206	view
23	x 2	plugins/wasm-go/extensions/cluster-key-rate-limit plugins/wasm-go/extensions/ai-token-ratelimit	main.go main.go	223:247 285:309	view
21	x 2	pkg/ingress/config pkg/ingress/config	ingress_config.go kingress_config.go	1292:1315 459:482	view
17	x 2	pkg/ingress/kube/ingress pkg/ingress/kube/ingressv1	controller.go controller.go	1144:1166 1123:1145	view
16	x 2	plugins/wasm-go/extensions/ai-proxy/provider plugins/wasm-go/extensions/ai-json-resp	model.go model.go	422:439 163:180	view
15	x 3	pkg/ingress/kube/ingress pkg/ingress/kube/kingress pkg/ingress/kube/ingressv1	controller.go controller.go controller.go	338:357 279:298 318:337	view
15	x 2	plugins/wasm-go/extensions/ai-quota plugins/wasm-go/extensions/ai-token-ratelimit	main.go main.go	247:265 172:190	view
14	x 3	plugins/wasm-go/mcp-servers/amap-tools/tools plugins/wasm-go/mcp-servers/amap-tools/tools plugins/wasm-go/mcp-servers/amap-tools/tools	maps_direction_walking.go maps_direction_driving.go maps_bicycling.go	51:67 51:67 51:67	view
14	x 2	plugins/wasm-go/extensions/key-auth plugins/wasm-go/extensions/basic-auth	main.go main.go	203:222 158:177	view
14	x 2	plugins/wasm-go/extensions/cluster-key-rate-limit plugins/wasm-go/extensions/ai-token-ratelimit	main.go main.go	204:221 266:283	view
14	x 2	plugins/wasm-go/extensions/cluster-key-rate-limit plugins/wasm-go/extensions/ai-token-ratelimit	config.go config.go	288:303 291:306	view
14	x 4	plugins/wasm-cpp/extensions/oauth plugins/wasm-cpp/extensions/jwt_auth plugins/wasm-cpp/extensions/hmac_auth plugins/wasm-cpp/extensions/key_auth	plugin.cc plugin.cc plugin.cc plugin.cc	348:364 393:409 405:421 407:423	view
14	x 3	plugins/wasm-cpp/extensions/request_block plugins/wasm-cpp/extensions/custom_response plugins/wasm-cpp/extensions/key_rate_limit	plugin.cc plugin.cc plugin.cc	208:224 151:167 198:214	view
13	x 2	hgctl/pkg hgctl/pkg	upgrade.go uninstall.go	108:122 112:126	view
13	x 2	pkg/ingress/kube/ingress pkg/ingress/kube/ingressv1	status.go status.go	61:76 61:76	view
13	x 2	registry/nacos/v2 registry/nacos	watcher.go watcher.go	508:525 393:410	view
12	x 3	client/pkg/clientset/versioned/typed/networking/v1 client/pkg/clientset/versioned/typed/networking/v1 client/pkg/clientset/ver...ped/extensions/v1alpha1	http2rpc.gen.go mcpbridge.gen.go wasmplugin.gen.go	170:183 170:183 170:183	view
12	x 2	hgctl/pkg/installer hgctl/pkg/installer	istio.go gateway_api.go	112:125 100:113	view
12	x 2	plugins/wasm-go/extensions/ai-proxy/provider plugins/wasm-go/extensions/ai-json-resp	model.go model.go	338:351 127:140	view
11	x 3	client/pkg/clientset/versioned/typed/networking/v1 client/pkg/clientset/versioned/typed/networking/v1 client/pkg/clientset/ver...ped/extensions/v1alpha1	http2rpc.gen.go mcpbridge.gen.go wasmplugin.gen.go	101:113 101:113 101:113	view
11	x 2	registry/nacos/v2 registry/nacos	watcher.go watcher.go	369:384 257:272	view
11	x 2	registry/nacos/v2 registry/nacos	watcher.go watcher.go	386:401 274:289	view
11	x 2	plugins/wasm-go/mcp-servers/amap-tools/tools plugins/wasm-go/extensions/ip-restriction	maps_ip_location.go utils.go	83:98 28:43	view
10	x 2	pkg/ingress/kube/ingress pkg/ingress/kube/ingressv1	controller.go controller.go	165:179 138:152	view
10	x 2	pkg/ingress/kube/ingress pkg/ingress/kube/ingressv1	controller.go controller.go	262:273 238:249	view
10	x 3	pkg/ingress/kube/configmap pkg/ingress/kube/configmap pkg/ingress/kube/configmap	mcp_server.go gzip.go tracing.go	159:173 115:129 128:142	view
10	x 4	plugins/wasm-go/extensions/cluster-key-rate-limit plugins/wasm-go/extensions/frontend-gray/util plugins/wasm-go/extensions/transformer plugins/wasm-go/extensions/ai-token-ratelimit	utils.go utils.go utils.go utils.go	35:46 136:147 260:271 35:46	view
10	x 2	plugins/wasm-go/extensions/cluster-key-rate-limit plugins/wasm-go/extensions/ai-token-ratelimit	utils.go utils.go	49:60 49:60	view
9	x 2	client/pkg/clientset/versioned/typed/networking/v1 client/pkg/clientset/ver...ped/extensions/v1alpha1	networking_client.gen.go extensions_client.gen.go	49:59 44:54	view
9	x 2	plugins/wasm-go/extensions/ai-statistics plugins/wasm-go/extensions/ai-token-ratelimit	main.go main.go	130:140 311:321	view
9	x 2	plugins/wasm-go/extensions/ai-intent plugins/wasm-go/extensions/ai-search	main.go main.go	26:36 83:93	view
8	x 3	client/pkg/applyconfiguration/networking/v1 client/pkg/applyconfiguration/networking/v1 client/pkg/applyconfiguration/extensions/v1alpha1	http2rpc.go mcpbridge.go wasmplugin.go	148:157 148:157 148:157	view
8	x 3	client/pkg/applyconfiguration/networking/v1 client/pkg/applyconfiguration/networking/v1 client/pkg/applyconfiguration/extensions/v1alpha1	http2rpc.go mcpbridge.go wasmplugin.go	163:172 163:172 163:172	view
8	x 3	client/pkg/applyconfiguration/networking/v1 client/pkg/applyconfiguration/networking/v1 client/pkg/applyconfiguration/extensions/v1alpha1	http2rpc.go mcpbridge.go wasmplugin.go	177:186 177:186 177:186	view
8	x 2	hgctl/pkg/installer hgctl/pkg/installer	istio.go gateway_api.go	101:110 89:98	view
8	x 4	plugins/wasm-go/extensions/ai-agent plugins/wasm-go/extensions/ai-security-guard plugins/wasm-go/extensions/transformer plugins/wasm-go/extensions/ai-transformer	main.go main.go main.go main.go	29:38 26:35 30:39 15:24	view
8	x 2	plugins/wasm-go/extensions/ai-search/engine/quark plugins/wasm-go/extensions/ai-security-guard	quark.go main.go	39:49 134:143	view
7	x 3	client/pkg/clientset/versioned/typed/networking/v1 client/pkg/clientset/versioned/typed/networking/v1 client/pkg/clientset/ver...ped/extensions/v1alpha1	http2rpc.gen.go mcpbridge.gen.go wasmplugin.gen.go	159:167 159:167 159:167	view
7	x 2	registry/nacos/v2 registry/nacos	watcher.go watcher.go	169:177 121:129	view