apache / airavata-custos

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

54% duplication:

58,505 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
32,122 duplicated lines

224,013 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
core (3%) --> custos-grpc-data-models (50%)	231	18 file pairs	details...
compose (98%) --> deployment (1%)	51	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 224,013 duplicates...

Size	#	Folders	Files	Lines	Code
1450	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	IamAdminService_pb2_grpc.py IamAdminService_pb2_grpc.py	26:1635 (100%) 26:1635 (100%)	view
790	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	SharingManagementService_pb2_grpc.py SharingManagementService_pb2_grpc.py	25:908 (100%) 25:908 (100%)	view
790	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	SharingService_pb2_grpc.py SharingService_pb2_grpc.py	24:907 (100%) 24:907 (100%)	view
730	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	UserProfileService_pb2_grpc.py UserProfileService_pb2_grpc.py	24:841 (100%) 24:841 (100%)	view
730	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	GroupManagementService_pb2_grpc.py GroupManagementService_pb2_grpc.py	26:843 (100%) 26:843 (100%)	view
700	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	UserManagementService_pb2_grpc.py UserManagementService_pb2_grpc.py	27:811 (100%) 27:811 (100%)	view
640	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	TenantManagementService_pb2_grpc.py TenantManagementService_pb2_grpc.py	30:748 (100%) 30:748 (100%)	view
640	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	ResourceSecretManagementService_pb2_g... ResourceSecretManagementService_pb2_g...	27:745 (100%) 27:745 (100%)	view
580	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	CredentialStoreService_pb2_grpc.py CredentialStoreService_pb2_grpc.py	25:677 (100%) 25:677 (100%)	view
580	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	ResourceSecretService_pb2_grpc.py ResourceSecretService_pb2_grpc.py	24:676 (100%) 24:676 (100%)	view
460	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	AgentManagementService_pb2_grpc.py AgentManagementService_pb2_grpc.py	26:546 (100%) 26:546 (100%)	view
370	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	IdentityManagementService_pb2_grpc.py IdentityManagementService_pb2_grpc.py	28:449 (100%) 28:449 (100%)	view
340	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	IdentityService_pb2_grpc.py IdentityService_pb2_grpc.py	26:414 (100%) 26:414 (100%)	view
280	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	FederatedAuthenticationService_pb2_gr... FederatedAuthenticationService_pb2_gr...	25:347 (100%) 25:347 (100%)	view
280	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	TenantProfileService_pb2_grpc.py TenantProfileService_pb2_grpc.py	24:346 (100%) 24:346 (100%)	view
195	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	user_management_client.py user_management_client.py	24:387 (100%) 24:387 (100%)	view
174	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	resource_secret_management_client.py resource_secret_management_client.py	29:260 (100%) 29:260 (100%)	view
162	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	tenant_management_client.py tenant_management_client.py	22:269 (100%) 22:269 (100%)	view
152	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	agent_management_client.py agent_management_client.py	25:294 (100%) 25:294 (100%)	view
133	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...stos/server/integration	SharingService_pb2_grpc.py SharingManagementService_pb2_grpc.py	326:458 (16%) 327:459 (16%)	view
133	x 2	custos-client-sdks/custo...-sdk/custos/server/core custos-client-sdks/custo...stos/server/integration	SharingService_pb2_grpc.py SharingManagementService_pb2_grpc.py	326:458 (16%) 327:459 (16%)	view
133	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...stos/server/integration	SharingService_pb2_grpc.py SharingManagementService_pb2_grpc.py	326:458 (16%) 327:459 (16%)	view
133	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...-sdk/custos/server/core	SharingManagementService_pb2_grpc.py SharingService_pb2_grpc.py	327:459 (16%) 326:458 (16%)	view
130	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	AgentProfileService_pb2_grpc.py AgentProfileService_pb2_grpc.py	25:182 (100%) 25:182 (100%)	view
130	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	LoggingService_pb2_grpc.py LoggingService_pb2_grpc.py	24:181 (100%) 24:181 (100%)	view
114	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	identity_management_client.py identity_management_client.py	24:240 (100%) 24:240 (100%)	view
113	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	ClusterManagementService_pb2.py ClusterManagementService_pb2.py	29:160 (100%) 29:160 (100%)	view
108	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	ClusterManagementService_pb2.py ClusterManagementService_pb2.py	28:154 (100%) 28:154 (100%)	view
104	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...-sdk/custos/server/core	SharingManagementService_pb2_grpc.py SharingService_pb2_grpc.py	169:323 (13%) 168:322 (13%)	view
104	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...stos/server/integration	SharingService_pb2_grpc.py SharingManagementService_pb2_grpc.py	168:322 (13%) 169:323 (13%)	view
104	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...stos/server/integration	SharingService_pb2_grpc.py SharingManagementService_pb2_grpc.py	168:322 (13%) 169:323 (13%)	view
104	x 2	custos-client-sdks/custo...-sdk/custos/server/core custos-client-sdks/custo...stos/server/integration	SharingService_pb2_grpc.py SharingManagementService_pb2_grpc.py	168:322 (13%) 169:323 (13%)	view
100	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	LogManagementService_pb2_grpc.py LogManagementService_pb2_grpc.py	25:149 (100%) 25:149 (100%)	view
95	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	sharing_management_client.py sharing_management_client.py	25:136 (100%) 25:136 (100%)	view
89	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	group_management_client.py group_management_client.py	28:169 (100%) 28:169 (100%)	view
81	x 2	custos-client-sdks/custo...lib/custosauthenticator custos-client-sdks/custo...tor/custosauthenticator	custos.py custos.py	72:194 (78%) 77:199 (75%)	view
70	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	MessagingService_pb2_grpc.py MessagingService_pb2_grpc.py	24:115 (100%) 24:115 (100%)	view
63	x 2	api/src/main/java/org/apache/custos/api/group api/src/main/java/org/apache/custos/api/group	GroupManagementController.java GroupManagementController.java	194:258 (6%) 277:341 (6%)	view
56	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...-sdk/custos/server/core	ResourceSecretManagementService_pb2_g... ResourceSecretService_pb2_grpc.py	304:359 (8%) 289:344 (9%)	view
56	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...stos/server/integration	ResourceSecretService_pb2_grpc.py ResourceSecretManagementService_pb2_g...	289:344 (9%) 304:359 (8%)	view
56	x 2	custos-client-sdks/custo...-sdk/custos/server/core custos-client-sdks/custo...stos/server/integration	ResourceSecretService_pb2_grpc.py ResourceSecretManagementService_pb2_g...	289:344 (9%) 304:359 (8%)	view
56	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...stos/server/integration	ResourceSecretService_pb2_grpc.py ResourceSecretManagementService_pb2_g...	289:344 (9%) 304:359 (8%)	view
55	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	LogManagementService_pb2.py LogManagementService_pb2.py	29:98 (100%) 29:98 (100%)	view
50	x 2	custos-client-sdks/custo...redential-store-service custos-client-sdks/custo...vices/tenant-management	CredentialStoreService_pb.js TenantManagementService_pb.js	2799:2856 (3%) 1812:1869 (3%)	view
47	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...-sdk/custos/server/core	ResourceSecretManagementService_pb2_g... ResourceSecretService_pb2_grpc.py	178:246 (7%) 177:245 (8%)	view
47	x 2	custos-client-sdks/custo...-sdk/custos/server/core custos-client-sdks/custo...stos/server/integration	ResourceSecretService_pb2_grpc.py ResourceSecretManagementService_pb2_g...	177:245 (8%) 178:246 (7%)	view
47	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...stos/server/integration	ResourceSecretService_pb2_grpc.py ResourceSecretManagementService_pb2_g...	177:245 (8%) 178:246 (7%)	view
47	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...stos/server/integration	ResourceSecretService_pb2_grpc.py ResourceSecretManagementService_pb2_g...	177:245 (8%) 178:246 (7%)	view
42	x 2	custos-client-sdks/custo...redential-store-service custos-client-sdks/custo...vices/tenant-management	CredentialStoreService_pb.js TenantManagementService_pb.js	2733:2777 (3%) 1746:1790 (3%)	view
40	x 2	custos-client-sdks/custo...ib/custos/clients/utils custos-client-sdks/custo...dk/custos/clients/utils	certificate_fetching_rest_client.py certificate_fetching_rest_client.py	26:79 (100%) 26:79 (100%)	view

Duplicated Units

The list of top 50 duplicated units.

See data for all 56 unit duplicates...

Size	#	Folders	Files	Lines	Code
244	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	IamAdminService_pb2_grpc.py IamAdminService_pb2_grpc.py	0:0 0:0	view
134	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	SharingService_pb2_grpc.py SharingService_pb2_grpc.py	0:0 0:0	view
134	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	SharingManagementService_pb2_grpc.py SharingManagementService_pb2_grpc.py	0:0 0:0	view
124	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	UserProfileService_pb2_grpc.py UserProfileService_pb2_grpc.py	0:0 0:0	view
124	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	GroupManagementService_pb2_grpc.py GroupManagementService_pb2_grpc.py	0:0 0:0	view
119	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	UserManagementService_pb2_grpc.py UserManagementService_pb2_grpc.py	0:0 0:0	view
109	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	ResourceSecretManagementService_pb2_g... ResourceSecretManagementService_pb2_g...	0:0 0:0	view
109	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	TenantManagementService_pb2_grpc.py TenantManagementService_pb2_grpc.py	0:0 0:0	view
99	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	CredentialStoreService_pb2_grpc.py CredentialStoreService_pb2_grpc.py	0:0 0:0	view
99	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	ResourceSecretService_pb2_grpc.py ResourceSecretService_pb2_grpc.py	0:0 0:0	view
79	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	AgentManagementService_pb2_grpc.py AgentManagementService_pb2_grpc.py	0:0 0:0	view
64	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	IdentityManagementService_pb2_grpc.py IdentityManagementService_pb2_grpc.py	0:0 0:0	view
59	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	IdentityService_pb2_grpc.py IdentityService_pb2_grpc.py	0:0 0:0	view
57	x 2	custos-client-sdks/custo...vices/tenant-management custos-client-sdks/custo...redential-store-service	TenantManagementService_pb.js CredentialStoreService_pb.js	1811:1869 2798:2856	view
49	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	TenantProfileService_pb2_grpc.py TenantProfileService_pb2_grpc.py	0:0 0:0	view
49	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	FederatedAuthenticationService_pb2_gr... FederatedAuthenticationService_pb2_gr...	0:0 0:0	view
44	x 2	custos-client-sdks/custo...vices/tenant-management custos-client-sdks/custo...redential-store-service	TenantManagementService_pb.js CredentialStoreService_pb.js	1745:1790 2732:2777	view
29	x 2	custos-client-sdks/custo...e-services/user-profile custos-client-sdks/custo...services/tenant-profile	UserProfileService_pb.js TenantProfileService_pb.js	1748:1778 1533:1563	view
29	x 2	custos-client-sdks/custo...redential-store-service custos-client-sdks/custo...-authentication-service	CredentialStoreService_pb.js FederatedAuthenticationService_pb.js	1788:1818 2076:2106	view
34	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	user_management_client.py user_management_client.py	0:0 0:0	view
28	x 2	custos-client-sdks/custo...e-services/user-profile custos-client-sdks/custo...services/tenant-profile	UserProfileService_pb.js TenantProfileService_pb.js	1698:1727 1483:1512	view
28	x 2	custos-client-sdks/custo...redential-store-service custos-client-sdks/custo...-authentication-service	CredentialStoreService_pb.js FederatedAuthenticationService_pb.js	1738:1767 2026:2055	view
25	x 2	services/src/main/java/o...stos/service/management services/src/main/java/o...stos/service/management	TenantManagementService.java UserManagementService.java	727:759 1297:1329	view
24	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	LoggingService_pb2_grpc.py LoggingService_pb2_grpc.py	0:0 0:0	view
24	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	AgentProfileService_pb2_grpc.py AgentProfileService_pb2_grpc.py	0:0 0:0	view
25	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	resource_secret_management_client.py resource_secret_management_client.py	0:0 0:0	view
28	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	tenant_management_client.py tenant_management_client.py	0:0 0:0	view
24	x 2	custos-client-sdks/custo...e-services/user-profile custos-client-sdks/custo...services/tenant-profile	UserProfileService_pb.js TenantProfileService_pb.js	1917:1942 1702:1727	view
22	x 2	custos-client-sdks/custo...e-services/user-profile custos-client-sdks/custo...services/tenant-profile	UserProfileService_pb.js TenantProfileService_pb.js	1963:1986 1748:1771	view
36	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	agent_management_client.py agent_management_client.py	0:0 0:0	view
20	x 2	custos-client-sdks/custo...ervices/user-management custos-client-sdks/custo...rvices/agent-management	UserManagementService_pb.js AgentManagementService_pb.js	1875:1896 607:628	view
19	x 2	custos-client-sdks/custo...ld/lib/custos/transport custos-client-sdks/custo...on-sdk/custos/transport	settings.py settings.py	0:0 0:0	view
19	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	LogManagementService_pb2_grpc.py LogManagementService_pb2_grpc.py	0:0 0:0	view
17	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	sharing_management_client.py sharing_management_client.py	0:0 0:0	view
16	x 3	custos-client-sdks/custo...vices/tenant-management custos-client-sdks/custo...rvices/identity-service custos-client-sdks/custo...services/tenant-profile	TenantManagementService_pb.js IdentityService_pb.js TenantProfileService_pb.js	2602:2619 2346:2363 1890:1907	view
16	x 5	custos-client-sdks/custo...e-services/user-profile custos-client-sdks/custo...resource-secret-service custos-client-sdks/custo...rvices/identity-service custos-client-sdks/custo...ervices/sharing-service custos-client-sdks/custo...s/agent-profile-service	UserProfileService_pb.js ResourceSecretService_pb.js IdentityService_pb.js SharingService_pb.js AgentProfileService_pb.js	3723:3740 2589:2606 3206:3223 3154:3171 910:927	view
16	x 2	custos-client-sdks/custo...redential-store-service custos-client-sdks/custo...-authentication-service	CredentialStoreService_pb.js FederatedAuthenticationService_pb.js	1605:1622 1893:1910	view
15	x 2	custos-client-sdks/custo...ervices/user-management custos-client-sdks/custo...rvices/agent-management	UserManagementService_pb.js AgentManagementService_pb.js	1917:1933 649:665	view
14	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	MessagingService_pb2_grpc.py MessagingService_pb2_grpc.py	0:0 0:0	view
14	x 2	custos-client-sdks/custo...vices/tenant-management custos-client-sdks/custo...redential-store-service	TenantManagementService_pb.js CredentialStoreService_pb.js	1706:1722 2693:2709	view
13	x 2	custos-client-sdks/custo...stos/server/integration custos-client-sdks/custo...stos/server/integration	ClusterManagementService_pb2_grpc.py ClusterManagementService_pb2_grpc.py	0:0 0:0	view
11	x 2	custos-client-sdks/custo...ib/custos/clients/utils custos-client-sdks/custo...dk/custos/clients/utils	certificate_fetching_rest_client.py certificate_fetching_rest_client.py	0:0 0:0	view
17	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	identity_management_client.py identity_management_client.py	0:0 0:0	view
18	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	group_management_client.py group_management_client.py	0:0 0:0	view
10	x 2	custos-client-sdks/custo...e-services/user-profile custos-client-sdks/custo...services/tenant-profile	UserProfileService_pb.js TenantProfileService_pb.js	1663:1675 1448:1460	view
10	x 2	custos-client-sdks/custo...redential-store-service custos-client-sdks/custo...-authentication-service	CredentialStoreService_pb.js FederatedAuthenticationService_pb.js	1703:1715 1991:2003	view
9	x 2	custos-client-sdks/custo.../lib/custos/server/core custos-client-sdks/custo...-sdk/custos/server/core	ClusterManagementService_pb2_grpc.py ClusterManagementService_pb2_grpc.py	0:0 0:0	view
9	x 2	custos-client-sdks/custo...e-services/user-profile custos-client-sdks/custo...services/tenant-profile	UserProfileService_pb.js TenantProfileService_pb.js	1883:1894 1668:1679	view
8	x 2	custos-client-sdks/custo...uild/lib/custos/clients custos-client-sdks/custo...thon-sdk/custos/clients	super_tenant_management_client.py super_tenant_management_client.py	0:0 0:0	view
8	x 3	custos-client-sdks/custo...vices/tenant-management custos-client-sdks/custo...rvices/identity-service custos-client-sdks/custo...services/tenant-profile	TenantManagementService_pb.js IdentityService_pb.js TenantProfileService_pb.js	2640:2649 2384:2393 1928:1937	view