uber / uForwarder - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

14% duplication:

19,808 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
2,961 duplicated lines

318 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
uforwarder-container (57%) --> uforwarder (1%)	277	1 file pair	details...
uforwarder-core (<1%) --> uforwarder (1%)	176	28 file pairs	details...
instrumentation (8%) --> uforwarder (<1%)	100	1 file pair	details...
uforwarder-sample-consumer (26%) --> uforwarder (<1%)	84	4 file pairs	details...
uforwarder-container (12%) --> uforwarder-sample-consumer (19%)	62	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 318 duplicates...

Size	#	Folders	Files	Lines	Code
74	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html workerJobs.html	64:143 (34%) 65:144 (35%)	view
61	x 2	uforwarder-container/src...consumerproxy/container uforwarder/src/integrati...ata/kafka/consumerproxy	UforwarderContainerIntegrationTests.java UforwarderIntegrationTests.java	221:295 (30%) 388:462 (17%)	view
50	x 2	instrumentation/src/main...a/kafka/instrumentation uforwarder/src/main/java...rproxy/worker/processor	Instrumentation.java ProcessorImpl.java	73:122 (15%) 121:170 (5%)	view
43	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masters.html workers.html	37:89 (50%) 45:97 (42%)	view
42	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html workers.html	111:162 (19%) 45:96 (41%)	view
42	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html masters.html	111:162 (19%) 37:88 (49%)	view
40	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html workerJobs.html	1:44 (18%) 1:44 (19%)	view
34	x 2	uforwarder-container/src...consumerproxy/container uforwarder/src/integrati...ata/kafka/consumerproxy	UforwarderContainerIntegrationTests.java UforwarderIntegrationTests.java	181:218 (16%) 349:386 (10%)	view
32	x 2	uforwarder/src/main/resources uforwarder/src/main/resources	application-uforwarder-controller.yaml application-uforwarder-worker.yaml	132:216 (33%) 46:130 (58%)	view
32	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	workerJobStatus.html workerJobs.html	1:36 (18%) 1:36 (15%)	view
32	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html workerJobStatus.html	1:36 (15%) 1:36 (18%)	view
31	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	workerJobStatus.html workerJobStatus.html	128:158 (17%) 162:192 (17%)	view
30	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html masterJobs.html	167:196 (14%) 200:229 (14%)	view
28	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masters.html workerJobs.html	37:69 (32%) 112:144 (13%)	view
28	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	workerJobs.html workers.html	112:144 (13%) 45:77 (27%)	view
27	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	workerJobs.html workerJobs.html	167:193 (13%) 197:223 (13%)	view
25	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html workerJobs.html	174:200 (11%) 171:197 (12%)	view
25	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masters.html workers.html	1:29 (29%) 1:29 (24%)	view
23	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html workerJobs.html	207:229 (10%) 171:193 (11%)	view
23	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html workerJobs.html	174:196 (10%) 201:223 (11%)	view
23	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html workerJobs.html	207:229 (10%) 201:223 (11%)	view
20	x 2	uforwarder-container/src...consumerproxy/container uforwarder/src/integrati...ata/kafka/consumerproxy	UforwarderContainerIntegrationTests.java UforwarderIntegrationTests.java	158:181 (9%) 172:195 (5%)	view
18	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	workerJobStatus.html workerJobs.html	107:129 (10%) 146:168 (8%)	view
18	x 2	uforwarder-core/src/main...nsfer/worker/controller uforwarder-core/src/main...nsfer/worker/controller	StateRegistering.java StateWorking.java	27:44 (14%) 50:67 (5%)	view
17	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html workerJobStatus.html	133:151 (8%) 95:113 (9%)	view
17	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	workerJobStatus.html workers.html	95:113 (9%) 67:85 (16%)	view
17	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masters.html workerJobStatus.html	59:77 (20%) 95:113 (9%)	view
15	x 2	idl/src/main/proto/data/kafka/data-transfer idl/src/main/proto/data/kafka/data-transfer	proto job.proto job_group.proto	123:139 (3%) 130:146 (8%)	view
15	x 2	uforwarder-container/src...consumerproxy/container uforwarder-sample-consum...r/data/kafka/uforwarder	UforwarderContainerIntegrationTests.java SampleConsumerAutoConfiguration.java	204:218 (7%) 45:59 (20%)	view
15	x 2	uforwarder-sample-consum...r/data/kafka/uforwarder uforwarder/src/integrati...ata/kafka/consumerproxy	SampleConsumerAutoConfiguration.java UforwarderIntegrationTests.java	45:59 (20%) 372:386 (4%)	view
14	x 2	uforwarder/src/main/java...rproxy/worker/processor uforwarder/src/main/java...rproxy/worker/processor	ProcessorMessage.java ProcessorMessage.java	295:308 (4%) 327:340 (4%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	workerJobs.html workers.html	21:36 (6%) 14:29 (12%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	workerJobs.html workers.html	1:14 (6%) 1:14 (12%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html masters.html	21:36 (6%) 14:29 (15%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html workers.html	1:14 (6%) 1:14 (12%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html workers.html	21:36 (6%) 14:29 (12%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masterJobs.html masters.html	1:14 (6%) 1:14 (15%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	workerJobStatus.html workers.html	1:14 (7%) 1:14 (12%)	view
13	x 2	uforwarder/src/main/java...proxy/worker/dispatcher uforwarder/src/main/java.../worker/dispatcher/grpc	DispatcherMessage.java GrpcRequest.java	96:108 (8%) 58:70 (7%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masters.html workerJobStatus.html	14:29 (15%) 21:36 (7%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masters.html workerJobs.html	1:14 (15%) 1:14 (6%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masters.html workerJobStatus.html	1:14 (15%) 1:14 (7%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	masters.html workerJobs.html	14:29 (15%) 21:36 (6%)	view
13	x 2	uforwarder-core/src/main/resources uforwarder-core/src/main/resources	workerJobStatus.html workers.html	21:36 (7%) 14:29 (12%)	view
13	x 2	uforwarder/src/main/java...rproxy/worker/processor uforwarder/src/main/java...rproxy/worker/processor	SimpleOutboundMessageLimiter.java SimpleOutboundMessageLimiter.java	227:239 (3%) 287:299 (3%)	view
12	x 2	instrumentation/src/main...a/kafka/instrumentation instrumentation/src/main...a/kafka/instrumentation	Instrument.java Instrument.java	268:280 (6%) 363:375 (6%)	view
12	x 2	uforwarder-core/src/main...ansfer/worker/pipelines uforwarder-core/src/main...ansfer/worker/pipelines	KafkaPipelineStateManager.java KafkaPipelineStateManager.java	286:297 (4%) 313:324 (4%)	view
12	x 2	uforwarder/src/main/resources uforwarder/src/main/resources	application-uforwarder-controller.yaml application-uforwarder-worker.yaml	21:39 (12%) 16:35 (21%)	view
12	x 2	instrumentation/src/main...a/kafka/instrumentation instrumentation/src/main...a/kafka/instrumentation	Instrument.java Instrument.java	316:328 (6%) 418:430 (6%)	view
12	x 2	uforwarder-core/src/main...r/worker/fetchers/kafka uforwarder/src/main/java...merproxy/worker/fetcher	KafkaFetcherThread.java RetryTopicKafkaFetcher.java	90:124 (16%) 89:127 (13%)	view

Duplicated Units

The list of top 3 duplicated units.

See data for all 3 unit duplicates...

Size	#	Folders	Files	Lines	Code
26	x 2	uforwarder/src/integrati...ata/kafka/consumerproxy uforwarder-container/src...consumerproxy/container	UforwarderIntegrationTests.java UforwarderContainerIntegrationTests.java	435:464 268:297	view
10	x 2	uforwarder/src/integrati...ata/kafka/consumerproxy uforwarder-container/src...consumerproxy/container	UforwarderIntegrationTests.java UforwarderContainerIntegrationTests.java	421:433 254:266	view
8	x 3	uforwarder/src/integrati...ata/kafka/consumerproxy uforwarder-container/src...consumerproxy/container uforwarder-sample-consum...r/data/kafka/uforwarder	UforwarderIntegrationTests.java UforwarderContainerIntegrationTests.java SampleConsumerProducer.java	409:419 242:252 34:44	view