netflix / genie - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

24% duplication:

53,608 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
13,228 duplicated lines

2,892 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
genie-common-internal (7%) --> genie-common (19%)	573	13 file pairs	details...
genie-client (5%) --> genie-web (<1%)	325	6 file pairs	details...
genie-common-internal (<1%) --> genie-web (<1%)	50	2 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 2,892 duplicates...

Size	#	Folders	Files	Lines	Code
605	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	init.xml jobSpecification.xml	1:634 (100%) 1:634 (99%)	view
474	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml unclaimed.xml	1:501 (60%) 1:501 (60%)	view
353	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml jobSpecification.xml	1:378 (45%) 1:377 (57%)	view
353	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml init.xml	1:378 (45%) 1:377 (58%)	view
353	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	init.xml unclaimed.xml	1:377 (58%) 1:378 (45%)	view
353	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	jobSpecification.xml unclaimed.xml	1:377 (57%) 1:378 (45%)	view
198	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml search.xml	1:214 (25%) 1:214 (23%)	view
198	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	search.xml unclaimed.xml	1:214 (23%) 1:214 (25%)	view
198	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	jobSpecification.xml search.xml	1:214 (32%) 1:214 (23%)	view
198	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	init.xml search.xml	1:214 (32%) 1:214 (23%)	view
196	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml search.xml	214:418 (25%) 235:439 (23%)	view
196	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	search.xml unclaimed.xml	235:439 (23%) 214:418 (25%)	view
183	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	archive_status.xml launcher_ext.xml	1:212 (100%) 1:212 (100%)	view
156	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	jobSpecification.xml search.xml	214:377 (25%) 235:399 (18%)	view
156	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	init.xml search.xml	214:377 (25%) 235:399 (18%)	view
100	x 2	genie-web/src/integTest/...eleteUnusedApplications genie-web/src/integTest/...eleteUnusedApplications	after.xml before.xml	28:136 (89%) 41:149 (80%)	view
82	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml unclaimed.xml	673:756 (10%) 673:756 (10%)	view
82	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml unclaimed.xml	588:671 (10%) 588:671 (10%)	view
71	x 2	genie-common-internal/sr...ie/common/internal/dtos genie-common/src/main/ja...etflix/genie/common/dto	Criterion.java Criterion.java	42:215 (100%) 42:215 (100%)	view
70	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml unclaimed.xml	503:574 (8%) 503:574 (8%)	view
64	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml init.xml	516:581 (8%) 508:573 (10%)	view
64	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml jobSpecification.xml	516:581 (8%) 508:573 (10%)	view
58	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml unclaimed.xml	758:816 (7%) 758:816 (7%)	view
57	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	search.xml unclaimed.xml	442:499 (6%) 419:476 (7%)	view
57	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml search.xml	419:476 (7%) 442:499 (6%)	view
57	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	jobSpecification.xml unclaimed.xml	508:566 (9%) 516:574 (7%)	view
57	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	init.xml unclaimed.xml	508:566 (9%) 516:574 (7%)	view
57	x 2	genie-web/src/integTest/...ds/deleteUnusedCommands genie-web/src/integTest/...ds/deleteUnusedCommands	expected.xml setup.xml	18:74 (53%) 22:78 (38%)	view
51	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	init.xml unclaimed.xml	439:491 (8%) 444:496 (6%)	view
51	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml init.xml	444:496 (6%) 439:491 (8%)	view
51	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	jobSpecification.xml unclaimed.xml	439:491 (8%) 444:496 (6%)	view
51	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml jobSpecification.xml	444:496 (6%) 439:491 (8%)	view
50	x 2	genie-web/src/integTest/...dApplicationsForCommand genie-web/src/integTest/...dApplicationsForCommand	after.xml before.xml	1:69 (90%) 1:69 (100%)	view
49	x 2	genie-web/src/integTest/...ds/deleteUnusedCommands genie-web/src/integTest/...ds/deleteUnusedCommands	expected.xml setup.xml	74:123 (45%) 116:165 (32%)	view
49	x 2	genie-web/src/integTest/...StatusForUnusedCommands genie-web/src/integTest/...StatusForUnusedCommands	after.xml before.xml	85:134 (41%) 85:134 (41%)	view
45	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	search.xml unclaimed.xml	554:599 (5%) 516:561 (5%)	view
45	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	jobSpecification.xml search.xml	508:553 (7%) 554:599 (5%)	view
45	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	search.xml unclaimed.xml	738:783 (5%) 686:731 (5%)	view
45	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml search.xml	601:646 (5%) 646:691 (5%)	view
45	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml init.xml	601:646 (5%) 589:634 (7%)	view
45	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	jobSpecification.xml search.xml	589:634 (7%) 646:691 (5%)	view
45	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	search.xml unclaimed.xml	830:875 (5%) 771:816 (5%)	view
45	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml search.xml	771:816 (5%) 830:875 (5%)	view
45	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	jobSpecification.xml unclaimed.xml	589:634 (7%) 601:646 (5%)	view
45	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	init.xml search.xml	589:634 (7%) 646:691 (5%)	view
45	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml search.xml	516:561 (5%) 554:599 (5%)	view
45	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	search.xml unclaimed.xml	646:691 (5%) 601:646 (5%)	view
45	x 2	genie-web/src/integTest/...s/getHostJobInformation genie-web/src/integTest/...pl/jpa/persistence/jobs	setup.xml jobSpecification.xml	601:646 (5%) 589:634 (7%)	view
45	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	init.xml unclaimed.xml	589:634 (7%) 601:646 (5%)	view
45	x 2	genie-web/src/integTest/...pl/jpa/persistence/jobs genie-web/src/integTest/...pl/jpa/persistence/jobs	init.xml search.xml	508:553 (7%) 554:599 (5%)	view

Duplicated Units

The list of top 10 duplicated units.

See data for all 10 unit duplicates...

Size	#	Folders	Files	Lines	Code
19	x 3	genie-common/src/main/ja...etflix/genie/common/dto genie-common/src/main/ja...etflix/genie/common/dto genie-common/src/main/ja...etflix/genie/common/dto	JobRequest.java Command.java JobExecution.java	463:484 304:324 283:303	view
14	x 2	genie-common/src/main/ja...etflix/genie/common/dto genie-common-internal/sr...ie/common/internal/dtos	Criterion.java Criterion.java	73:89 73:89	view
13	x 2	genie-ui/src/main/web/scripts/components genie-ui/src/main/web/scripts/components	JobDetails.js AuthCheck.js	70:84 34:48	view
11	x 3	genie-ui/src/main/web/scripts genie-ui/src/main/web/scripts genie-ui/src/main/web/scripts	Cluster.js Application.js Command.js	53:65 54:66 54:66	view
9	x 2	genie-common/src/main/ja...etflix/genie/common/dto genie-common/src/main/ja...etflix/genie/common/dto	Job.java JobRequest.java	259:269 337:347	view
9	x 3	genie-web/src/integTest/...tflix/genie/web/scripts genie-web/src/integTest/...tflix/genie/web/scripts genie-web/src/integTest/...tflix/genie/web/scripts	AgentLauncherSelectorManagedScriptInt... ClusterSelectorManagedScriptIntegrati... CommandSelectorManagedScriptIntegrati...	108:118 106:116 121:131	view
7	x 2	genie-common/src/main/ja...etflix/genie/common/dto genie-common-internal/sr...ie/common/internal/dtos	Cluster.java ClusterMetadata.java	69:77 69:77	view
7	x 2	genie-common/src/main/ja...etflix/genie/common/dto genie-common-internal/sr...ie/common/internal/dtos	Application.java ApplicationMetadata.java	83:91 86:94	view
7	x 2	genie-common/src/main/ja...etflix/genie/common/dto genie-common-internal/sr...ie/common/internal/dtos	RuntimeResources.java ComputeResources.java	136:144 133:141	view
6	x 2	genie-common/src/main/ja...etflix/genie/common/dto genie-common-internal/sr...ie/common/internal/dtos	Criterion.java Criterion.java	199:206 199:206	view