elastic / logstash - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

16% duplication:

70,027 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
11,525 duplicated lines

2,194 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
logstash-core (<1%) --> x-pack (1%)	222	16 file pairs	details...
lib (4%) --> logstash-core (<1%)	210	16 file pairs	details...
logstash-core (<1%) --> qa (3%)	198	15 file pairs	details...
logstash-core (<1%) --> tools (<1%)	60	1 file pair	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 2,194 duplicates...

Size	#	Folders	Files	Lines	Code
282	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	423:735 (8%) 447:759 (8%)	view
262	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	2835:3124 (7%) 2859:3148 (7%)	view
159	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	72:240 (4%) 96:264 (4%)	view
152	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	856:1020 (4%) 880:1044 (4%)	view
138	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	1256:1403 (4%) 1280:1427 (4%)	view
128	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	1516:1655 (3%) 1540:1679 (3%)	view
125	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	2111:2247 (3%) 2135:2271 (3%)	view
110	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	1022:1137 (3%) 1046:1161 (3%)	view
110	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	1139:1254 (3%) 1163:1278 (3%)	view
110	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	1987:2107 (3%) 2011:2131 (3%)	view
104	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	1405:1514 (3%) 1429:1538 (3%)	view
98	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	2253:2359 (2%) 2277:2383 (2%)	view
96	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	2568:2674 (2%) 2592:2698 (2%)	view
91	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	321:421 (2%) 345:445 (2%)	view
91	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	1885:1985 (2%) 1909:2009 (2%)	view
78	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	1798:1883 (2%) 1822:1907 (2%)	view
75	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	2361:2445 (2%) 2385:2469 (2%)	view
71	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	2447:2525 (2%) 2471:2549 (2%)	view
70	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	3303:3381 (2%) 3327:3405 (2%)	view
69	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	3126:3207 (2%) 3150:3231 (2%)	view
67	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	780:854 (2%) 804:878 (2%)	view
63	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	1657:1726 (1%) 1681:1750 (1%)	view
61	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	1728:1796 (1%) 1752:1820 (1%)	view
60	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	3537:3601 (1%) 3561:3625 (1%)	view
59	x 2	logstash-core/spec/logstash logstash-core/spec/logstash	acked_queue_concurrent_stress_spec.rb acked_queue_concurrent_stress_spec.rb	150:221 (26%) 226:297 (26%)	view
55	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	2770:2833 (1%) 2794:2857 (1%)	view
55	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	2705:2768 (1%) 2729:2792 (1%)	view
38	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	737:778 (1%) 761:802 (1%)	view
37	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	242:282 (1%) 266:306 (1%)	view
33	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	3499:3535 (1%) 3523:3559 (<1%)	view
32	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	285:319 (<1%) 309:343 (<1%)	view
31	x 2	logstash-core/spec/logstash logstash-core/spec/logstash	filter_delegator_spec.rb java_filter_delegator_spec.rb	32:68 (25%) 56:92 (19%)	view
30	x 2	logstash-core/src/main/java/org/logstash/util tools/jvm-options-parser.../org/logstash/launchers	JavaVersion.java JavaVersion.java	39:84 (83%) 37:82 (85%)	view
30	x 2	tools/release tools/release	generate_release_notes.rb generate_release_notes_md.rb	54:89 (34%) 52:87 (32%)	view
29	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	3209:3241 (<1%) 3233:3265 (<1%)	view
29	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	3383:3415 (<1%) 3407:3439 (<1%)	view
29	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	3429:3461 (<1%) 3453:3485 (<1%)	view
28	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/config	grammar.rb grammar.rb	390:417 (<1%) 2328:2355 (<1%)	view
28	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	2304:2331 (<1%) 390:417 (<1%)	view
28	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	2676:2703 (<1%) 2700:2727 (<1%)	view
28	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/compiler/lscl	lscl_grammar.rb lscl_grammar.rb	366:393 (<1%) 2304:2331 (<1%)	view
28	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	366:393 (<1%) 2328:2355 (<1%)	view
27	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/config	grammar.rb grammar.rb	419:445 (<1%) 2357:2383 (<1%)	view
27	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	2333:2359 (<1%) 419:445 (<1%)	view
27	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/compiler/lscl	lscl_grammar.rb lscl_grammar.rb	395:421 (<1%) 2333:2359 (<1%)	view
27	x 2	logstash-core/lib/logstash/compiler/lscl logstash-core/lib/logstash/config	lscl_grammar.rb grammar.rb	395:421 (<1%) 2357:2383 (<1%)	view
26	x 2	logstash-core/src/main/j.../logstash/ackedqueue/io logstash-core/src/main/j.../logstash/ackedqueue/io	MmapPageIOV1.java MmapPageIOV2.java	101:138 (14%) 111:148 (10%)	view
26	x 2	qa/scripts/windows/event_log qa/scripts/windows/integration	logstash_event_log_plugin_integration... logstash_simple_integration.ps1	1:33 (26%) 1:33 (25%)	view
25	x 2	logstash-core/lib/logstash/compiler logstash-core/lib/logstash/config	treetop_monkeypatches.rb config_ast.rb	87:112 (33%) 564:589 (5%)	view
25	x 2	logstash-core/spec/logstash/inputs logstash-core/spec/logstash/outputs	base_spec.rb base_spec.rb	89:118 (20%) 105:134 (21%)	view

Duplicated Units

The list of top 20 duplicated units.

See data for all 20 unit duplicates...

Size	#	Folders	Files	Lines	Code
72	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler/lscl	grammar.rb lscl_grammar.rb	109:186 85:162	view
52	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler/lscl	grammar.rb lscl_grammar.rb	562:619 538:595	view
50	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler/lscl	grammar.rb lscl_grammar.rb	489:544 465:520	view
50	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler/lscl	grammar.rb lscl_grammar.rb	890:945 866:921	view
50	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler/lscl	grammar.rb lscl_grammar.rb	2947:3002 2923:2978	view
44	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler/lscl	grammar.rb lscl_grammar.rb	946:995 922:971	view
41	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler/lscl	grammar.rb lscl_grammar.rb	2900:2946 2876:2922	view
27	x 2	logstash-core/src/main/j.../logstash/ackedqueue/io logstash-core/src/main/j.../logstash/ackedqueue/io	MmapPageIOV2.java MmapPageIOV1.java	112:149 102:139	view
26	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler/lscl	grammar.rb lscl_grammar.rb	457:488 433:464	view
26	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler/lscl	grammar.rb lscl_grammar.rb	1290:1321 1266:1297	view
22	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler	config_ast.rb treetop_monkeypatches.rb	563:588 86:111	view
18	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler/lscl	grammar.rb lscl_grammar.rb	2869:2892 2845:2868	view
14	x 2	logstash-core/src/main/java/org/logstash/util tools/jvm-options-parser.../org/logstash/launchers	JavaVersion.java JavaVersion.java	64:80 62:78	view
12	x 2	logstash-core/lib/logstash/config logstash-core/lib/logstash/compiler/lscl	grammar.rb lscl_grammar.rb	3160:3177 3136:3153	view
9	x 2	x-pack/spec/support logstash-core/spec/support	helpers.rb helpers.rb	63:75 138:150	view
9	x 2	logstash-core/src/main/java/org/logstash/util tools/jvm-options-parser.../org/logstash/launchers	JavaVersion.java JavaVersion.java	42:53 40:51	view
8	x 2	logstash-core/src/main/j.../logstash/ackedqueue/io logstash-core/src/main/j.../logstash/ackedqueue/io	MmapPageIOV2.java MmapPageIOV1.java	72:81 62:71	view
8	x 2	logstash-core/src/main/java/org/logstash logstash-core/src/main/java/org/logstash	Valuefier.java Javafier.java	114:123 62:71	view
7	x 2	logstash-core/src/main/j.../logstash/ackedqueue/io logstash-core/src/main/j.../logstash/ackedqueue/io	MmapPageIOV2.java MmapPageIOV1.java	405:413 326:334	view
6	x 2	logstash-core/src/main/java/org/logstash/util tools/jvm-options-parser.../org/logstash/launchers	JavaVersion.java JavaVersion.java	55:62 53:60	view