uber / RedELK - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

20% duplication:

3,378 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
677 duplicated lines

77 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
elkserver (2%) --> example-data-and-configs (43%)	112	1 file pair	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 77 duplicates...

Size	#	Folders	Files	Lines	Code
28	x 2	elkserver/docker/redelk-.../modules/alarm_filehash elkserver/docker/redelk-...h_domainscategorization	ioc_vt.py cat_vt.py	27:63 (31%) 94:130 (35%)	view
25	x 2	elkserver/docker/redelk-...modules/enrich_csbeacon elkserver/docker/redelk-...s/modules/enrich_stage1	module.py module.py	82:111 (35%) 82:111 (35%)	view
25	x 2	elkserver/mounts/sample-...s/cobaltstrike/profiles example-data-and-configs/CobaltStrike	profile MallableConfig-DomainFronting.profile MallableConfig-DomainFronting.profile	1:29 (43%) 1:29 (43%)	view
21	x 2	elkserver/docker/redelk-...modules/enrich_csbeacon elkserver/docker/redelk-...s/modules/enrich_stage1	module.py module.py	49:79 (30%) 49:79 (30%)	view
17	x 2	elkserver/docker/redelk-...ules/alarm_backendalarm elkserver/docker/redelk-...modules/alarm_useragent	module.py module.py	39:57 (47%) 38:55 (30%)	view
16	x 2	elkserver/mounts/sample-...s/cobaltstrike/profiles example-data-and-configs/CobaltStrike	profile MallableConfig-DomainFronting.profile MallableConfig-DomainFronting.profile	31:49 (27%) 31:49 (27%)	view
15	x 2	elkserver/docker/redelk-...modules/enrich_csbeacon elkserver/docker/redelk-...s/modules/enrich_stage1	module.py module.py	25:46 (21%) 25:46 (21%)	view
15	x 2	elkserver/mounts/sample-...s/cobaltstrike/profiles example-data-and-configs/CobaltStrike	profile MallableConfig-DomainFronting.profile MallableConfig-DomainFronting.profile	52:69 (25%) 52:69 (25%)	view
14	x 2	example-data-and-configs/HAProxy example-data-and-configs/HAProxy	cfg haproxy.cfg haproxy.cfg	24:37 (19%) 51:64 (19%)	view
11	x 2	elkserver/docker/redelk-...dules/alarm_httptraffic elkserver/docker/redelk-...ts/modules/alarm_manual	module.py module.py	60:70 (11%) 58:68 (12%)	view
11	x 2	elkserver/docker/redelk-...pts/modules/alarm_dummy elkserver/docker/redelk-.../modules/alarm_filehash	module.py module.py	32:43 (26%) 49:60 (6%)	view
11	x 2	elkserver/docker/redelk-...dules/alarm_httptraffic elkserver/docker/redelk-.../modules/alarm_lastline	module.py module.py	38:48 (11%) 37:47 (25%)	view
10	x 2	elkserver/docker/redelk-...h_domainscategorization elkserver/docker/redelk-...h_domainscategorization	cat_ibmxforce.py cat_mcafee.py	31:43 (23%) 27:39 (16%)	view
10	x 2	elkserver/docker/redelk-...odules/enrich_greynoise elkserver/docker/redelk-...ipts/modules/enrich_tor	module.py module.py	70:79 (6%) 121:130 (8%)	view
10	x 2	elkserver/docker/redelk-...pts/modules/alarm_dummy elkserver/docker/redelk-...modules/alarm_useragent	module.py module.py	21:38 (24%) 23:38 (18%)	view
9	x 2	elkserver/docker/redelk-...pts/modules/alarm_dummy elkserver/docker/redelk-...dules/alarm_httptraffic	module.py module.py	21:37 (21%) 23:37 (9%)	view
9	x 2	elkserver/docker/redelk-...ules/alarm_backendalarm elkserver/docker/redelk-...ts/modules/alarm_manual	module.py module.py	23:39 (25%) 24:38 (10%)	view
9	x 2	elkserver/docker/redelk-...dules/alarm_httptraffic elkserver/docker/redelk-...modules/alarm_useragent	module.py module.py	23:37 (9%) 23:37 (16%)	view
9	x 2	elkserver/docker/redelk-...scripts/modules/msteams elkserver/docker/redelk-...a/scripts/modules/slack	module.py module.py	44:52 (21%) 50:58 (16%)	view
8	x 2	elkserver/docker/redelk-...ules/alarm_backendalarm elkserver/docker/redelk-...pts/modules/alarm_dummy	module.py module.py	23:38 (22%) 21:36 (19%)	view
8	x 2	elkserver/docker/redelk-...ules/alarm_backendalarm elkserver/docker/redelk-...modules/alarm_useragent	module.py module.py	23:38 (22%) 23:36 (14%)	view
8	x 2	elkserver/docker/redelk-...ules/alarm_backendalarm elkserver/docker/redelk-.../modules/alarm_lastline	module.py module.py	48:57 (22%) 48:57 (18%)	view
8	x 2	elkserver/docker/redelk-.../modules/alarm_filehash elkserver/docker/redelk-...h_domainscategorization	ioc_vt.py cat_vt.py	69:79 (8%) 136:146 (10%)	view
8	x 2	elkserver/docker/redelk-...ules/alarm_backendalarm elkserver/docker/redelk-.../modules/alarm_lastline	module.py module.py	23:38 (22%) 23:36 (18%)	view
8	x 2	elkserver/docker/redelk-...ts/modules/alarm_manual elkserver/docker/redelk-...modules/alarm_useragent	module.py module.py	24:37 (9%) 23:36 (14%)	view
8	x 2	elkserver/docker/redelk-.../modules/alarm_lastline elkserver/docker/redelk-...ts/modules/alarm_manual	module.py module.py	23:36 (18%) 24:37 (9%)	view
8	x 2	elkserver/docker/redelk-.../modules/alarm_lastline elkserver/docker/redelk-...modules/alarm_useragent	module.py module.py	23:36 (18%) 23:36 (14%)	view
8	x 2	elkserver/docker/redelk-.../modules/alarm_lastline elkserver/docker/redelk-...modules/alarm_useragent	module.py module.py	48:57 (18%) 47:55 (14%)	view
8	x 2	elkserver/docker/redelk-...pts/modules/alarm_dummy elkserver/docker/redelk-.../modules/alarm_lastline	module.py module.py	21:36 (19%) 23:36 (18%)	view
8	x 2	elkserver/docker/redelk-...pts/modules/alarm_dummy elkserver/docker/redelk-...ts/modules/alarm_manual	module.py module.py	21:36 (19%) 24:37 (9%)	view
8	x 2	elkserver/docker/redelk-...dules/alarm_httptraffic elkserver/docker/redelk-...ts/modules/alarm_manual	module.py module.py	23:36 (8%) 24:37 (9%)	view
8	x 2	elkserver/docker/redelk-...dules/alarm_httptraffic elkserver/docker/redelk-.../modules/alarm_lastline	module.py module.py	23:36 (8%) 23:36 (18%)	view
8	x 2	elkserver/docker/redelk-...ules/alarm_backendalarm elkserver/docker/redelk-...dules/alarm_httptraffic	module.py module.py	23:38 (22%) 23:36 (8%)	view
7	x 2	elkserver/docker/redelk-.../modules/alarm_filehash elkserver/docker/redelk-...h_domainscategorization	ioc_ibm.py cat_vt.py	81:88 (9%) 139:146 (8%)	view
7	x 2	elkserver/docker/redelk-...h_domainscategorization elkserver/docker/redelk-...h_domainscategorization	cat_ibmxforce.py cat_vt.py	31:38 (16%) 26:33 (8%)	view
7	x 2	elkserver/docker/redelk-.../modules/alarm_lastline elkserver/docker/redelk-...s/modules/enrich_stage1	module.py module.py	23:35 (16%) 25:37 (10%)	view
7	x 2	elkserver/docker/redelk-...pts/modules/alarm_dummy elkserver/docker/redelk-...s/modules/enrich_stage1	module.py module.py	21:35 (17%) 25:37 (10%)	view
7	x 2	elkserver/docker/redelk-.../modules/alarm_filehash elkserver/docker/redelk-.../modules/alarm_filehash	ioc_ibm.py ioc_vt.py	81:88 (9%) 72:79 (7%)	view
7	x 2	elkserver/docker/redelk-...ts/modules/alarm_manual elkserver/docker/redelk-...modules/enrich_csbeacon	module.py module.py	24:36 (8%) 25:37 (10%)	view
7	x 2	elkserver/docker/redelk-...dules/alarm_httptraffic elkserver/docker/redelk-...s/modules/enrich_stage1	module.py module.py	23:35 (7%) 25:37 (10%)	view
7	x 2	elkserver/docker/redelk-...ts/modules/alarm_manual elkserver/docker/redelk-...s/modules/enrich_stage1	module.py module.py	24:36 (8%) 25:37 (10%)	view
7	x 2	elkserver/docker/redelk-...modules/alarm_useragent elkserver/docker/redelk-...s/modules/enrich_stage1	module.py module.py	23:35 (12%) 25:37 (10%)	view
7	x 2	helper-scripts helper-scripts	export_kibana_config.py export_kibana_config.py	283:289 (2%) 294:300 (2%)	view
7	x 2	elkserver/docker/redelk-...h_domainscategorization elkserver/docker/redelk-...h_domainscategorization	cat_mcafee.py cat_vt.py	27:34 (11%) 26:33 (8%)	view
7	x 2	helper-scripts helper-scripts	export_kibana_config.py export_kibana_config.py	275:281 (2%) 294:300 (2%)	view
7	x 2	elkserver/docker/redelk-...h_domainscategorization elkserver/docker/redelk-...h_domainscategorization	cat_ibmxforce.py cat_mcafee.py	71:78 (16%) 96:104 (11%)	view
7	x 2	elkserver/docker/redelk-...dules/alarm_httptraffic elkserver/docker/redelk-...modules/enrich_csbeacon	module.py module.py	23:35 (7%) 25:37 (10%)	view
7	x 2	elkserver/docker/redelk-.../modules/alarm_lastline elkserver/docker/redelk-...modules/enrich_csbeacon	module.py module.py	23:35 (16%) 25:37 (10%)	view
7	x 2	elkserver/docker/redelk-...modules/alarm_useragent elkserver/docker/redelk-...modules/enrich_csbeacon	module.py module.py	23:35 (12%) 25:37 (10%)	view
7	x 2	elkserver/docker/redelk-...dules/alarm_httptraffic elkserver/docker/redelk-...odules/enrich_greynoise	module.py module.py	119:129 (7%) 90:99 (4%)	view