apache / spamassassin

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

16% duplication:

85,154 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
14,018 duplicated lines

2,914 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
lib (<1%) --> t (<1%)	356	195 file pairs	details...
lib (<1%) --> rulesrc (23%)	290	76 file pairs	details...
lib (<1%) --> masses (2%)	186	31 file pairs	details...
sql (19%) --> t (<1%)	107	9 file pairs	details...
masses (<1%) --> t (<1%)	54	5 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 2,914 duplicates...

Size	#	Folders	Files	Lines	Code
216	x 2	t/data/spam/olevbmacro t/data/spam/olevbmacro	eml macro.eml renamedmacro.eml	41:256 (85%) 42:257 (85%)	view
166	x 2	t t	t spf.t spf_welcome_block.t	94:341 (46%) 83:331 (47%)	view
86	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	MySQL.pm PgSQL.pm	672:824 (11%) 780:934 (14%)	view
82	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	MySQL.pm PgSQL.pm	67:196 (11%) 71:200 (13%)	view
76	x 2	t t	t bayessdbm.t bayessdbm_seen_delete.t	15:137 (47%) 14:136 (46%)	view
75	x 2	t t	t spf.t spf_welcome_block.t	386:499 (21%) 376:489 (21%)	view
74	x 2	t/data/spam/olevbmacro t/data/spam/olevbmacro	eml malicemacro.eml renamedmacro.eml	42:115 (28%) 42:115 (29%)	view
74	x 2	t/data/spam/olevbmacro t/data/spam/olevbmacro	eml macro.eml malicemacro.eml	41:114 (29%) 42:115 (28%)	view
69	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	MySQL.pm PgSQL.pm	466:578 (9%) 466:578 (11%)	view
59	x 2	t t	t freemail.t freemail_welcome_block.t	64:138 (58%) 64:138 (58%)	view
55	x 2	t t	t uri_html.t uri_saferedirect.t	13:82 (70%) 13:82 (70%)	view
55	x 2	t t	t bayesbdb.t bayesdbm.t	155:250 (33%) 170:265 (31%)	view
53	x 2	t t	t priorities.t priorities_welcome_block.t	23:83 (40%) 16:76 (42%)	view
50	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	MySQL.pm PgSQL.pm	202:296 (6%) 203:297 (8%)	view
48	x 2	t t	t bayesdbm.t bayessdbm_seen_delete.t	63:136 (27%) 63:136 (29%)	view
48	x 2	t t	t bayesdbm.t bayessdbm.t	63:136 (27%) 64:137 (30%)	view
47	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	DBM.pm SQL.pm	1713:1766 (3%) 1470:1523 (3%)	view
47	x 2	t t	t bayessdbm.t bayessdbm_seen_delete.t	200:276 (29%) 203:279 (28%)	view
45	x 2	t t	t bayesdbm.t bayesdbm_flock.t	200:279 (26%) 195:274 (27%)	view
45	x 2	t/data/geodb t/data/geodb	create_GeoIP2-City.pl create_GeoIP2-City.pl	38:82 (35%) 85:129 (35%)	view
45	x 2	t t	t bayesdbm_flock.t bayessdbm.t	179:262 (27%) 174:257 (28%)	view
42	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	MySQL.pm SQL.pm	829:899 (5%) 1731:1801 (3%)	view
36	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	MySQL.pm PgSQL.pm	301:369 (5%) 301:370 (6%)	view
35	x 2	t t	t bayesdbm.t bayessdbm.t	200:267 (20%) 190:257 (21%)	view
34	x 2	t t	t bayesbdb.t bayessdbm.t	185:250 (20%) 190:255 (21%)	view
34	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	PgSQL.pm SQL.pm	485:535 (5%) 990:1040 (2%)	view
34	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	MySQL.pm SQL.pm	485:535 (4%) 990:1040 (2%)	view
34	x 2	t t	t mkrules.t mkrules_else.t	429:474 (9%) 136:182 (25%)	view
34	x 2	t t	t bayesbdb.t bayesdbm_flock.t	185:250 (20%) 195:260 (20%)	view
34	x 2	lib/Mail/SpamAssassin lib/Mail/SpamAssassin	ArchiveIterator.pm ArchiveIterator.pm	965:1003 (4%) 1092:1130 (4%)	view
33	x 2	t t	t freemail.t freemail_welcome_block.t	22:61 (32%) 22:61 (32%)	view
33	x 2	t t	t spf.t spf_welcome_block.t	21:53 (9%) 19:51 (9%)	view
33	x 2	t/data/spam/extracttext t/data/spam/extracttext	eml gtube_png.eml gtube_png.eml	1033:1065 (3%) 1052:1084 (3%)	view
32	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	MySQL.pm SQL.pm	382:435 (4%) 829:882 (2%)	view
32	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	BDB.pm DBM.pm	1236:1274 (3%) 1735:1773 (2%)	view
31	x 2	t t	t bayesbdb.t bayesdbm.t	42:95 (18%) 32:85 (17%)	view
31	x 2	t t	t bayesdbm.t bayessdbm_seen_delete.t	210:267 (17%) 203:260 (19%)	view
31	x 2	t t	t bayesdbm_flock.t bayessdbm_seen_delete.t	205:262 (19%) 203:260 (19%)	view
30	x 2	t t	t bayesbdb.t bayessdbm_seen_delete.t	195:250 (18%) 203:258 (18%)	view
29	x 2	t t	t priorities.t priorities_welcome_block.t	138:176 (22%) 131:169 (23%)	view
28	x 2	t t	t sql_based_welcomelist.t sql_based_whitelist.t	110:143 (26%) 110:143 (26%)	view
28	x 2	t t	t priorities.t priorities_welcome_block.t	99:134 (21%) 92:127 (22%)	view
27	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	BDB.pm SQL.pm	1236:1267 (3%) 1492:1523 (2%)	view
26	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	BDB.pm SQL.pm	1328:1370 (3%) 1586:1628 (2%)	view
26	x 2	t t	t bayesdbm.t bayessql.t	172:213 (15%) 337:379 (7%)	view
26	x 2	t t	t bayesbdb.t bayessql.t	157:198 (15%) 337:379 (7%)	view
26	x 2	lib/Mail/SpamAssassin/Plugin lib/Mail/SpamAssassin/Plugin	SPF.pm SPF.pm	459:488 (4%) 510:539 (4%)	view
25	x 2	t/data/spam t/data/spam	eml gtubedcc.eml gtubedcc_crlf.eml	1:31 (100%) 1:31 (100%)	view
25	x 2	t t	t spf.t spf_welcome_block.t	55:86 (7%) 52:83 (7%)	view
25	x 2	t t	t sa_txrep_sql.t sa_txrep_welcomelist_out.t	71:96 (21%) 69:93 (9%)	view

Duplicated Units

The list of top 21 duplicated units.

See data for all 21 unit duplicates...

Size	#	Folders	Files	Lines	Code
74	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	PgSQL.pm MySQL.pm	71:180 67:176	view
39	x 2	t t	t uri_html.t uri_saferedirect.t	47:98 47:98	view
40	x 2	t t	t sql_based_welcomelist.t sql_based_whitelist.t	94:147 94:147	view
37	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	PgSQL.pm MySQL.pm	497:542 497:542	view
34	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	PgSQL.pm MySQL.pm	859:906 749:796	view
29	x 2	t t	t priorities.t priorities_welcome_block.t	134:176 127:169	view
23	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	PgSQL.pm MySQL.pm	808:845 699:735	view
17	x 2	lib/Mail/SpamAssassin/Plugin lib/Mail/SpamAssassin/Plugin	DecodeShortURLs.pm Redirectors.pm	964:991 1014:1041	view
16	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	PgSQL.pm MySQL.pm	227:250 226:249	view
15	x 2	t t	t mkrules_else.t mkrules.t	152:173 445:465	view
15	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	PgSQL.pm MySQL.pm	261:283 260:282	view
14	x 4	t t t t	t root_spamd_tell_x.t root_spamd_tell.t root_spamd_tell_paranoid.t root_spamd_tell_x_paranoid.t	48:65 48:65 48:65 48:65	view
12	x 3	t t t	t bayesbdb.t bayessql.t bayesdbm.t	256:272 459:475 271:287	view
12	x 2	lib/Mail/SpamAssassin/BayesStore lib/Mail/SpamAssassin/BayesStore	PgSQL.pm MySQL.pm	326:345 326:344	view
10	x 3	t t t	t bayessdbm.t bayessdbm_seen_delete.t bayesdbm_flock.t	263:276 266:279 266:279	view
9	x 2	lib/Mail/SpamAssassin lib/Mail/SpamAssassin/Plugin	Bayes.pm Bayes.pm	88:101 468:483	view
8	x 2	t t	t line_endings.t report_safe.t	131:142 28:39	view
8	x 2	lib/Mail/SpamAssassin/Plugin lib/Mail/SpamAssassin/Plugin	URIDetail.pm Shortcircuit.pm	112:126 53:65	view
8	x 2	lib/Mail/SpamAssassin/Conf lib/Mail/SpamAssassin/Conf	SQL.pm LDAP.pm	55:66 55:66	view
7	x 2	lib/Mail/SpamAssassin/Plugin lib/Mail/SpamAssassin/Plugin	P595Body.pm Rule2XSBody.pm	181:191 297:307	view
6	x 3	t/data t/data lib/Mail/SpamAssassin/Plugin	reporterplugin.pm validuserplugin.pm Check.pm	18:28 17:27 38:47	view