apache / bigtop - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

12% duplication:

25,783 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
3,275 duplicated lines

724 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
bigtop-deploy (<1%) --> bigtop-packages (<1%)	88	3 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 724 duplicates...

Size	#	Folders	Files	Lines	Code
92	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-kafka	bundle-local.yaml bundle.yaml	72:165 (56%) 72:165 (56%)	view
79	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-hbase	bundle-local.yaml bundle.yaml	64:142 (55%) 64:142 (55%)	view
64	x 2	bigtop-deploy/juju/hadoop-processing bigtop-deploy/juju/hadoop-processing	bundle-local.yaml bundle.yaml	43:106 (60%) 43:106 (60%)	view
62	x 2	bigtop-deploy/juju/spark-processing bigtop-deploy/juju/spark-processing	bundle-local.yaml bundle.yaml	19:80 (77%) 22:83 (74%)	view
45	x 2	bigtop-deploy/juju/hadoop-spark bigtop-deploy/juju/hadoop-spark	bundle-local.yaml bundle.yaml	43:87 (40%) 43:87 (41%)	view
44	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-processing	bundle.yaml bundle.yaml	6:49 (27%) 6:49 (41%)	view
44	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-processing	bundle-local.yaml bundle-local.yaml	6:49 (27%) 6:49 (41%)	view
44	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-processing	bundle-local.yaml bundle-local.yaml	7:50 (30%) 6:49 (41%)	view
44	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-kafka	bundle.yaml bundle.yaml	7:50 (30%) 6:49 (27%)	view
44	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-processing	bundle.yaml bundle.yaml	7:50 (30%) 6:49 (41%)	view
44	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-kafka	bundle-local.yaml bundle-local.yaml	7:50 (30%) 6:49 (27%)	view
35	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-spark	bundle-local.yaml bundle-local.yaml	6:40 (21%) 6:40 (31%)	view
35	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-spark	bundle-local.yaml bundle-local.yaml	7:41 (24%) 6:40 (31%)	view
35	x 2	bigtop-deploy/juju/hadoop-processing bigtop-deploy/juju/hadoop-spark	bundle-local.yaml bundle-local.yaml	6:40 (33%) 6:40 (31%)	view
35	x 2	bigtop-deploy/juju/hadoop-processing bigtop-deploy/juju/hadoop-spark	bundle.yaml bundle.yaml	6:40 (33%) 6:40 (32%)	view
35	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-spark	bundle.yaml bundle.yaml	7:41 (24%) 6:40 (32%)	view
35	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-spark	bundle.yaml bundle.yaml	6:40 (21%) 6:40 (32%)	view
34	x 2	bigtop-deploy/juju/hadoop-processing bigtop-deploy/juju/hadoop-spark	bundle-local.yaml bundle-local.yaml	48:81 (32%) 50:83 (30%)	view
34	x 2	bigtop-deploy/juju/hadoop-processing bigtop-deploy/juju/hadoop-spark	bundle-local.yaml bundle.yaml	48:81 (32%) 50:83 (31%)	view
34	x 2	bigtop-deploy/juju/hadoop-processing bigtop-deploy/juju/hadoop-spark	bundle.yaml bundle.yaml	48:81 (32%) 50:83 (31%)	view
34	x 2	bigtop-deploy/juju/hadoop-processing bigtop-deploy/juju/hadoop-spark	bundle.yaml bundle-local.yaml	48:81 (32%) 50:83 (30%)	view
33	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-processing	bundle.yaml bundle-local.yaml	89:121 (20%) 50:82 (31%)	view
33	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-kafka	bundle.yaml bundle-local.yaml	73:105 (23%) 89:121 (20%)	view
33	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-kafka	bundle-local.yaml bundle.yaml	73:105 (23%) 89:121 (20%)	view
33	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-processing	bundle-local.yaml bundle.yaml	73:105 (23%) 50:82 (31%)	view
33	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-processing	bundle-local.yaml bundle.yaml	89:121 (20%) 50:82 (31%)	view
33	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-processing	bundle-local.yaml bundle-local.yaml	73:105 (23%) 50:82 (31%)	view
33	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-kafka	bundle.yaml bundle.yaml	73:105 (23%) 89:121 (20%)	view
33	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-processing	bundle.yaml bundle-local.yaml	73:105 (23%) 50:82 (31%)	view
33	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-processing	bundle-local.yaml bundle-local.yaml	89:121 (20%) 50:82 (31%)	view
33	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-processing	bundle.yaml bundle.yaml	89:121 (20%) 50:82 (31%)	view
33	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-processing	bundle.yaml bundle.yaml	73:105 (23%) 50:82 (31%)	view
33	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-kafka	bundle-local.yaml bundle-local.yaml	73:105 (23%) 89:121 (20%)	view
32	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-spark	bundle.yaml bundle.yaml	89:120 (19%) 52:83 (29%)	view
32	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-spark	bundle-local.yaml bundle.yaml	89:120 (19%) 52:83 (29%)	view
32	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-spark	bundle-local.yaml bundle.yaml	73:104 (22%) 52:83 (29%)	view
32	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-spark	bundle.yaml bundle-local.yaml	73:104 (22%) 52:83 (29%)	view
32	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-spark	bundle.yaml bundle-local.yaml	89:120 (19%) 52:83 (29%)	view
32	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-spark	bundle-local.yaml bundle-local.yaml	73:104 (22%) 52:83 (29%)	view
32	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-spark	bundle.yaml bundle.yaml	73:104 (22%) 52:83 (29%)	view
32	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-spark	bundle-local.yaml bundle-local.yaml	89:120 (19%) 52:83 (29%)	view
27	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-kafka	bundle.yaml bundle.yaml	116:142 (19%) 136:162 (16%)	view
27	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-kafka	bundle-local.yaml bundle-local.yaml	116:142 (19%) 136:162 (16%)	view
27	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-kafka	bundle.yaml bundle-local.yaml	116:142 (19%) 136:162 (16%)	view
27	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-kafka	bundle-local.yaml bundle.yaml	116:142 (19%) 136:162 (16%)	view
24	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-spark	ci-info.yaml ci-info.yaml	3:26 (70%) 3:26 (70%)	view
24	x 2	bigtop-deploy/juju/hadoop-kafka bigtop-deploy/juju/hadoop-processing	ci-info.yaml ci-info.yaml	3:26 (70%) 3:26 (92%)	view
24	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-kafka	ci-info.yaml ci-info.yaml	3:26 (70%) 3:26 (70%)	view
24	x 2	bigtop-deploy/juju/hadoop-hbase bigtop-deploy/juju/hadoop-processing	ci-info.yaml ci-info.yaml	3:26 (70%) 3:26 (92%)	view
24	x 2	bigtop-deploy/juju/hadoop-processing bigtop-deploy/juju/hadoop-spark	ci-info.yaml ci-info.yaml	3:26 (92%) 3:26 (70%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
7	x 2	bigtop-data-generators/b...rs/products/collections bigtop-data-generators/b...rs/products/collections	SmallProductCollection.java MediumProductCollection.java	151:161 264:274	view