apache / datasketches-characterization

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

26% duplication:

12,152 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
3,199 duplicated lines

277 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 277 duplicates...

Size	#	Folders	Files	Lines	Code
82	x 2	src/main/java/org/apache...cterization/uniquecount src/main/java/org/apache...cterization/uniquecount	BaseMergeSpeedProfile.java BaseMergeSpeedProfile2.java	34:147 (98%) 30:143 (98%)	view
51	x 2	src/main/java/org/apache...etches/characterization src/main/java/org/apache...etches/characterization	DoubleStreamMaker.java StreamMaker.java	55:118 (56%) 47:110 (56%)	view
49	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllDoublesSketchWeightedRankGaussianA... KllFloatsSketchWeightedRankGaussianAc...	70:140 (47%) 70:140 (47%)	view
48	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllSketchSizeSpeedProfile.java KllSketchVectorSizeSpeedProfile.java	83:160 (46%) 81:158 (45%)	view
40	x 2	src/main/java/org/apache...haracterization/filters src/main/java/org/apache...cterization/uniquecount	BaseFilterUpdateSpeedProfile.java BaseUpdateSpeedProfile.java	95:172 (47%) 98:174 (47%)	view
39	x 2	src/main/java/org/apache...haracterization/filters src/main/java/org/apache...cterization/uniquecount	BaseFilterUpdateSpeedProfile.java BaseUpdateSpeedProfile.java	34:93 (46%) 37:96 (46%)	view
32	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllDoublesSketchRankGaussianAccuracyP... KllFloatsSketchRankGaussianAccuracyPr...	83:127 (24%) 83:127 (24%)	view
26	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/req	KllSketchVectorSizeSpeedProfile.java ReqSketchSizeSpeedProfile.java	108:144 (24%) 103:139 (29%)	view
26	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/req	KllSketchSizeSpeedProfile.java ReqSketchSizeSpeedProfile.java	110:146 (25%) 103:139 (29%)	view
25	x 2	cpp/src cpp/src	kll_merge_timing_profile_impl.hpp req_merge_timing_profile_impl.hpp	72:105 (40%) 74:107 (39%)	view
25	x 2	src/main/java/org/apache...cterization/uniquecount src/main/java/org/apache...cterization/uniquecount	BaseAccuracyProfile.java BaseBoundsAccuracyProfile.java	274:308 (13%) 241:275 (15%)	view
24	x 2	cpp/src cpp/src	theta_union_timing_profile.cpp tuple_union_timing_profile.cpp	108:139 (29%) 117:146 (28%)	view
24	x 2	src/main/java/org/apache...racterization/quantiles src/main/java/org/apache...racterization/quantiles	ExactStreamAProfile.java QuantilesStreamAProfile.java	211:244 (16%) 182:215 (20%)	view
23	x 2	cpp/src cpp/src	kll_sketch_timing_profile_impl.hpp req_sketch_timing_profile_impl.hpp	83:111 (25%) 85:113 (24%)	view
22	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllDoublesSketchRankGaussianAccuracyP... KllFloatsSketchRankGaussianAccuracyPr...	152:183 (17%) 152:183 (17%)	view
21	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllSketchSizeSpeedProfile.java KllSketchVectorSizeSpeedProfile.java	166:203 (20%) 164:202 (20%)	view
21	x 2	src/main/java/org/apache...etches/characterization src/main/java/org/apache...etches/characterization	DoubleFlipFlopStream.java FlipFlopStream.java	45:74 (47%) 49:78 (47%)	view
20	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllDoublesSketchWeightedRankGaussianA... KllItemsSketchWeightedRankGaussianAcc...	80:105 (19%) 82:107 (21%)	view
20	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllFloatsSketchWeightedRankGaussianAc... KllItemsSketchWeightedRankGaussianAcc...	80:105 (19%) 82:107 (21%)	view
19	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/req	KllDoublesSketchRankGaussianAccuracyP... ReqSketchAccuracyProfile.java	154:181 (14%) 206:235 (9%)	view
19	x 2	src/main/java/org/apache...es/characterization/req src/main/java/org/apache...es/characterization/req	ReqSketchLongSizeSpeedProfile.java ReqSketchSizeSpeedProfile.java	82:114 (23%) 89:124 (21%)	view
19	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/req	KllFloatsSketchRankGaussianAccuracyPr... ReqSketchAccuracyProfile.java	154:181 (14%) 206:235 (9%)	view
18	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllDoublesSketchWeightedRankGaussianA... KllFloatsSketchWeightedRankGaussianAc...	147:181 (17%) 147:181 (17%)	view
18	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllDoublesSketchWeightedRankGaussianA... KllItemsSketchWeightedRankGaussianAcc...	147:181 (17%) 144:178 (19%)	view
18	x 2	cpp/src cpp/src	kll_sketch_timing_profile_impl.hpp req_sketch_timing_profile_impl.hpp	60:81 (19%) 62:83 (19%)	view
18	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllFloatsSketchWeightedRankGaussianAc... KllItemsSketchWeightedRankGaussianAcc...	147:181 (17%) 144:178 (19%)	view
17	x 2	cpp/src cpp/src	theta_sketch_timing_profile.cpp tuple_sketch_timing_profile.cpp	45:67 (30%) 45:67 (31%)	view
17	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllDoublesSketchWeightedRankGaussianA... KllFloatsSketchWeightedRankGaussianAc...	42:65 (16%) 42:65 (16%)	view
17	x 2	src/main/java/org/apache...cterization/frequencies src/main/java/org/apache...racterization/quantiles	BaseFrequenciesSpeedProfile.java BaseQuantilesSpeedProfile.java	30:52 (40%) 30:54 (41%)	view
16	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllSketchSizeSpeedProfile.java KllSketchVectorSizeSpeedProfile.java	58:81 (15%) 56:79 (15%)	view
16	x 2	cpp/src cpp/src	tdigest_merge_timing_profile_impl.hpp tdigest_timing_profile_impl.hpp	70:100 (35%) 74:104 (34%)	view
16	x 2	src/main/java/org/apache...es/characterization/hll src/main/java/org/apache...es/characterization/hll	HllAccuracyProfile.java HllBoundsAccuracyProfile.java	43:62 (20%) 41:60 (36%)	view
14	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/req	KllSketchSizeSpeedProfile.java ReqSketchSizeSpeedProfile.java	176:203 (13%) 158:184 (15%)	view
14	x 2	cpp/src cpp/src	theta_union_timing_profile.cpp tuple_union_timing_profile.cpp	56:71 (17%) 60:75 (16%)	view
14	x 2	cpp/src cpp/src	tdigest_merge_timing_profile_impl.hpp tdigest_timing_profile_impl.hpp	30:47 (31%) 31:48 (30%)	view
14	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllDoublesSketchRankGaussianAccuracyP... KllFloatsSketchRankGaussianAccuracyPr...	47:68 (10%) 47:68 (10%)	view
14	x 2	cpp/src cpp/src	kll_sketch_timing_profile_impl.hpp req_sketch_timing_profile_impl.hpp	127:143 (15%) 128:144 (15%)	view
14	x 2	cpp/src cpp/src	cpc_union_timing_profile.cpp hll_union_timing_profile.cpp	69:85 (19%) 69:85 (20%)	view
14	x 2	cpp/src cpp/src	tdigest_merge_timing_profile_impl.hpp tdigest_timing_profile_impl.hpp	49:68 (31%) 52:71 (30%)	view
14	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/req	KllSketchVectorSizeSpeedProfile.java ReqSketchSizeSpeedProfile.java	175:202 (13%) 158:184 (15%)	view
13	x 2	cpp/src cpp/src	distinct_count_accuracy_profile.cpp memory_usage_profile.cpp	129:144 (15%) 89:104 (23%)	view
13	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/req	KllSketchSizeSpeedProfile.java ReqSketchLongSizeSpeedProfile.java	110:131 (12%) 93:114 (15%)	view
13	x 2	src/main/java/org/apache...haracterization/filters src/main/java/org/apache...cterization/uniquecount	BaseFilterUpdateSpeedProfile.java BaseSerDeProfile.java	109:135 (15%) 123:149 (13%)	view
13	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllDoublesSketchRankGaussianAccuracyP... KllFloatsSketchRankGaussianAccuracyPr...	235:253 (10%) 235:253 (10%)	view
13	x 2	src/main/java/org/apache...s/characterization/hash src/main/java/org/apache...characterization/memory	BaseHashSpeedProfile.java BaseSpeedProfile.java	112:138 (18%) 135:161 (14%)	view
13	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/req	KllSketchVectorSizeSpeedProfile.java ReqSketchLongSizeSpeedProfile.java	108:129 (12%) 93:114 (15%)	view
13	x 2	src/main/java/org/apache...cterization/uniquecount src/main/java/org/apache...cterization/uniquecount	BaseSerDeProfile.java BaseUpdateSpeedProfile.java	123:149 (13%) 111:137 (15%)	view
13	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllDoublesSketchRankGaussianAccuracyP... KllFloatsSketchRankGaussianAccuracyPr...	197:220 (10%) 197:220 (10%)	view
13	x 2	src/main/java/org/apache...cterization/uniquecount src/main/java/org/apache...cterization/uniquecount	BaseAccuracyProfile.java BaseBoundsAccuracyProfile.java	82:122 (7%) 72:112 (7%)	view
13	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllSketchSizeSpeedProfile.java KllSketchVectorSizeSpeedProfile.java	38:56 (12%) 36:54 (12%)	view

Duplicated Units

The list of top 26 duplicated units.

See data for all 26 unit duplicates...

Size	#	Folders	Files	Lines	Code
26	x 2	src/main/java/org/apache...cterization/uniquecount src/main/java/org/apache...cterization/uniquecount	BaseMergeSpeedProfile.java BaseMergeSpeedProfile2.java	85:114 81:110	view
20	x 3	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/req	KllDoublesSketchRankGaussianAccuracyP... KllFloatsSketchRankGaussianAccuracyPr... ReqSketchAccuracyProfile.java	152:178 152:178 204:232	view
18	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllSketchSizeSpeedProfile.java KllSketchVectorSizeSpeedProfile.java	131:151 129:149	view
17	x 2	src/main/java/org/apache...etches/characterization src/main/java/org/apache...etches/characterization	FlipFlopStream.java DoubleFlipFlopStream.java	63:81 59:77	view
16	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllFloatsSketchWeightedRankGaussianAc... KllDoublesSketchWeightedRankGaussianA...	91:115 91:115	view
16	x 2	src/main/java/org/apache...haracterization/filters src/main/java/org/apache...cterization/uniquecount	BaseFilterUpdateSpeedProfile.java BaseUpdateSpeedProfile.java	46:63 49:66	view
16	x 2	src/main/java/org/apache...racterization/quantiles src/main/java/org/apache...racterization/quantiles	QuantilesStreamAProfile.java ExactStreamAProfile.java	182:199 211:228	view
15	x 3	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllItemsSketchWeightedRankGaussianAcc... KllFloatsSketchWeightedRankGaussianAc... KllDoublesSketchWeightedRankGaussianA...	144:168 147:171 147:171	view
15	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllSketchSizeSpeedProfile.java KllSketchVectorSizeSpeedProfile.java	91:107 89:105	view
13	x 2	src/main/java/org/apache...characterization/memory src/main/java/org/apache...s/characterization/hash	BaseSpeedProfile.java BaseHashSpeedProfile.java	148:162 125:139	view
13	x 4	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/req src/main/java/org/apache...es/characterization/req	KllSketchSizeSpeedProfile.java KllSketchVectorSizeSpeedProfile.java ReqSketchLongSizeSpeedProfile.java ReqSketchSizeSpeedProfile.java	190:204 189:203 161:175 171:185	view
13	x 5	src/main/java/org/apache...haracterization/filters src/main/java/org/apache...haracterization/filters src/main/java/org/apache...haracterization/filters src/main/java/org/apache...cterization/uniquecount src/main/java/org/apache...cterization/uniquecount	BaseFilterUpdateSpeedProfile.java BaseFilterAccuracyProfile.java BaseSpaceProfile.java BaseSerDeProfile.java BaseUpdateSpeedProfile.java	122:136 162:176 132:146 136:150 124:138	view
12	x 3	src/main/java/org/apache/datasketches src/main/java/org/apache...es/characterization/hll src/main/java/org/apache/datasketches	DumpSketchSegment.java HllJavaCppGenerator.java Files.java	65:78 217:230 1080:1093	view
12	x 2	src/main/java/org/apache...cterization/uniquecount src/main/java/org/apache...cterization/uniquecount	BaseMergeSpeedProfile.java BaseMergeSpeedProfile2.java	48:61 44:57	view
11	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllDoublesSketchRankGaussianAccuracyP... KllFloatsSketchRankGaussianAccuracyPr...	108:124 108:124	view
10	x 2	src/main/java/org/apache...characterization/memory src/main/java/org/apache...s/characterization/hash	BaseSpeedProfile.java HashLongsSpeedProfile.java	57:68 67:78	view
10	x 2	src/main/java/org/apache...cterization/uniquecount src/main/java/org/apache...cterization/uniquecount	BaseMergeSpeedProfile.java BaseMergeSpeedProfile2.java	116:129 112:125	view
9	x 2	src/main/java/org/apache...haracterization/filters src/main/java/org/apache...cterization/uniquecount	BaseFilterUpdateSpeedProfile.java BaseUpdateSpeedProfile.java	146:157 148:159	view
9	x 2	src/main/java/org/apache...haracterization/filters src/main/java/org/apache...cterization/uniquecount	BaseFilterUpdateSpeedProfile.java BaseUpdateSpeedProfile.java	163:173 165:175	view
9	x 2	src/main/java/org/apache...cterization/uniquecount src/main/java/org/apache...cterization/uniquecount	BaseMergeSpeedProfile.java BaseMergeSpeedProfile2.java	131:141 127:137	view
9	x 2	src/main/java/org/apache...zation/theta/concurrent src/main/java/org/apache...zation/theta/concurrent	ConcurrentThetaUpdateSpeedProfile.java ConcurrentThetaAccuracyProfile.java	92:102 93:103	view
8	x 2	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllFloatsSketchWeightedRankGaussianAc... KllDoublesSketchWeightedRankGaussianA...	117:126 117:126	view
7	x 3	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll	KllItemsSketchWeightedRankGaussianAcc... KllFloatsSketchWeightedRankGaussianAc... KllDoublesSketchWeightedRankGaussianA...	83:91 81:89 81:89	view
7	x 4	src/main/java/org/apache...es/characterization/cpc src/main/java/org/apache...haracterization/filters src/main/java/org/apache...es/characterization/hll src/main/java/org/apache.../characterization/theta	CpcUpdateSpeedProfile.java BloomFilterUpdateSpeedProfile.java HllUpdateSpeedProfile.java ThetaUpdateSpeedProfile.java	38:47 37:46 55:64 62:71	view
7	x 2	src/main/java/org/apache...haracterization/filters src/main/java/org/apache...haracterization/filters	BaseFilterAccuracyProfile.java BaseSpaceProfile.java	204:212 165:173	view
6	x 4	src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/kll src/main/java/org/apache...es/characterization/req src/main/java/org/apache...es/characterization/req	KllSketchSizeSpeedProfile.java KllSketchVectorSizeSpeedProfile.java ReqSketchLongSizeSpeedProfile.java ReqSketchSizeSpeedProfile.java	111:118 109:116 94:101 104:111	view