apache / datasketches-java

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

25% duplication:

44,707 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
11,311 duplicated lines

1,840 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,840 duplicates...

Size	#	Folders	Files	Lines	Code
127	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	4497:4630 (2%) 4761:4894 (2%)	view
127	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2645:2771 (2%) 3437:3563 (2%)	view
125	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	4497:4621 (2%) 5025:5149 (2%)	view
125	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	4761:4885 (2%) 5025:5149 (2%)	view
121	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	4765:4885 (2%) 5293:5413 (2%)	view
121	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	4501:4621 (2%) 5557:5677 (2%)	view
121	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	5293:5413 (2%) 5557:5677 (2%)	view
121	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	4765:4885 (2%) 5557:5677 (2%)	view
121	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	4501:4621 (2%) 5293:5413 (2%)	view
121	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2387:2507 (2%) 2651:2771 (2%)	view
121	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2387:2507 (2%) 3443:3563 (2%)	view
121	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	5029:5149 (2%) 5293:5413 (2%)	view
121	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	5029:5149 (2%) 5557:5677 (2%)	view
117	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2919:3035 (2%) 3183:3299 (2%)	view
116	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	4769:4884 (1%) 5825:5940 (1%)	view
116	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	5561:5676 (1%) 5825:5940 (1%)	view
116	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	5297:5412 (1%) 5825:5940 (1%)	view
116	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	5033:5148 (1%) 5825:5940 (1%)	view
116	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	4505:4620 (1%) 5825:5940 (1%)	view
113	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2139:2258 (1%) 2403:2522 (1%)	view
109	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2135:2243 (1%) 5569:5677 (1%)	view
109	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2135:2243 (1%) 5305:5413 (1%)	view
109	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	1871:1979 (1%) 5305:5413 (1%)	view
109	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	1871:1979 (1%) 5569:5677 (1%)	view
109	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	1871:1979 (1%) 2135:2243 (1%)	view
109	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	1871:1979 (1%) 4513:4621 (1%)	view
109	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	1871:1979 (1%) 4777:4885 (1%)	view
109	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	1871:1979 (1%) 5041:5149 (1%)	view
109	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2135:2243 (1%) 4513:4621 (1%)	view
109	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2135:2243 (1%) 5041:5149 (1%)	view
109	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2135:2243 (1%) 4777:4885 (1%)	view
108	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	1871:1978 (1%) 5833:5940 (1%)	view
108	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2135:2242 (1%) 5833:5940 (1%)	view
107	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2931:3044 (1%) 3459:3572 (1%)	view
106	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	1875:1987 (1%) 2667:2779 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	1875:1979 (1%) 3723:3827 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2667:2771 (1%) 2931:3035 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2667:2771 (1%) 5045:5149 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	3459:3563 (1%) 5573:5677 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2931:3035 (1%) 5309:5413 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	3195:3299 (1%) 5309:5413 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2667:2771 (1%) 4517:4621 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2667:2771 (1%) 4781:4885 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	3459:3563 (1%) 3723:3827 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	1875:1979 (1%) 3195:3299 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	1875:1979 (1%) 3459:3563 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2403:2507 (1%) 4517:4621 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2931:3035 (1%) 5045:5149 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2403:2507 (1%) 4781:4885 (1%)	view
105	x 2	src/main/java/org/apache/datasketches/cpc src/main/java/org/apache/datasketches/cpc	CompressionData.java CompressionData.java	2667:2771 (1%) 5309:5413 (1%)	view

Duplicated Units

The list of top 22 duplicated units.

See data for all 22 unit duplicates...

Size	#	Folders	Files	Lines	Code
22	x 3	src/main/java/org/apache/datasketches/kll src/main/java/org/apache/datasketches/kll src/main/java/org/apache/datasketches/kll	KllFloatsSketch.java KllLongsSketch.java KllDoublesSketch.java	567:590 568:591 568:591	view
20	x 2	src/main/java/org/apache/datasketches/quantiles src/main/java/org/apache/datasketches/quantiles	ItemsUtil.java DoublesUtil.java	131:152 163:184	view
20	x 2	src/main/java/org/apache/datasketches/theta src/main/java/org/apache/datasketches/theta	ConcurrentHeapQuickSelectSketch.java ConcurrentDirectQuickSelectSketch.java	201:223 206:228	view
19	x 2	src/main/java/org/apache/datasketches/sampling src/main/java/org/apache/datasketches/sampling	ReservoirItemsUnion.java ReservoirLongsUnion.java	399:435 350:386	view
15	x 2	src/main/java/org/apache/datasketches/frequencies src/main/java/org/apache/datasketches/frequencies	ReversePurgeItemHashMap.java ReversePurgeLongHashMap.java	281:300 315:334	view
14	x 2	src/main/java/org/apache/datasketches/theta src/main/java/org/apache/datasketches/theta	BytesCompactCompressedHashIterator.java MemoryCompactCompressedHashIterator.java	59:74 67:82	view
12	x 2	src/main/java/org/apache/datasketches/sampling src/main/java/org/apache/datasketches/sampling	ReservoirItemsUnion.java ReservoirLongsUnion.java	263:279 218:234	view
10	x 3	src/main/java/org/apache...ketches/quantilescommon src/main/java/org/apache...ketches/quantilescommon src/main/java/org/apache...ketches/quantilescommon	LongsSketchSortedView.java DoublesSketchSortedView.java FloatsSketchSortedView.java	97:108 97:108 97:108	view
10	x 2	src/main/java/org/apache/datasketches/sampling src/main/java/org/apache/datasketches/sampling	ReservoirItemsSketch.java ReservoirLongsSketch.java	405:419 353:367	view
9	x 4	src/main/java/org/apache/datasketches/kll src/main/java/org/apache/datasketches/kll src/main/java/org/apache/datasketches/kll src/main/java/org/apache/datasketches/kll	KllFloatsHelper.java KllDoublesHelper.java KllItemsHelper.java KllLongsHelper.java	282:293 282:293 284:295 282:293	view
9	x 4	src/main/java/org/apache/datasketches/kll src/main/java/org/apache/datasketches/kll src/main/java/org/apache/datasketches/kll src/main/java/org/apache/datasketches/kll	KllFloatsHelper.java KllDoublesHelper.java KllItemsHelper.java KllLongsHelper.java	303:314 303:314 305:316 303:314	view
8	x 3	src/main/java/org/apache...ketches/quantilescommon src/main/java/org/apache...ketches/quantilescommon src/main/java/org/apache...ketches/quantilescommon	LongsSketchSortedView.java DoublesSketchSortedView.java FloatsSketchSortedView.java	116:125 116:125 116:125	view
8	x 2	src/main/java/org/apache/datasketches/hll src/main/java/org/apache/datasketches/hll	Hll4Array.java DirectHll4Array.java	110:119 111:120	view
8	x 2	src/main/java/org/apache/datasketches/theta src/main/java/org/apache/datasketches/theta	ConcurrentHeapQuickSelectSketch.java ConcurrentDirectQuickSelectSketch.java	166:176 171:181	view
8	x 2	src/main/java/org/apache/datasketches/theta src/main/java/org/apache/datasketches/theta	ConcurrentHeapQuickSelectSketch.java ConcurrentDirectQuickSelectSketch.java	184:193 189:198	view
7	x 2	src/main/java/org/apache/datasketches/hll src/main/java/org/apache/datasketches/hll	Hll4Array.java DirectHll4Array.java	99:107 100:108	view
6	x 2	src/main/java/org/apache/datasketches/frequencies src/main/java/org/apache/datasketches/frequencies	ItemsSketch.java LongsSketch.java	544:551 616:623	view
6	x 2	src/main/java/org/apache/datasketches/frequencies src/main/java/org/apache/datasketches/frequencies	ItemsSketch.java LongsSketch.java	702:709 770:777	view
6	x 3	src/main/java/org/apache/datasketches/kll src/main/java/org/apache/datasketches/quantiles src/main/java/org/apache/datasketches/quantiles	KllHelper.java DoublesSketch.java ItemsSketch.java	147:154 782:789 717:724	view
6	x 2	src/main/java/org/apache/datasketches/hash src/main/java/org/apache/datasketches/hash	MurmurHash3.java MurmurHash3FFM21.java	430:437 349:356	view
6	x 2	src/main/java/org/apache/datasketches/hll src/main/java/org/apache/datasketches/hll	DirectHll8Array.java DirectHll6Array.java	53:61 51:58	view
6	x 2	src/main/java/org/apache/datasketches/theta src/main/java/org/apache/datasketches/theta	ConcurrentHeapQuickSelectSketch.java ConcurrentDirectQuickSelectSketch.java	253:264 258:268	view