apache / tsfile - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

16% duplication:

60,092 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
10,075 duplicated lines

1,695 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
cpp (1%) --> java (<1%)	514	7 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,695 duplicates...

Size	#	Folders	Files	Lines	Code
166	x 2	cpp/src/parser java/tsfile/src/main/ant...rg/apache/tsfile/parser	PathLexer.g4 PathLexer.g4	1:212 (100%) 1:212 (100%)	view
55	x 2	cpp/src/parser java/tsfile/src/main/ant...rg/apache/tsfile/parser	PathParser.g4 PathParser.g4	1:67 (100%) 1:67 (100%)	view
47	x 2	java/tsfile/src/main/jav...pache/tsfile/write/page java/tsfile/src/main/jav...pache/tsfile/write/page	PageWriter.java ValuePageWriter.java	238:308 (27%) 282:350 (23%)	view
44	x 2	cpp/src/common/container cpp/src/common/container	hash_table.h hash_table.h	624:671 (7%) 681:728 (7%)	view
40	x 2	java/tsfile/src/main/java/org/apache/tsfile/write java/tsfile/src/main/jav.../apache/tsfile/write/v4	TsFileWriter.java AbstractTableModelTsFileWriter.java	183:230 (9%) 94:142 (28%)	view
38	x 2	java/tsfile/src/main/jav...sfile/read/common/block java/tsfile/src/main/jav...sfile/read/common/block	TsBlockBuilder.java TsBlockBuilder.java	106:143 (18%) 176:213 (18%)	view
35	x 2	java/tsfile/src/main/jav...ache/tsfile/read/common java/tsfile/src/main/jav...ache/tsfile/read/common	BatchData.java DescReadWriteBatchData.java	725:759 (6%) 466:500 (10%)	view
35	x 2	java/tsfile/src/main/jav...le/fileSystem/fsFactory java/tsfile/src/main/jav...le/fileSystem/fsFactory	HDFSFactory.java OSFSFactory.java	92:138 (19%) 91:137 (19%)	view
32	x 2	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java LongRLBE.java	225:289 (23%) 208:272 (25%)	view
31	x 2	java/tsfile/src/main/jav...pache/tsfile/write/page java/tsfile/src/main/jav...pache/tsfile/write/page	PageWriter.java TimePageWriter.java	227:267 (18%) 110:150 (30%)	view
29	x 2	java/tsfile/src/main/java/org/apache/tsfile/read java/tsfile/src/main/java/org/apache/tsfile/read	TsFileSequenceReader.java TsFileSequenceReader.java	2242:2273 (1%) 2472:2502 (1%)	view
28	x 2	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	FloatRLBEDecoder.java LongRLBEDecoder.java	128:193 (33%) 128:193 (33%)	view
28	x 2	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	IntRLBEDecoder.java LongRLBEDecoder.java	127:192 (34%) 128:193 (33%)	view
28	x 2	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	FloatRLBEDecoder.java IntRLBEDecoder.java	128:193 (33%) 127:192 (34%)	view
28	x 2	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	DoubleRLBEDecoder.java LongRLBEDecoder.java	69:115 (33%) 69:115 (33%)	view
28	x 2	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	DoubleRLBEDecoder.java LongRLBEDecoder.java	129:194 (33%) 128:193 (33%)	view
28	x 2	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	DoubleRLBEDecoder.java IntRLBEDecoder.java	129:194 (33%) 127:192 (34%)	view
28	x 2	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	DoubleRLBEDecoder.java FloatRLBEDecoder.java	129:194 (33%) 128:193 (33%)	view
27	x 2	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	FloatRLBEDecoder.java IntRLBEDecoder.java	69:114 (32%) 69:114 (32%)	view
27	x 2	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java IntRLBE.java	142:196 (20%) 130:184 (21%)	view
26	x 2	java/tsfile/src/main/jav...ache/tsfile/write/chunk java/tsfile/src/main/jav...ache/tsfile/write/chunk	ChunkWriterImpl.java TimeChunkWriter.java	424:452 (8%) 210:238 (12%)	view
25	x 2	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	BooleanColumn.java DoubleColumn.java	111:148 (18%) 112:149 (18%)	view
25	x 2	java/tsfile/src/main/jav...pache/tsfile/write/page java/tsfile/src/main/jav...pache/tsfile/write/page	TimePageWriter.java ValuePageWriter.java	121:150 (24%) 282:311 (12%)	view
25	x 2	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	FloatColumn.java LongColumn.java	127:164 (17%) 127:164 (17%)	view
25	x 2	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	BooleanColumn.java FloatColumn.java	111:148 (18%) 127:164 (17%)	view
25	x 2	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	FloatColumn.java IntColumn.java	127:164 (17%) 155:192 (15%)	view
25	x 2	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	BooleanColumn.java IntColumn.java	111:148 (18%) 155:192 (15%)	view
25	x 2	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	DoubleColumn.java LongColumn.java	112:149 (18%) 127:164 (17%)	view
25	x 2	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	DoubleColumn.java IntColumn.java	112:149 (18%) 155:192 (15%)	view
25	x 2	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	IntColumn.java LongColumn.java	155:192 (15%) 127:164 (17%)	view
25	x 2	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	BooleanColumn.java LongColumn.java	111:148 (18%) 127:164 (17%)	view
25	x 2	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	DoubleColumn.java FloatColumn.java	112:149 (18%) 127:164 (17%)	view
23	x 2	cpp/src/writer cpp/src/writer	tsfile_writer.cc tsfile_writer.cc	378:408 (2%) 467:497 (2%)	view
23	x 2	java/tsfile/src/main/java/org/apache/tsfile/write java/tsfile/src/main/jav.../apache/tsfile/write/v4	TsFileWriter.java AbstractTableModelTsFileWriter.java	625:650 (5%) 208:233 (16%)	view
23	x 2	java/tsfile/src/main/jav...ache/tsfile/write/chunk java/tsfile/src/main/jav...ache/tsfile/write/chunk	AlignedChunkWriterImpl.java AlignedChunkWriterImpl.java	61:87 (6%) 92:118 (6%)	view
23	x 2	java/tsfile/src/main/jav...ache/tsfile/write/chunk java/tsfile/src/main/jav...ache/tsfile/write/chunk	AlignedChunkWriterImpl.java AlignedChunkWriterImpl.java	193:219 (6%) 225:251 (6%)	view
23	x 2	cpp/src/common/container cpp/src/common/container	array.h sorted_array.h	71:116 (15%) 75:120 (12%)	view
23	x 2	cpp/src/common/container cpp/src/common/container	hash_table.h hash_table.h	369:394 (4%) 474:499 (4%)	view
22	x 2	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	IntZigzagDecoder.java LongZigzagDecoder.java	62:91 (56%) 70:98 (48%)	view
22	x 2	java/tsfile/src/main/jav...ile/metadata/statistics java/tsfile/src/main/jav...ile/metadata/statistics	DoubleStatistics.java FloatStatistics.java	234:259 (13%) 222:247 (14%)	view
21	x 2	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java IntRLBE.java	250:289 (15%) 237:276 (16%)	view
21	x 2	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	IntRLBE.java LongRLBE.java	237:276 (16%) 233:272 (16%)	view
20	x 2	cpp/src/encoding cpp/src/encoding	zigzag_decoder.h zigzag_decoder.h	132:155 (16%) 165:188 (16%)	view
20	x 2	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	TSEncodingBuilder.java TSEncodingBuilder.java	163:188 (8%) 214:243 (8%)	view
19	x 2	java/tsfile/src/main/jav...ache/tsfile/write/chunk java/tsfile/src/main/jav...ache/tsfile/write/chunk	ChunkWriterImpl.java TimeChunkWriter.java	320:341 (6%) 183:204 (9%)	view
19	x 2	java/tsfile/src/main/jav...ache/tsfile/write/chunk java/tsfile/src/main/jav...ache/tsfile/write/chunk	AlignedChunkWriterImpl.java AlignedChunkWriterImpl.java	131:152 (5%) 160:181 (5%)	view
19	x 2	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java LongRLBE.java	114:149 (14%) 97:132 (15%)	view
19	x 2	java/tsfile/src/main/java/org/apache/tsfile/utils java/tsfile/src/main/java/org/apache/tsfile/utils	TsFileGeneratorUtils.java TsFileGeneratorUtils.java	330:351 (5%) 395:415 (5%)	view
18	x 2	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	BinaryColumn.java BooleanColumn.java	226:252 (11%) 193:219 (13%)	view
18	x 2	java/tsfile/src/main/ant...rg/apache/tsfile/parser java/tsfile/src/main/ant...rg/apache/tsfile/parser	PathLexer.g4 PathParser.g4	1:18 (10%) 1:18 (32%)	view

Duplicated Units

The list of top 43 duplicated units.

See data for all 43 unit duplicates...

Size	#	Folders	Files	Lines	Code
24	x 2	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleSprintzEncoder.java FloatSprintzEncoder.java	136:161 130:155	view
17	x 2	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java LongRLBE.java	128:150 111:133	view
17	x 2	java/tsfile/src/main/jav...tsfile/read/reader/page java/tsfile/src/main/jav...tsfile/read/reader/page	AlignedPageReader.java TablePageReader.java	40:58 38:56	view
17	x 2	java/tsfile/src/main/jav...tsfile/read/reader/page java/tsfile/src/main/jav...tsfile/read/reader/page	AlignedPageReader.java TablePageReader.java	61:82 58:76	view
13	x 3	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	LongSprintzDecoder.java DoubleSprintzDecoder.java IntSprintzDecoder.java	112:126 124:138 114:128	view
12	x 4	java/tsfile/src/main/jav...ile/metadata/statistics java/tsfile/src/main/jav...ile/metadata/statistics java/tsfile/src/main/jav...ile/metadata/statistics java/tsfile/src/main/jav...ile/metadata/statistics	DoubleStatistics.java IntegerStatistics.java LongStatistics.java FloatStatistics.java	247:260 235:248 244:257 235:248	view
12	x 3	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java LongRLBE.java IntRLBE.java	93:110 76:93 81:98	view
12	x 2	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java IntRLBE.java	173:188 161:176	view
12	x 2	cpp/src/common/container cpp/src/common/container	sorted_array.h array.h	133:150 130:147	view
11	x 3	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java LongRLBE.java IntRLBE.java	153:166 136:149 141:154	view
11	x 2	cpp/src/common/container cpp/src/common/container	sorted_array.h array.h	93:107 89:103	view
10	x 5	java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column java/tsfile/src/main/jav...ead/common/block/column	BooleanColumnBuilder.java IntColumnBuilder.java FloatColumnBuilder.java DoubleColumnBuilder.java LongColumnBuilder.java	144:156 149:161 149:161 159:171 149:161	view
10	x 3	java/tsfile/src/main/jav...tsfile/read/reader/page java/tsfile/src/main/jav...tsfile/read/reader/page java/tsfile/src/main/jav...tsfile/read/reader/page	PageReader.java ValuePageReader.java TimePageReader.java	421:432 587:598 106:117	view
10	x 2	cpp/src/reader/filter cpp/src/reader/filter	gt.h gt_eq.h	33:45 34:46	view
9	x 2	java/tsfile/src/main/jav...le/fileSystem/fsFactory java/tsfile/src/main/jav...le/fileSystem/fsFactory	OSFSFactory.java HDFSFactory.java	107:117 108:118	view
9	x 2	java/tsfile/src/main/jav...le/fileSystem/fsFactory java/tsfile/src/main/jav...le/fileSystem/fsFactory	OSFSFactory.java HDFSFactory.java	120:130 121:131	view
9	x 2	java/tsfile/src/main/jav...System/fileInputFactory java/tsfile/src/main/jav...System/fileInputFactory	OSFileInputFactory.java HDFSInputFactory.java	48:58 50:60	view
9	x 2	java/tsfile/src/main/jav...ystem/fileOutputFactory java/tsfile/src/main/jav...ystem/fileOutputFactory	OSFileOutputFactory.java HDFSOutputFactory.java	47:57 49:59	view
9	x 3	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java LongRLBE.java IntRLBE.java	40:50 41:51 46:56	view
9	x 3	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java LongRLBE.java IntRLBE.java	267:277 250:260 254:264	view
9	x 2	cpp/src/writer cpp/src/writer	value_chunk_writer.cc time_chunk_writer.cc	150:160 149:159	view
8	x 3	java/tsfile/src/main/jav...ile/metadata/statistics java/tsfile/src/main/jav...ile/metadata/statistics java/tsfile/src/main/jav...ile/metadata/statistics	DoubleStatistics.java IntegerStatistics.java LongStatistics.java	77:86 69:78 126:135	view
8	x 4	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	IntRLBEDecoder.java FloatRLBEDecoder.java DoubleRLBEDecoder.java LongRLBEDecoder.java	152:161 153:162 154:163 153:162	view
8	x 2	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	LongZigzagDecoder.java IntZigzagDecoder.java	91:100 84:93	view
8	x 2	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	IntChimpDecoder.java LongChimpDecoder.java	146:155 145:154	view
8	x 2	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java LongRLBE.java	58:67 59:68	view
8	x 4	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java FloatRLBE.java LongRLBE.java IntRLBE.java	250:260 237:247 233:243 237:247	view
8	x 3	cpp/src/compress cpp/src/compress cpp/src/compress	snappy_compressor.cc lz4_compressor.cc lzo_compressor.cc	27:37 27:37 27:37	view
8	x 3	cpp/src/writer cpp/src/writer cpp/src/writer	value_page_writer.h time_page_writer.h page_writer.h	53:63 46:55 63:73	view
7	x 4	java/tsfile/src/main/jav...ile/metadata/statistics java/tsfile/src/main/jav...ile/metadata/statistics java/tsfile/src/main/jav...ile/metadata/statistics java/tsfile/src/main/jav...ile/metadata/statistics	DoubleStatistics.java IntegerStatistics.java LongStatistics.java FloatStatistics.java	193:201 182:190 191:199 181:189	view
7	x 2	java/tsfile/src/main/jav...le/fileSystem/fsFactory java/tsfile/src/main/jav...le/fileSystem/fsFactory	OSFSFactory.java HDFSFactory.java	96:104 97:105	view
7	x 2	java/tsfile/src/main/jav...le/fileSystem/fsFactory java/tsfile/src/main/jav...le/fileSystem/fsFactory	OSFSFactory.java HDFSFactory.java	133:141 134:142	view
7	x 3	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	DoubleRLBE.java LongRLBE.java IntRLBE.java	284:292 267:275 271:279	view
7	x 2	cpp/src/common/container cpp/src/common/container	sorted_array.h array.h	109:117 105:113	view
6	x 3	java/tsfile/src/main/jav...he/tsfile/file/metadata java/tsfile/src/main/jav...he/tsfile/file/metadata java/tsfile/src/main/jav...tsfile/read/reader/page	AlignedTimeSeriesMetadata.java AlignedChunkMetadata.java AlignedPageReader.java	46:55 48:57 90:99	view
6	x 2	java/tsfile/src/main/jav...ile/metadata/statistics java/tsfile/src/main/jav...ile/metadata/statistics	DoubleStatistics.java FloatStatistics.java	115:122 106:113	view
6	x 2	java/tsfile/src/main/jav...ile/metadata/statistics java/tsfile/src/main/jav...ile/metadata/statistics	IntegerStatistics.java LongStatistics.java	107:114 100:107	view
6	x 4	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	IntRLBEDecoder.java FloatRLBEDecoder.java DoubleRLBEDecoder.java LongRLBEDecoder.java	126:133 127:134 128:135 127:134	view
6	x 4	java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder java/tsfile/src/main/jav...tsfile/encoding/decoder	IntRLBEDecoder.java FloatRLBEDecoder.java DoubleRLBEDecoder.java LongRLBEDecoder.java	188:195 189:196 190:197 189:196	view
6	x 4	java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder java/tsfile/src/main/jav...tsfile/encoding/encoder	LongGorillaEncoder.java IntGorillaEncoder.java LongChimpEncoder.java IntChimpEncoder.java	56:63 56:63 117:124 106:113	view
6	x 2	java/tsfile/src/main/jav...le/read/filter/operator java/tsfile/src/main/jav...le/read/filter/operator	ValueIsNotNullOperator.java ValueIsNullOperator.java	110:123 127:138	view
6	x 2	java/tsfile/src/main/jav...le/read/filter/operator java/tsfile/src/main/jav...le/read/filter/operator	ValueIsNotNullOperator.java ValueIsNullOperator.java	132:142 110:119	view
6	x 2	cpp/src/reader cpp/src/reader	qds_with_timegenerator.cc qds_without_timegenerator.cc	381:388 145:152	view