apache / avro - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

7% duplication:

81,178 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
5,738 duplicated lines

2,404 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
doc (5%) --> lang (<1%)	72	3 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 2,404 duplicates...

Size	#	Folders	Files	Lines	Code
57	x 2	lang/java/avro/src/main/java lang/java/trevni/core/src/main/java	overview.html overview.html	1:84 (100%) 1:84 (100%)	view
50	x 2	lang/c++ lang/c	FindSnappy.cmake FindSnappy.cmake	1:54 (100%) 1:54 (100%)	view
37	x 2	lang/csharp/src/apache/main/Specific lang/csharp/src/apache/main/Specific	SpecificDatumWriter.cs SpecificWriter.cs	118:155 (42%) 188:225 (41%)	view
33	x 2	lang/java/ipc/src/main/v...e/avro/ipc/stats/static lang/java/ipc/src/main/v...e/avro/ipc/stats/static	g.bar.js g.bar.js	8:49 (12%) 211:252 (12%)	view
28	x 2	lang/java/avro/src/main/java/org/apache/avro/io lang/java/trevni/core/sr.../java/org/apache/trevni	BinaryDecoder.java InputBuffer.java	219:255 (5%) 236:271 (10%)	view
24	x 2	lang/java/compiler/src/m...pache/avro/compiler/idl lang/java/compiler/src/m...he/avro/compiler/schema	ResolvingVisitor.java CloningVisitor.java	49:75 (22%) 72:98 (22%)	view
23	x 2	lang/java/avro/src/it lang/java/interop-data-test/src/it	settings.xml settings.xml	1:45 (100%) 1:45 (100%)	view
21	x 2	lang/java/archetypes/avr...src/main/java/transport lang/java/archetypes/avr...src/main/java/transport	SimpleOrderServiceClient.java SimpleOrderServiceEndpoint.java	1:38 (53%) 1:35 (53%)	view
21	x 2	lang/c/src lang/c/src	resolved-reader.c resolved-writer.c	2980:3016 (1%) 2712:2750 (1%)	view
21	x 2	lang/c++/impl/parsing lang/c++/impl/parsing	JsonCodec.cc ResolvingDecoder.cc	180:200 (4%) 447:467 (4%)	view
21	x 2	lang/c++/impl/parsing lang/c++/impl/parsing	JsonCodec.cc ValidatingCodec.cc	467:488 (4%) 370:391 (5%)	view
21	x 2	lang/c++/impl/parsing lang/c++/impl/parsing	ResolvingDecoder.cc ValidatingCodec.cc	447:467 (4%) 165:185 (5%)	view
21	x 2	lang/java/archetypes/avr...s/src/main/java/service lang/java/archetypes/avr...src/main/java/transport	SimpleOrderService.java SimpleOrderServiceClient.java	1:27 (72%) 1:38 (53%)	view
21	x 2	lang/c++/impl/parsing lang/c++/impl/parsing	JsonCodec.cc ValidatingCodec.cc	180:200 (4%) 165:185 (5%)	view
21	x 2	lang/java/archetypes/avr...s/src/main/java/service lang/java/archetypes/avr...src/main/java/transport	SimpleOrderService.java SimpleOrderServiceEndpoint.java	1:27 (72%) 1:35 (53%)	view
20	x 2	lang/csharp/src/apache/main/Generic lang/csharp/src/apache/main/Specific	GenericDatumWriter.cs SpecificDatumWriter.cs	100:120 (28%) 118:138 (22%)	view
20	x 2	lang/c++/impl lang/c++/impl/parsing	BinaryEncoder.cc ValidatingCodec.cc	30:49 (27%) 370:389 (5%)	view
20	x 2	lang/csharp/src/apache/main/Generic lang/csharp/src/apache/main/Specific	GenericDatumWriter.cs SpecificWriter.cs	100:120 (28%) 188:208 (22%)	view
20	x 2	lang/c++/impl lang/c++/impl/parsing	BinaryEncoder.cc JsonCodec.cc	30:49 (27%) 467:486 (4%)	view
19	x 2	lang/csharp/src/apache/main/Generic lang/csharp/src/apache/main/Reflect	GenericDatumWriter.cs ReflectDefaultWriter.cs	101:120 (27%) 171:190 (24%)	view
19	x 2	lang/csharp/src/apache/main/Reflect lang/csharp/src/apache/main/Specific	ReflectDefaultWriter.cs SpecificDatumWriter.cs	171:190 (24%) 119:138 (21%)	view
19	x 2	lang/java/avro/src/main/java/org/apache/avro/util lang/java/compiler/src/m...he/avro/compiler/schema	Schemas.java Schemas.java	75:93 (21%) 132:150 (14%)	view
19	x 2	lang/csharp/src/apache/main/Reflect lang/csharp/src/apache/main/Specific	ReflectDefaultWriter.cs SpecificWriter.cs	171:190 (24%) 189:208 (21%)	view
19	x 2	lang/java/avro/src/main/java/org/apache/avro/io lang/java/avro/src/main/java/org/apache/avro/io	BlockingBinaryEncoder.java BufferedBinaryEncoder.java	253:281 (6%) 125:153 (18%)	view
18	x 2	lang/csharp/src/apache/main/Generic lang/csharp/src/apache/main/Specific	GenericWriter.cs SpecificDatumWriter.cs	471:489 (10%) 118:136 (20%)	view
18	x 2	lang/c lang/c	FindSnappy.cmake cmake_pretty.cmake	1:18 (36%) 1:18 (60%)	view
18	x 2	lang/csharp/src/apache/main/Generic lang/csharp/src/apache/main/Specific	GenericWriter.cs SpecificWriter.cs	471:489 (10%) 188:206 (20%)	view
18	x 2	doc lang/c	config.toml cmake_pretty.cmake	1:18 (5%) 1:18 (60%)	view
18	x 2	doc lang/c++	config.toml FindSnappy.cmake	1:18 (5%) 1:18 (36%)	view
18	x 2	lang/csharp/src/apache/main/Generic lang/csharp/src/apache/main/Generic	GenericDatumWriter.cs GenericWriter.cs	100:118 (26%) 471:489 (10%)	view
18	x 2	lang/c++ lang/c	FindSnappy.cmake cmake_pretty.cmake	1:18 (36%) 1:18 (60%)	view
18	x 2	doc lang/c	config.toml FindSnappy.cmake	1:18 (5%) 1:18 (36%)	view
17	x 2	lang/java/avro/src/main/...org/apache/avro/generic lang/java/avro/src/main/...org/apache/avro/generic	GenericData.java GenericData.java	654:670 (1%) 1010:1026 (1%)	view
17	x 2	lang/java/compiler/src/m...pache/avro/compiler/idl lang/java/compiler/src/m...he/avro/compiler/schema	ResolvingVisitor.java CloningVisitor.java	144:162 (15%) 141:158 (16%)	view
17	x 2	lang/java/avro/src/main/...org/apache/avro/reflect lang/java/avro/src/main/java/org/apache/avro/util	MapEntry.java MapEntry.java	36:60 (94%) 37:61 (100%)	view
17	x 2	lang/csharp/src/apache/main/Generic lang/csharp/src/apache/main/Reflect	GenericWriter.cs ReflectDefaultWriter.cs	472:489 (9%) 171:188 (22%)	view
16	x 2	lang/c++/impl/parsing lang/c++/impl/parsing	ResolvingDecoder.cc ValidatingCodec.cc	257:272 (3%) 63:78 (4%)	view
16	x 2	doc/layouts/shortcodes doc/layouts/shortcodes	avro_version.html project_logo.html	1:20 (88%) 1:20 (88%)	view
16	x 2	lang/java/avro/src/main/java/org/apache/avro/io lang/java/trevni/core/sr.../java/org/apache/trevni	BinaryDecoder.java InputBuffer.java	155:170 (3%) 177:192 (5%)	view
16	x 2	lang/csharp/src/apache/main/Generic lang/csharp/src/apache/main/Generic	GenericDatumWriter.cs GenericWriter.cs	120:138 (23%) 490:508 (9%)	view
16	x 2	lang/java/avro/src/main/java/org/apache/avro/io lang/java/trevni/core/sr.../java/org/apache/trevni	BinaryDecoder.java InputBuffer.java	206:225 (3%) 220:239 (5%)	view
15	x 2	lang/csharp/src/apache/ipc lang/csharp/src/apache/main/IO	OutputStream.cs OutputStream.cs	26:59 (88%) 31:70 (93%)	view
15	x 2	lang/java/avro/src/main/...ro/util/springframework lang/java/avro/src/main/...ro/util/springframework	ConcurrentReferenceHashMap.java ConcurrentReferenceHashMap.java	1049:1070 (2%) 1086:1107 (2%)	view
13	x 2	lang/c/src lang/c/src	datafile.c datafile.c	153:168 (2%) 377:392 (2%)	view
13	x 2	lang/java/mapred/src/mai...g/apache/avro/hadoop/io lang/java/mapred/src/mai.../org/apache/avro/mapred	AvroSerialization.java AvroJob.java	256:280 (15%) 210:227 (11%)	view
13	x 2	lang/java/tools/src/main/java/org/apache/avro/tool lang/java/tools/src/main/java/org/apache/avro/tool	BinaryFragmentToJsonTool.java JsonToBinaryFragmentTool.java	56:71 (27%) 53:68 (27%)	view
13	x 2	lang/java/mapred/src/mai.../org/apache/avro/mapred lang/java/mapred/src/mai.../org/apache/avro/mapred	AvroAsTextRecordReader.java AvroRecordReader.java	81:100 (26%) 65:84 (36%)	view
12	x 2	lang/java/mapred/src/mai.../org/apache/avro/mapred lang/java/mapred/src/mai...ache/avro/mapred/tether	AvroAsTextInputFormat.java TetherInputFormat.java	49:63 (75%) 46:60 (70%)	view
12	x 2	lang/java/tools/src/main/java/org/apache/avro/tool lang/java/tools/src/main/java/org/apache/avro/tool	TrevniMetadataTool.java TrevniToJsonTool.java	53:64 (23%) 57:68 (10%)	view
12	x 2	lang/java/avro/src/main/.../apache/avro/io/parsing lang/java/avro/src/main/.../apache/avro/io/parsing	ResolvingGrammarGenerator.java ValidatingGrammarGenerator.java	161:172 (5%) 51:62 (18%)	view

Duplicated Units

The list of top 7 duplicated units.

See data for all 7 unit duplicates...

Size	#	Folders	Files	Lines	Code
40	x 2	lang/csharp/src/apache/main/Specific lang/csharp/src/apache/main/Specific	SpecificDatumWriter.cs SpecificWriter.cs	116:157 186:227	view
15	x 2	lang/java/mapred/src/mai.../org/apache/avro/mapred lang/java/mapred/src/mai...g/apache/avro/mapreduce	AvroMultipleOutputs.java AvroMultipleOutputs.java	174:190 151:167	view
10	x 2	lang/java/mapred/src/mai...g/apache/avro/hadoop/io lang/java/mapred/src/mai.../org/apache/avro/mapred	AvroSerialization.java AvroJob.java	260:271 214:225	view
10	x 2	lang/java/avro/src/main/...org/apache/avro/generic lang/java/avro/src/main/...org/apache/avro/generic	GenericData.java PrimitivesArrays.java	447:459 118:130	view
7	x 2	lang/csharp/src/apache/main/Specific lang/csharp/src/apache/main/Generic	SpecificDatumReader.cs GenericDatumReader.cs	228:236 216:224	view
7	x 2	lang/csharp/src/apache/main/Specific lang/csharp/src/apache/main/Generic	SpecificFixed.cs GenericFixed.cs	73:81 120:128	view
7	x 2	lang/csharp/src/apache/main/Generic lang/csharp/src/apache/main/Generic	GenericDatumWriter.cs GenericWriter.cs	76:84 429:437	view