apache / daffodil - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

8% duplication:

65,616 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
5,816 duplicated lines

762 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
daffodil-japi (61%) --> daffodil-sapi (64%)	524	4 file pairs	details...
project (48%) --> scripts (12%)	288	1 file pair	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 762 duplicates...

Size	#	Folders	Files	Lines	Code
82	x 2	project scripts/osgi-refactor	Rat.scala Rat.scala	118:199 (43%) 167:248 (34%)	view
58	x 2	daffodil-japi/src/main/s...e/daffodil/japi/infoset daffodil-sapi/src/main/s...e/daffodil/sapi/infoset	Infoset.scala Infoset.scala	281:464 (48%) 270:453 (51%)	view
54	x 2	daffodil-japi/src/main/s...rg/apache/daffodil/japi daffodil-sapi/src/main/s...rg/apache/daffodil/sapi	Daffodil.scala Daffodil.scala	846:937 (21%) 792:883 (22%)	view
31	x 2	daffodil-propgen/src/mai...apache/daffodil/propGen daffodil-propgen/src/mai...apache/daffodil/propGen	TunableGenerator.scala WarnIDGenerator.scala	22:52 (11%) 22:52 (51%)	view
26	x 2	daffodil-cli/src/main/sc...org/apache/daffodil/cli daffodil-cli/src/main/sc...org/apache/daffodil/cli	Main.scala Main.scala	400:426 (1%) 527:552 (1%)	view
24	x 2	project scripts/osgi-refactor	Rat.scala Rat.scala	202:230 (12%) 250:278 (10%)	view
24	x 2	daffodil-schematron/src/...es/iso-schematron-xslt2 daffodil-schematron/src/...es/iso-schematron-xslt2	xsl iso_dsdl_include.xsl iso_dsdl_include.xsl	296:335 (3%) 871:910 (3%)	view
24	x 2	daffodil-japi/src/main/s...rg/apache/daffodil/japi daffodil-sapi/src/main/s...rg/apache/daffodil/sapi	Daffodil.scala Daffodil.scala	437:496 (9%) 398:457 (9%)	view
23	x 2	daffodil-core/src/main/s.../daffodil/core/runtime1 daffodil-core/src/main/s.../daffodil/core/runtime1	TermRuntime1Mixin.scala TermRuntime1Mixin.scala	149:192 (7%) 299:343 (7%)	view
22	x 2	daffodil-schematron/src/...es/iso-schematron-xslt2 daffodil-schematron/src/...es/iso-schematron-xslt2	xsl iso_dsdl_include.xsl iso_dsdl_include.xsl	849:875 (3%) 947:975 (3%)	view
22	x 2	daffodil-cli/src/main/sc...org/apache/daffodil/cli daffodil-cli/src/main/sc...org/apache/daffodil/cli	Main.scala Main.scala	346:368 (1%) 475:497 (1%)	view
20	x 2	daffodil-core/src/main/s...core/grammar/primitives daffodil-core/src/main/s...core/grammar/primitives	SequenceCombinator.scala SequenceCombinator.scala	87:115 (16%) 176:207 (16%)	view
20	x 2	daffodil-cli/src/main/sc...org/apache/daffodil/cli daffodil-cli/src/main/sc...org/apache/daffodil/cli	Main.scala Main.scala	377:396 (1%) 505:524 (1%)	view
20	x 2	daffodil-schematron/src/...es/iso-schematron-xslt2 daffodil-schematron/src/...es/iso-schematron-xslt2	xsl iso_dsdl_include.xsl iso_dsdl_include.xsl	351:382 (2%) 527:558 (2%)	view
20	x 2	daffodil-schematron/src/...es/iso-schematron-xslt2 daffodil-schematron/src/...es/iso-schematron-xslt2	xsl iso_dsdl_include.xsl iso_dsdl_include.xsl	351:382 (2%) 689:718 (2%)	view
20	x 2	daffodil-schematron/src/...es/iso-schematron-xslt2 daffodil-schematron/src/...es/iso-schematron-xslt2	xsl iso_dsdl_include.xsl iso_dsdl_include.xsl	527:558 (2%) 689:718 (2%)	view
20	x 2	daffodil-cli/src/main/sc...org/apache/daffodil/cli daffodil-cli/src/main/sc...org/apache/daffodil/cli	Main.scala Main.scala	346:366 (1%) 701:721 (1%)	view
20	x 2	daffodil-cli/src/main/sc...org/apache/daffodil/cli daffodil-cli/src/main/sc...org/apache/daffodil/cli	Main.scala Main.scala	475:495 (1%) 701:721 (1%)	view
20	x 2	daffodil-runtime1/src/ma...dil/runtime1/processors daffodil-runtime1/src/ma...dil/runtime1/processors	RuntimeData.scala RuntimeData.scala	967:986 (3%) 1022:1041 (3%)	view
19	x 2	daffodil-cli/src/main/sc...org/apache/daffodil/cli daffodil-cli/src/main/sc...org/apache/daffodil/cli	Main.scala Main.scala	612:630 (1%) 832:850 (1%)	view
19	x 2	daffodil-schematron/src/...es/iso-schematron-xslt2 daffodil-schematron/src/...es/iso-schematron-xslt2	xsl iso_dsdl_include.xsl iso_dsdl_include.xsl	401:427 (2%) 574:600 (2%)	view
18	x 2	daffodil-japi/src/main/s...rg/apache/daffodil/japi daffodil-sapi/src/main/s...rg/apache/daffodil/sapi	Daffodil.scala Daffodil.scala	725:792 (7%) 672:739 (7%)	view
17	x 2	daffodil-runtime1/src/ma...dil/runtime1/processors daffodil-runtime1/src/ma...dil/runtime1/processors	RuntimeData.scala RuntimeData.scala	947:963 (2%) 1004:1020 (2%)	view
17	x 2	daffodil-schematron/src/...es/iso-schematron-xslt2 daffodil-schematron/src/...es/iso-schematron-xslt2	xsl iso_schematron_skeleton_for_saxon.xsl iso_schematron_skeleton_for_saxon.xsl	1968:1992 (1%) 2001:2024 (1%)	view
17	x 2	daffodil-cli/src/main/sc...org/apache/daffodil/cli daffodil-cli/src/main/sc...org/apache/daffodil/cli	Main.scala Main.scala	505:521 (1%) 733:749 (1%)	view
17	x 2	daffodil-cli/src/main/sc...org/apache/daffodil/cli daffodil-cli/src/main/sc...org/apache/daffodil/cli	Main.scala Main.scala	377:393 (1%) 733:749 (1%)	view
17	x 2	daffodil-runtime1/src/ma...ffodil/runtime1/infoset daffodil-sapi/src/main/s...e/daffodil/sapi/infoset	InfosetOutputter.scala Infoset.scala	46:134 (53%) 134:222 (15%)	view
17	x 2	daffodil-schematron/src/...es/iso-schematron-xslt2 daffodil-schematron/src/...es/iso-schematron-xslt2	xsl iso_dsdl_include.xsl iso_dsdl_include.xsl	455:487 (2%) 622:651 (2%)	view
16	x 2	daffodil-core/src/main/s...che/daffodil/core/dpath daffodil-core/src/main/s...che/daffodil/core/dpath	Expression.scala Expression.scala	2765:2780 (<1%) 2786:2801 (<1%)	view
16	x 2	daffodil-runtime1/src/ma...dil/runtime1/processors daffodil-runtime1/src/ma...dil/runtime1/processors	PackedBinaryTraits.scala PackedBinaryTraits.scala	172:188 (10%) 233:249 (10%)	view
15	x 2	daffodil-codegen-c/src/m.../codegen/c/files/libcli daffodil-codegen-c/src/m.../codegen/c/files/libcli	xml_reader.c xml_reader.c	83:109 (5%) 120:146 (5%)	view
15	x 2	daffodil-runtime1-unpars...odil/unparsers/runtime1 daffodil-runtime1-unpars...odil/unparsers/runtime1	SpecifiedLength2.scala SpecifiedLength2.scala	751:766 (2%) 800:815 (2%)	view
15	x 2	daffodil-runtime1-unpars...odil/unparsers/runtime1 daffodil-runtime1-unpars...odil/unparsers/runtime1	SpecifiedLength2.scala SpecifiedLength2.scala	772:787 (2%) 824:839 (2%)	view
15	x 2	project scripts/osgi-refactor	Rat.scala Rat.scala	48:62 (7%) 46:60 (6%)	view
15	x 2	daffodil-japi/src/main/s...e/daffodil/japi/infoset daffodil-sapi/src/main/s...e/daffodil/sapi/infoset	Infoset.scala Infoset.scala	89:161 (12%) 89:161 (13%)	view
15	x 2	daffodil-core/src/main/s.../daffodil/core/runtime1 daffodil-core/src/main/s.../daffodil/core/runtime1	ChoiceTermRuntime1Mixin.scala SequenceTermRuntime1Mixin.scala	199:214 (12%) 35:50 (27%)	view
15	x 2	daffodil-core/src/main/s...che/daffodil/core/dpath daffodil-core/src/main/s...che/daffodil/core/dpath	Expression.scala Expression.scala	2651:2665 (<1%) 2728:2742 (<1%)	view
14	x 2	daffodil-runtime1-unpars...odil/unparsers/runtime1 daffodil-runtime1-unpars...odil/unparsers/runtime1	BinaryNumberUnparsers.scala PackedBinaryUnparserTraits.scala	58:72 (9%) 67:81 (20%)	view
14	x 2	daffodil-schematron/src/...es/iso-schematron-xslt2 daffodil-schematron/src/...es/iso-schematron-xslt2	xsl iso_svrl_for_xslt2.xsl iso_svrl_for_xslt2.xsl	276:295 (4%) 351:371 (4%)	view
14	x 2	daffodil-core/src/main/s...ache/daffodil/core/dsom daffodil-runtime1/src/ma...dil/runtime1/processors	Facets.scala DFDLDelimiter.scala	142:155 (2%) 248:261 (3%)	view
14	x 2	daffodil-runtime1/src/ma...runtime1/processors/dfa daffodil-runtime1/src/ma...runtime1/processors/dfa	Rules.scala Rules.scala	600:618 (2%) 652:670 (2%)	view
13	x 2	daffodil-schematron/src/...es/iso-schematron-xslt2 daffodil-schematron/src/...es/iso-schematron-xslt2	xsl iso_dsdl_include.xsl iso_dsdl_include.xsl	308:323 (1%) 983:998 (1%)	view
13	x 2	daffodil-japi/src/main/s...e/daffodil/japi/infoset daffodil-sapi/src/main/s...e/daffodil/sapi/infoset	Infoset.scala Infoset.scala	183:248 (10%) 185:253 (11%)	view
13	x 2	daffodil-schematron/src/...es/iso-schematron-xslt2 daffodil-schematron/src/...es/iso-schematron-xslt2	xsl iso_dsdl_include.xsl iso_dsdl_include.xsl	883:899 (1%) 983:998 (1%)	view
13	x 2	daffodil-runtime1-unpars...odil/unparsers/runtime1 daffodil-runtime1-unpars...odil/unparsers/runtime1	SeparatedSequenceUnparsers.scala SeparatedSequenceUnparsers.scala	341:368 (3%) 625:645 (3%)	view
13	x 2	project scripts/osgi-refactor	Rat.scala Rat.scala	104:116 (6%) 102:114 (5%)	view
13	x 2	daffodil-runtime1/src/ma...ime1/processors/parsers daffodil-runtime1/src/ma...ime1/processors/parsers	DelimitedParsers.scala DelimitedParsers.scala	255:268 (6%) 286:299 (6%)	view
13	x 2	daffodil-runtime1/src/ma...ffodil/runtime1/infoset daffodil-runtime1/src/ma...ffodil/runtime1/infoset	InfosetImpl.scala InfosetImpl.scala	331:343 (1%) 350:362 (1%)	view
12	x 2	tutorials/src/main/resources tutorials/src/main/resources	bitorder.tutorial.tdml.xml bitorder.tutorial.tdml.xml	796:817 (1%) 949:970 (1%)	view
12	x 2	daffodil-cli/src/main/sc...org/apache/daffodil/cli daffodil-cli/src/main/sc...org/apache/daffodil/cli	Main.scala Main.scala	346:358 (<1%) 595:607 (<1%)	view

Duplicated Units

The list of top 8 duplicated units.

See data for all 8 unit duplicates...

Size	#	Folders	Files	Lines	Code
14	x 2	daffodil-japi/src/main/s...rg/apache/daffodil/japi daffodil-sapi/src/main/s...rg/apache/daffodil/sapi	Daffodil.scala Daffodil.scala	878:894 824:840	view
13	x 3	daffodil-runtime1/src/ma...ffodil/runtime1/infoset daffodil-runtime1/src/ma...ffodil/runtime1/infoset daffodil-runtime1/src/ma...ffodil/runtime1/infoset	ScalaXMLInfosetInputter.scala W3CDOMInfosetInputter.scala JDOMInfosetInputter.scala	181:207 169:195 171:197	view
11	x 2	daffodil-japi/src/main/s...rg/apache/daffodil/japi daffodil-sapi/src/main/s...rg/apache/daffodil/sapi	Daffodil.scala Daffodil.scala	473:485 434:446	view
9	x 2	daffodil-japi/src/main/s...rg/apache/daffodil/japi daffodil-sapi/src/main/s...rg/apache/daffodil/sapi	Daffodil.scala Daffodil.scala	725:747 672:694	view
8	x 2	daffodil-japi/src/main/s...rg/apache/daffodil/japi daffodil-sapi/src/main/s...rg/apache/daffodil/sapi	Daffodil.scala Daffodil.scala	904:933 850:879	view
7	x 2	daffodil-japi/src/main/s...e/daffodil/japi/infoset daffodil-sapi/src/main/s...e/daffodil/sapi/infoset	Infoset.scala Infoset.scala	430:438 419:427	view
7	x 2	daffodil-japi/src/main/s...rg/apache/daffodil/japi daffodil-sapi/src/main/s...rg/apache/daffodil/sapi	Daffodil.scala Daffodil.scala	859:868 805:814	view
6	x 3	daffodil-runtime1/src/ma...ffodil/runtime1/infoset daffodil-runtime1/src/ma...ffodil/runtime1/infoset daffodil-runtime1/src/ma...ffodil/runtime1/infoset	ScalaXMLInfosetInputter.scala W3CDOMInfosetInputter.scala JDOMInfosetInputter.scala	60:67 64:71 69:76	view