apache / uima-addonsDuplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

15% duplication:

30,398 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
4,803 duplicated lines

500 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
AlchemyAPIAnnotator (5%) --> OpenCalaisAnnotator (23%)	576	24 file pairs	details...
DictionaryAnnotator (8%) --> SimpleServer (7%)	288	3 file pairs	details...
DictionaryAnnotator (6%) --> RegularExpressionAnnotator (3%)	211	3 file pairs	details...
ConceptMapper (1%) --> SnowballAnnotator (9%)	94	4 file pairs	details...
AlchemyAPIAnnotator (<1%) --> DictionaryAnnotator (2%)	94	8 file pairs	details...
SnowballAnnotator (8%) --> Tagger (7%)	88	5 file pairs	details...
ConceptMapper (1%) --> Tagger (6%)	75	6 file pairs	details...
AlchemyAPIAnnotator (<1%) --> ConfigurableFeatureExtractor (<1%)	64	7 file pairs	details...
AlchemyAPIAnnotator (<1%) --> Lucas (<1%)	64	7 file pairs	details...
AlchemyAPIAnnotator (<1%) --> Tagger (5%)	64	7 file pairs	details...
AlchemyAPIAnnotator (<1%) --> Solrcas (10%)	64	7 file pairs	details...

Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 500 duplicates...

Size	#	Folders	Files	Lines	Code
369	x 2	ConceptMapper/desc/analysis_engine/primitive ConceptMapper/src/main/r...alysis_engine/primitive	ConceptMapperOffsetTokenizer.xml ConceptMapperOffsetTokenizer.xml	1:509 (100%) 1:509 (100%)	view
110	x 2	ConfigurableFeatureExtractor/src/main/xsdForEmf ConfigurableFeatureExtra...src/main/xsdForXMLBeans	xsd CFEConfigModel.xsd CFEConfig.xsd	23:191 (96%) 23:191 (96%)	view
57	x 2	ConceptMapper/desc/analysis_engine/primitive ConceptMapper/src/main/r...alysis_engine/primitive	OffsetTokenizer.xml OffsetTokenizer.xml	1:98 (100%) 1:98 (100%)	view
52	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl RegularExpressionAnnotat...ma/annotator/regex/impl	FeaturePathInfo_impl.java FeaturePath_impl.java	182:235 (13%) 174:227 (42%)	view
40	x 2	ConceptMapper/desc/collection_processing_engines ConceptMapper/src/main/r...tion_processing_engines	TestConceptMapperCPE.xml TestConceptMapperCPE.xml	1:74 (100%) 1:74 (100%)	view
39	x 2	AlchemyAPIAnnotator/desc AlchemyAPIAnnotator/desc	HtmlMicroformatsAEDescriptor.xml URLMicroformatsAEDescriptor.xml	46:101 (62%) 46:101 (62%)	view
31	x 2	AlchemyAPIAnnotator/desc AlchemyAPIAnnotator/desc	TextLanguageDetectionAEDescriptor.xml URLMicroformatsAEDescriptor.xml	28:67 (37%) 28:67 (50%)	view
30	x 2	ConceptMapper/desc/analysis_engine/aggregate ConceptMapper/src/main/r...alysis_engine/aggregate	OffsetTokenizerMatcher.xml OffsetTokenizerMatcher.xml	1:56 (100%) 1:56 (100%)	view
27	x 2	AlchemyAPIAnnotator/desc AlchemyAPIAnnotator/desc	TextLanguageDetectionAEDescriptor.xml TextSentimentAnalysisAEDescriptor.xml	28:60 (32%) 23:55 (42%)	view
27	x 2	AlchemyAPIAnnotator/desc AlchemyAPIAnnotator/desc	TextSentimentAnalysisAEDescriptor.xml URLMicroformatsAEDescriptor.xml	23:55 (42%) 28:60 (43%)	view
27	x 2	ConceptMapper/desc/analysis_engine/primitive ConceptMapper/src/main/r...alysis_engine/primitive	DictTerm.xml DictTerm.xml	1:48 (100%) 1:48 (100%)	view
23	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl SimpleServer/src/main/ja...impleserver/config/impl	FeaturePathInfo_impl.java SimpleFilterImpl.java	689:724 (5%) 344:379 (9%)	view
23	x 2	ConfigurableFeatureExtractor/src/docbook ConfigurableFeatureExtractor/src/docbook	CFE_UG.xml CFE_UG.xml	1686:1719 (1%) 1770:1803 (1%)	view
23	x 2	AlchemyAPIAnnotator/desc AlchemyAPIAnnotator/desc	TextConceptTaggingAEDescriptor.xml TextRankedEntityExtractionAEDescripto...	138:166 (16%) 350:378 (7%)	view
23	x 2	AlchemyAPIAnnotator/desc AlchemyAPIAnnotator/desc	TextConceptTaggingAEDescriptor.xml TextRankedEntityExtractionAEDescripto...	113:141 (16%) 320:348 (7%)	view
22	x 2	ConceptMapper/desc/analysis_engine/primitive ConceptMapper/src/main/j...ache/uima/conceptMapper	DictTerm.xml DictTerm.xml	24:48 (81%) 24:48 (81%)	view
22	x 2	ConfigurableFeatureExtractor/src/docbook ConfigurableFeatureExtractor/src/docbook	CFE_UG.xml CFE_UG.xml	1569:1601 (1%) 1765:1797 (1%)	view
22	x 2	ConceptMapper/src/main/j...ache/uima/conceptMapper ConceptMapper/src/main/r...alysis_engine/primitive	DictTerm.xml DictTerm.xml	24:48 (81%) 24:48 (81%)	view
21	x 2	RegularExpressionAnnotator/src/docbook RegularExpressionAnnotator/src/docbook	RegexAnnotatorUserGuide.xml RegexAnnotatorUserGuide.xml	1399:1421 (1%) 1452:1474 (1%)	view
21	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl SimpleServer/src/main/ja...ima/simpleserver/config	FilterOp.java FilterOp.java	25:55 (95%) 26:56 (95%)	view
20	x 2	AlchemyAPIAnnotator/desc AlchemyAPIAnnotator/desc	TextAnnotatedEntityExtractionAEDescri... TextRankedEntityExtractionAEDescripto...	28:50 (20%) 23:45 (6%)	view
20	x 2	AlchemyAPIAnnotator/src/...alchemy/digester/domain AlchemyAPIAnnotator/src/...alchemy/digester/domain	Concept.java Disambiguated.java	62:99 (28%) 65:102 (30%)	view
19	x 2	ConfigurableFeatureExtractor/src/docbook ConfigurableFeatureExtractor/src/docbook	CFE_UG.xml CFE_UG.xml	1574:1601 (1%) 1686:1713 (1%)	view
18	x 2	AlchemyAPIAnnotator/desc AlchemyAPIAnnotator/desc	TextRankedEntityExtractionAEDescripto... TextSentimentAnalysisAEDescriptor.xml	397:420 (5%) 62:85 (28%)	view
17	x 2	SimpleServer/src/main/ja...impleserver/config/impl SimpleServer/src/main/ja...impleserver/config/impl	SimpleFilterImpl.java SimpleFilterImpl.java	279:302 (7%) 312:335 (7%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	430:453 (4%) 559:582 (4%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	430:453 (4%) 473:496 (4%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	430:453 (4%) 516:539 (4%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	430:453 (4%) 602:625 (4%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	430:453 (4%) 645:668 (4%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	602:625 (4%) 645:668 (4%)	view
17	x 2	SimpleServer/src/main/ja...impleserver/config/impl SimpleServer/src/main/ja...impleserver/config/impl	SimpleFilterImpl.java SimpleFilterImpl.java	213:236 (7%) 246:269 (7%)	view
17	x 2	SimpleServer/src/main/ja...impleserver/config/impl SimpleServer/src/main/ja...impleserver/config/impl	SimpleFilterImpl.java SimpleFilterImpl.java	213:236 (7%) 279:302 (7%)	view
17	x 2	SimpleServer/src/main/ja...impleserver/config/impl SimpleServer/src/main/ja...impleserver/config/impl	SimpleFilterImpl.java SimpleFilterImpl.java	213:236 (7%) 312:335 (7%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	473:496 (4%) 602:625 (4%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	473:496 (4%) 645:668 (4%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	473:496 (4%) 516:539 (4%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	473:496 (4%) 559:582 (4%)	view
17	x 2	SimpleServer/src/main/ja...impleserver/config/impl SimpleServer/src/main/ja...impleserver/config/impl	SimpleFilterImpl.java SimpleFilterImpl.java	180:203 (7%) 213:236 (7%)	view
17	x 2	SimpleServer/src/main/ja...impleserver/config/impl SimpleServer/src/main/ja...impleserver/config/impl	SimpleFilterImpl.java SimpleFilterImpl.java	246:269 (7%) 279:302 (7%)	view
17	x 2	SimpleServer/src/main/ja...impleserver/config/impl SimpleServer/src/main/ja...impleserver/config/impl	SimpleFilterImpl.java SimpleFilterImpl.java	246:269 (7%) 312:335 (7%)	view
17	x 2	SimpleServer/src/main/ja...impleserver/config/impl SimpleServer/src/main/ja...impleserver/config/impl	SimpleFilterImpl.java SimpleFilterImpl.java	180:203 (7%) 246:269 (7%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	516:539 (4%) 645:668 (4%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	559:582 (4%) 602:625 (4%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	559:582 (4%) 645:668 (4%)	view
17	x 2	SimpleServer/src/main/ja...impleserver/config/impl SimpleServer/src/main/ja...impleserver/config/impl	SimpleFilterImpl.java SimpleFilterImpl.java	147:170 (7%) 213:236 (7%)	view
17	x 2	ConceptMapper/src/main/java/uima/tt SnowballAnnotator/src/main/java/org/apache/uima	TokenAnnotation.java TokenAnnotation.java	17:67 (100%) 34:75 (68%)	view
17	x 2	DictionaryAnnotator/src/...notator/dict_annot/impl DictionaryAnnotator/src/...notator/dict_annot/impl	FeaturePathInfo_impl.java FeaturePathInfo_impl.java	516:539 (4%) 602:625 (4%)	view
17	x 2	TikaAnnotator/desc TikaAnnotator/desc	FileSystemCollectionReader.xml MarkupAnnotator.xml	86:109 (23%) 93:116 (22%)	view
17	x 2	SimpleServer/src/main/ja...impleserver/config/impl SimpleServer/src/main/ja...impleserver/config/impl	SimpleFilterImpl.java SimpleFilterImpl.java	180:203 (7%) 279:302 (7%)	view

Duplicated Units

The list of top 14 duplicated units.

See data for all 14 unit duplicates...

Size	#	Folders	Files	Lines	Code
9	x 3	ConceptMapper/src/main/java/uima/tt ConceptMapper/src/main/j...apper/support/tokenizer SnowballAnnotator/src/main/java/org/apache/uima	TokenAnnotation_Type.java TokenAnnotation_Type.java TokenAnnotation_Type.java	23:34 24:35 43:54	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	Country_Type.java Country_Type.java	39:50 40:51	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	Company_Type.java Company_Type.java	39:50 40:51	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	Facility_Type.java Facility_Type.java	39:50 40:51	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	Holiday_Type.java Holiday_Type.java	39:50 40:51	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	City_Type.java City_Type.java	39:50 40:51	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	Organization_Type.java Organization_Type.java	39:50 39:50	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	Anniversary_Type.java Anniversary_Type.java	39:50 39:50	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	Continent_Type.java Continent_Type.java	39:50 40:51	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	NaturalDisaster_Type.java NaturalDisaster_Type.java	39:50 40:51	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	Person_Type.java Person_Type.java	39:50 40:51	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	Technology_Type.java Technology_Type.java	39:50 40:51	view
9	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/ts/entity OpenCalaisAnnotator/src/.../org/apache/uima/calais	Region_Type.java Region_Type.java	39:50 40:51	view
8	x 2	AlchemyAPIAnnotator/src/.../uima/alchemy/annotator AlchemyAPIAnnotator/src/.../uima/alchemy/annotator	HtmlMicroformatsAnnotator.java URLMicroformatsAnnotator.java	46:56 46:56	view