awslabs / amazon-neptune-tools
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 11% duplication:
    • 16,263 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 1,941 duplicated lines
  • 134 duplicates
system11% (1,941 lines)
Duplication per Extension
java13% (1,817 lines)
py4% (124 lines)
Duplication per Component (primary)
neptune-export14% (1,692 lines)
neptune-gremlin-client6% (105 lines)
drop-graph19% (46 lines)
csv-gremlin8% (34 lines)
neptune-python-utils2% (28 lines)
neo4j-to-neptune3% (20 lines)
glue-neptune14% (16 lines)
export-neptune-to-elasticsearch0% (0 lines)
graphml2csv0% (0 lines)
csv-to-neptune-bulk-format0% (0 lines)
neptune-streams-utils0% (0 lines)

Duplication Between Components (50+ lines)

G neptune-export neptune-export neptune-gremlin-client neptune-gremlin-client neptune-export--neptune-gremlin-client 54

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 20 longest duplicates.
See data for all 134 duplicates...
Size#FoldersFilesLinesCode
38 x 2 neptune-export/src/main/...une/profiles/neptune_ml
neptune-export/src/main/...une/profiles/neptune_ml
NeptuneMachineLearningExportEventHand...
NeptuneMachineLearningExportEventHand...
180:233 (31%)
189:242 (27%)
view
32 x 2 neptune-export/src/main/...zonaws/services/neptune
neptune-export/src/main/...ws/services/neptune/cli
AddClone.java
CloneClusterModule.java
43:75 (54%)
32:64 (50%)
view
31 x 2 neptune-export/src/main/...services/neptune/rdf/io
neptune-export/src/main/...services/neptune/rdf/io
NeptuneStreamsJsonNQuadsWriter.java
NeptuneStreamsSimpleJsonNQuadsWriter....
38:92 (52%)
41:95 (31%)
view
30 x 2 neptune-export/src/main/...eptune/propertygraph/io
neptune-export/src/main/...eptune/propertygraph/io
NeptuneStreamsJsonPropertyGraphPrinte...
NeptuneStreamsSimpleJsonPropertyGraph...
61:108 (34%)
62:109 (35%)
view
19 x 2 neptune-export/src/main/.../profiles/neptune_ml/v1
neptune-export/src/main/.../profiles/neptune_ml/v2
PropertyGraphTrainingDataConfigWriter...
PropertyGraphTrainingDataConfigWriter...
35:61 (4%)
36:62 (4%)
view
18 x 2 neptune-export/src/main/...s/neptune/propertygraph
neptune-export/src/main/...s/neptune/propertygraph
AllLabels.java
SpecifiedLabels.java
50:80 (41%)
131:161 (18%)
view
17 x 2 neptune-export/src/main/...une/profiles/neptune_ml
neptune-export/src/main/...une/profiles/neptune_ml
NeptuneMachineLearningExportEventHand...
NeptuneMachineLearningExportEventHand...
67:85 (14%)
59:77 (12%)
view
17 x 2 neptune-export/src/main/...zonaws/services/neptune
neptune-export/src/main/...zonaws/services/neptune
ExportPropertyGraph.java
ExportPropertyGraphFromConfig.java
102:122 (20%)
84:104 (26%)
view
16 x 2 glue-neptune/glue_neptune
neptune-python-utils/neptune_python_utils
GremlinCsvTransforms.py
glue_gremlin_csv_transforms.py
30:62 (94%)
21:53 (94%)
view
16 x 2 neptune-export/src/main/...services/neptune/rdf/io
neptune-export/src/main/...services/neptune/rdf/io
EnhancedNQuadsWriter.java
EnhancedTurtleWriter.java
32:55 (64%)
33:57 (61%)
view
16 x 2 neptune-gremlin-client/g...software/amazon/neptune
neptune-gremlin-client/g...software/amazon/neptune
RefreshAgentDemo.java
RollingSubsetOfEndpointDemo.java
48:67 (21%)
49:68 (21%)
view
16 x 2 neptune-export/src/main/...ervices/neptune/cluster
neptune-gremlin-client/g.../amazon/neptune/cluster
NeptuneClusterMetadata.java
GetEndpointsFromNeptuneManagementApi....
76:94 (11%)
109:127 (14%)
view
15 x 2 neptune-export/src/main/...ervices/neptune/cluster
neptune-export/src/main/...ervices/neptune/cluster
DoNotCloneCluster.java
SimulatedCloneCluster.java
30:52 (68%)
32:54 (62%)
view
15 x 2 neptune-export/src/main/...zonaws/services/neptune
neptune-export/src/main/...zonaws/services/neptune
ExportPropertyGraph.java
ExportPropertyGraphFromConfig.java
54:75 (18%)
44:65 (23%)
view
14 x 2 neptune-export/src/main/...eptune/propertygraph/io
neptune-export/src/main/...eptune/propertygraph/io
RewriteAndMergeCsv.java
RewriteCsv.java
77:97 (14%)
76:96 (14%)
view
14 x 2 neptune-export/src/main/...eptune/propertygraph/io
neptune-export/src/main/...eptune/propertygraph/io
NeptuneStreamsJsonPropertyGraphPrinte...
NeptuneStreamsSimpleJsonPropertyGraph...
112:134 (15%)
114:136 (16%)
view
12 x 2 neptune-export/src/main/...ervices/neptune/cluster
neptune-export/src/main/...ervices/neptune/cluster
EventId.java
StreamRecordsNotFoundExceptionParser....
25:42 (54%)
24:41 (44%)
view
12 x 2 neptune-export/src/main/...s/neptune/propertygraph
neptune-export/src/main/...s/neptune/propertygraph
Scope.java
Scope.java
86:97 (8%)
127:138 (8%)
view
12 x 2 neptune-export/src/main/...s/neptune/propertygraph
neptune-export/src/main/...s/neptune/propertygraph
EdgesClient.java
NodesClient.java
116:134 (13%)
114:132 (13%)
view
11 x 2 neptune-export/src/main/...eptune/propertygraph/io
neptune-export/src/main/...eptune/propertygraph/io
JsonPropertyGraphPrinter.java
VariableRowCsvPropertyGraphPrinter.java
156:172 (9%)
101:117 (16%)
view
Duplicated Units
The list of top 18 duplicated units.
See data for all 18 unit duplicates...
Size#FoldersFilesLinesCode
19 x 2 neptune-export/src/main/...une/profiles/neptune_ml
neptune-export/src/main/...une/profiles/neptune_ml
NeptuneMachineLearningExportEventHand...
NeptuneMachineLearningExportEventHand...
202:228 
193:219 
view
17 x 2 neptune-export/src/main/...eptune/propertygraph/io
neptune-export/src/main/...eptune/propertygraph/io
NeptuneStreamsSimpleJsonPropertyGraph...
NeptuneStreamsJsonPropertyGraphPrinte...
68:89 
67:88 
view
12 x 2 neptune-export/src/main/...services/neptune/rdf/io
neptune-export/src/main/...services/neptune/rdf/io
EnhancedTurtleWriter.java
EnhancedNQuadsWriter.java
39:55 
38:53 
view
11 x 2 neptune-export/src/main/...ptune_ml/common/parsing
neptune-export/src/main/...ptune_ml/common/parsing
ParseSubject.java
ParseObject.java
27:38 
27:38 
view
10 x 2 neptune-export/src/main/...eptune/propertygraph/io
neptune-export/src/main/...eptune/propertygraph/io
PropertyGraphExportFormat.java
PropertyGraphExportFormat.java
84:94 
124:134 
view
10 x 2 neptune-export/src/main/...s/services/neptune/util
neptune-export/src/main/...s/services/neptune/util
Timer.java
Timer.java
53:64 
70:81 
view
9 x 2 neptune-export/src/main/...s/services/neptune/util
neptune-export/src/main/...s/services/neptune/util
Timer.java
Timer.java
21:31 
37:47 
view
8 x 2 neptune-export/src/main/...s/neptune/propertygraph
neptune-export/src/main/...s/neptune/propertygraph
NodesClient.java
EdgesClient.java
48:56 
47:55 
view
8 x 2 neptune-export/src/main/...s/neptune/propertygraph
neptune-export/src/main/...s/neptune/propertygraph
NodesClient.java
EdgesClient.java
120:129 
122:131 
view
8 x 2 neptune-export/src/main/...s/services/neptune/util
neptune-export/src/main/...s/services/neptune/util
Timer.java
Timer.java
83:91 
93:101 
view
7 x 2 neptune-export/src/main/...services/neptune/rdf/io
neptune-export/src/main/...services/neptune/rdf/io
NeptuneStreamsJsonNQuadsWriter.java
NeptuneStreamsSimpleJsonNQuadsWriter....
37:44 
40:47 
view
7 x 2 neptune-export/src/main/...une/profiles/neptune_ml
neptune-export/src/main/...une/profiles/neptune_ml
NeptuneMachineLearningExportEventHand...
NeptuneMachineLearningExportEventHand...
230:237 
221:228 
view
7 x 2 neptune-export/src/main/...aws/services/neptune/io
neptune-export/src/main/...aws/services/neptune/io
DirectoryStructure.java
DirectoryStructure.java
56:63 
67:74 
view
6 x 2 neptune-export/src/main/...eptune/propertygraph/io
neptune-export/src/main/...eptune/propertygraph/io
RewriteCsv.java
RewriteAndMergeCsv.java
45:51 
46:52 
view
6 x 2 neptune-export/src/main/...eptune/propertygraph/io
neptune-export/src/main/...eptune/propertygraph/io
RewriteCsv.java
RewriteAndMergeCsv.java
54:62 
55:63 
view
6 x 3 neptune-export/src/main/...s/neptune_ml/v1/parsing
neptune-export/src/main/...s/neptune_ml/v2/parsing
neptune-export/src/main/...s/neptune_ml/v2/parsing
ParseBucketCountV1.java
ParseMinDfV2.java
ParseMaxFeaturesV2.java
29:35 
29:35 
29:35 
view
6 x 2 neptune-export/src/main/...s/neptune_ml/v1/parsing
neptune-export/src/main/...s/neptune_ml/v2/parsing
ParseFeaturesV1.java
ParseFeaturesV2.java
139:145 
278:284 
view
6 x 2 neptune-export/src/main/.../profiles/neptune_ml/v1
neptune-export/src/main/.../profiles/neptune_ml/v2
PropertyGraphTrainingDataConfigWriter...
PropertyGraphTrainingDataConfigWriter...
161:167 
359:365 
view