aws-samples / amazon-athena-train-amazon-sagemaker
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 8% duplication:
    • 5,912 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 514 duplicated lines
  • 273 duplicates
system8% (514 lines)
Duplication per Extension
java8% (484 lines)
yaml26% (30 lines)
Duplication per Component (primary)
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/data6% (135 lines)
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/domain9% (116 lines)
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/metadata13% (86 lines)
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/handlers8% (60 lines)
athena-udfs/src/main/java/com/amazonaws/athena/connectors/udfs22% (28 lines)
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/request27% (28 lines)
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/records11% (25 lines)
athena-udfs26% (15 lines)
athena-federation-sdk26% (15 lines)
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/security2% (6 lines)
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/serde0% (0 lines)
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda0% (0 lines)
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/exceptions0% (0 lines)
athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/udf0% (0 lines)

Duplication Between Components (50+ lines)

G athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/domain athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/domain athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/metadata athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/metadata athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/domain--athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/metadata 96 athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/records athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/records athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/domain--athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/records 52 athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/metadata--athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/records 84 athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/security athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/security athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/metadata--athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/security 72 athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/data athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/data athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/data--athena-federation-sdk/src/main/java/com/amazonaws/athena/connector/lambda/metadata 72

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 20 longest duplicates.
See data for all 273 duplicates...
Size#FoldersFilesLinesCode
15 x 2 athena-federation-sdk/sr...a/connector/lambda/data
athena-federation-sdk/sr...a/connector/lambda/data
Block.java
Block.java
 380:402 (9%)
430:452 (9%)
 view
14 x 2 athena-udfs/src/main/jav.../athena/connectors/udfs
athena-udfs/src/main/jav.../athena/connectors/udfs
AthenaUDFHandler.java
AthenaUDFHandler.java
 84:97 (11%)
107:120 (11%)
 view
11 x 2 athena-federation-sdk/sr...nnector/lambda/handlers
athena-federation-sdk/sr...nnector/lambda/handlers
RecordHandler.java
UserDefinedFunctionHandler.java
 241:261 (11%)
278:298 (4%)
 view
10 x 2 athena-federation-sdk/sr...nnector/lambda/handlers
athena-federation-sdk/sr...nnector/lambda/handlers
MetadataHandler.java
RecordHandler.java
 194:205 (6%)
120:131 (10%)
 view
9 x 2 athena-federation-sdk/sr...nnector/lambda/metadata
athena-federation-sdk/sr...nnector/lambda/metadata
GetSplitsResponse.java
GetTableResponse.java
 117:131 (16%)
123:137 (17%)
 view
9 x 2 athena-federation-sdk/sr...onnector/lambda/records
athena-federation-sdk/sr...onnector/lambda/records
ReadRecordsResponse.java
RemoteReadRecordsResponse.java
 105:117 (21%)
126:138 (16%)
 view
8 x 2 athena-federation-sdk/sr...onnector/lambda/request
athena-federation-sdk/sr...onnector/lambda/request
PingRequest.java
PingResponse.java
 79:91 (28%)
103:115 (20%)
 view
8 x 2 athena-federation-sdk/sr...a/connector/lambda/data
athena-federation-sdk/sr...a/connector/lambda/data
S3BlockSpillReader.java
S3BlockSpillReader.java
 72:81 (19%)
104:113 (19%)
 view
8 x 2 athena-federation-sdk
athena-udfs
athena-federation-sdk.yaml
athena-udfs.yaml
 27:34 (14%)
24:31 (14%)
 view
7 x 2 athena-federation-sdk/sr...lambda/domain/predicate
athena-federation-sdk/sr...lambda/domain/predicate
EquatableValueSet.java
EquatableValueSet.java
 366:375 (2%)
386:394 (2%)
 view
7 x 2 athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
DateDayFieldWriter.java
SmallIntFieldWriter.java
 72:81 (33%)
72:81 (33%)
 view
7 x 2 athena-federation-sdk/sr...onnector/lambda/records
athena-federation-sdk/sr...onnector/lambda/records
ReadRecordsRequest.java
RemoteReadRecordsResponse.java
 172:182 (8%)
128:138 (12%)
 view
7 x 2 athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
Float4FieldWriter.java
TinyIntFieldWriter.java
 72:81 (33%)
72:81 (33%)
 view
7 x 2 athena-federation-sdk/sr...lambda/domain/predicate
athena-federation-sdk/sr...lambda/domain/predicate
EquatableValueSet.java
EquatableValueSet.java
 366:375 (2%)
413:422 (2%)
 view
7 x 2 athena-federation-sdk/sr...nnector/lambda/metadata
athena-federation-sdk/sr...nnector/lambda/metadata
GetTableLayoutRequest.java
ListTablesResponse.java
 139:149 (11%)
79:89 (21%)
 view
7 x 2 athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
Float4FieldWriter.java
Float8FieldWriter.java
 72:81 (33%)
72:81 (33%)
 view
7 x 2 athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
DateDayFieldWriter.java
DateMilliFieldWriter.java
 72:81 (33%)
74:83 (33%)
 view
7 x 2 athena-federation-sdk/sr...nnector/lambda/metadata
athena-federation-sdk/sr...nnector/lambda/metadata
GetTableLayoutRequest.java
ListTablesRequest.java
 139:149 (11%)
77:87 (20%)
 view
7 x 2 athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
BigIntFieldWriter.java
SmallIntFieldWriter.java
 72:81 (33%)
72:81 (33%)
 view
7 x 2 athena-federation-sdk/sr...nnector/lambda/metadata
athena-federation-sdk/sr...nnector/lambda/metadata
ListSchemasResponse.java
ListTablesRequest.java
 78:88 (21%)
77:87 (20%)
 view
Duplicated Units
The list of top 4 duplicated units.
See data for all 4 unit duplicates...
Size#FoldersFilesLinesCode
10 x 2 athena-federation-sdk/sr...nnector/lambda/handlers
athena-federation-sdk/sr...nnector/lambda/handlers
UserDefinedFunctionHandler.java
RecordHandler.java
 278:288 
241:251 
 view
6 x 3 athena-federation-sdk/sr...lambda/domain/predicate
athena-federation-sdk/sr...lambda/domain/predicate
athena-federation-sdk/sr...lambda/domain/predicate
EquatableValueSet.java
AllOrNoneValueSet.java
SortedRangeSet.java
 562:568 
273:279 
468:474 
 view
6 x 2 athena-federation-sdk/sr...onnector/lambda/records
athena-federation-sdk/sr...nnector/lambda/metadata
RecordResponse.java
MetadataResponse.java
 42:48 
42:48 
 view
6 x 9 athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
athena-federation-sdk/sr...ta/writers/fieldwriters
Float8FieldWriter.java
DateMilliFieldWriter.java
BitFieldWriter.java
Float4FieldWriter.java
DateDayFieldWriter.java
BigIntFieldWriter.java
SmallIntFieldWriter.java
IntFieldWriter.java
TinyIntFieldWriter.java
 73:79 
75:81 
73:79 
73:79 
73:79 
73:79 
73:79 
73:79 
73:79 
 view