aws-samples / sql-based-etl-on-amazon-eks
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 21% duplication:
    • 1,702 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 371 duplicated lines
  • 37 duplicates
system21% (371 lines)
Duplication per Extension
yaml36% (371 lines)
Duplication per Component (primary)
source/app_resources38% (312 lines)
source/example21% (36 lines)
deployment/app_code/job29% (23 lines)
source/lib0% (0 lines)
source/lib/util0% (0 lines)
source/lib/cdk_infra0% (0 lines)
source0% (0 lines)
deployment/cdk-solution-helper0% (0 lines)
Longest Duplicates
The list of 20 longest duplicates.
See data for all 37 duplicates...
Size#FoldersFilesLinesCode
29 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
152:180 (9%)
239:267 (9%)
view
29 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
65:93 (9%)
152:180 (9%)
view
29 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
65:93 (9%)
239:267 (9%)
view
15 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
27:42 (4%)
114:129 (4%)
view
15 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
131:150 (4%)
218:237 (4%)
view
15 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
27:42 (4%)
201:216 (4%)
view
15 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
114:129 (4%)
201:216 (4%)
view
14 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
45:63 (4%)
132:150 (4%)
view
14 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
45:63 (4%)
219:237 (4%)
view
13 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
etl-rbac.yaml
native-spark-rbac.yaml
28:40 (34%)
1:13 (100%)
view
12 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
21:32 (3%)
280:291 (3%)
view
12 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
9:21 (3%)
96:108 (3%)
view
12 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
9:21 (3%)
183:195 (3%)
view
12 x 2 spark-on-eks/source/app_resources
spark-on-eks/source/app_resources
spark-template.yaml
spark-template.yaml
96:108 (3%)
183:195 (3%)
view
11 x 2 spark-on-eks/deployment/app_code/job
spark-on-eks/deployment/app_code/job
driver-pod-template.yaml
executor-pod-template.yaml
6:16 (64%)
6:16 (64%)
view
9 x 2 spark-on-eks/source/example
spark-on-eks/source/example
native-spark-job-scheduler.yaml
native-spark-job-scheduler.yaml
39:47 (11%)
65:73 (11%)
view
9 x 2 spark-on-eks/deployment/app_code/job
spark-on-eks/source/example
executor-pod-template.yaml
native-spark-job-scheduler.yaml
9:17 (52%)
39:47 (11%)
view
9 x 2 spark-on-eks/deployment/app_code/job
spark-on-eks/source/example
executor-pod-template.yaml
native-spark-job-scheduler.yaml
9:17 (52%)
65:73 (11%)
view
8 x 2 spark-on-eks/deployment/app_code/job
spark-on-eks/source/example
driver-pod-template.yaml
native-spark-job-scheduler.yaml
9:16 (47%)
39:46 (10%)
view
8 x 2 spark-on-eks/deployment/app_code/job
spark-on-eks/source/example
driver-pod-template.yaml
native-spark-job-scheduler.yaml
9:16 (47%)
65:72 (10%)
view