aws-samples / dataops-platform-airflow-dbt
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 16% duplication:
    • 959 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 155 duplicated lines
  • 13 duplicates
system16% (155 lines)
Duplication per Extension
py12% (102 lines)
Dockerfile91% (33 lines)
yml23% (20 lines)
Duplication per Component (primary)
dataops-infra/infra/stacks/fargate_services28% (76 lines)
dataops-infra/images/airflow91% (33 lines)
dataops-infra/infra/stacks5% (26 lines)
dataops-infra/images46% (20 lines)
analytics/airflow_dags0% (0 lines)
analytics/dbt_dags/config0% (0 lines)
analytics/dbt_dags/models/example0% (0 lines)
analytics/dbt_dags0% (0 lines)
dataops-infra/infra0% (0 lines)
dataops-infra/scripts0% (0 lines)
Longest Duplicates
The list of 13 longest duplicates.
See data for all 13 duplicates...
Size#FoldersFilesLinesCode
15 x 2 dataops-infra/infra/stacks/fargate_services
dataops-infra/infra/stacks/fargate_services
airflow.py
airflow.py
142:156 (6%)
197:211 (6%)
view
14 x 2 dataops-infra/infra/stacks/fargate_services
dataops-infra/infra/stacks/fargate_services
airflow.py
airflow.py
76:89 (6%)
198:211 (6%)
view
14 x 2 dataops-infra/infra/stacks/fargate_services
dataops-infra/infra/stacks/fargate_services
airflow.py
airflow.py
76:89 (6%)
143:156 (6%)
view
11 x 2 dataops-infra/images/airflow
dataops-infra/images/airflow
webserver.Dockerfile
worker.Dockerfile
2:15 (91%)
2:15 (91%)
view
11 x 2 dataops-infra/images/airflow
dataops-infra/images/airflow
scheduler.Dockerfile
webserver.Dockerfile
2:15 (91%)
2:15 (91%)
view
11 x 2 dataops-infra/images/airflow
dataops-infra/images/airflow
scheduler.Dockerfile
worker.Dockerfile
2:15 (91%)
2:15 (91%)
view
10 x 2 dataops-infra/images
dataops-infra/images
airflow_buildspec.yml
dbt_buildspec.yml
7:16 (40%)
3:12 (55%)
view
7 x 2 dataops-infra/infra/stacks/fargate_services
dataops-infra/infra/stacks/fargate_services
airflow.py
airflow.py
133:139 (3%)
188:194 (3%)
view
7 x 2 dataops-infra/infra/stacks
dataops-infra/infra/stacks
airflow_cluster_stack.py
airflow_cluster_stack.py
24:30 (5%)
37:43 (5%)
view
6 x 2 dataops-infra/infra/stacks/fargate_services
dataops-infra/infra/stacks/fargate_services
airflow.py
airflow.py
68:73 (2%)
188:193 (2%)
view
6 x 2 dataops-infra/infra/stacks/fargate_services
dataops-infra/infra/stacks/fargate_services
airflow.py
dbt.py
31:37 (2%)
24:30 (12%)
view
6 x 2 dataops-infra/infra/stacks
dataops-infra/infra/stacks
airflow_cluster_stack.py
airflow_cluster_stack.py
67:72 (4%)
79:84 (4%)
view
6 x 2 dataops-infra/infra/stacks/fargate_services
dataops-infra/infra/stacks/fargate_services
airflow.py
airflow.py
68:73 (2%)
133:138 (2%)
view