Places in code with 6 or more lines that are exactly the same.
Intro
- For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
- Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
- You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
- To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:
- Avoid Repetition, MartinFlower.com (IEEE Software article)
- Refactoring duplicated code, sourcemaking.com
- Beck Design Rules, MartinFowler.com
- DRY (Don't Repeat Yourself) Principle, Wikipedia
- The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
- Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:
- "Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"
- Reducing Coupling, MartinFlower.com (IEEE Software article):
- "There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."
Duplication Overall
- 76% duplication:
- 5,545 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
- 4,260 duplicated lines
- 78 duplicates
Duplication per Extension
Duplication per Component (primary)
Duplication Between Components (50+ lines)
Open 3D force graph...
Show more details on duplication between components...
From Component
--> To Component
Duplicated
Lines
File Pairs
Details
News Vendor/common/sagemaker_rl (99%)
--> Vehicle Routing Problem/common/sagemaker_rl (99%)
1606
9 file pairs
details...
Bin Packing/common/sagemaker_rl (99%)
--> common/sagemaker_rl (99%)
1606
9 file pairs
details...
News Vendor/common/sagemaker_rl (99%)
--> common/sagemaker_rl (99%)
1606
9 file pairs
details...
Bin Packing/common/sagemaker_rl (99%)
--> News Vendor/common/sagemaker_rl (99%)
1606
9 file pairs
details...
Vehicle Routing Problem/common/sagemaker_rl (99%)
--> common/sagemaker_rl (99%)
1606
9 file pairs
details...
Bin Packing/common/sagemaker_rl (99%)
--> Vehicle Routing Problem/common/sagemaker_rl (99%)
1606
9 file pairs
details...
Bin Packing/common (100%)
--> Vehicle Routing Problem/common (100%)
458
3 file pairs
details...
News Vendor/common (100%)
--> Vehicle Routing Problem/common (100%)
458
3 file pairs
details...
Vehicle Routing Problem/common (100%)
--> common (100%)
458
3 file pairs
details...
Bin Packing/common (100%)
--> common (100%)
458
3 file pairs
details...
Bin Packing/common (100%)
--> News Vendor/common (100%)
458
3 file pairs
details...
News Vendor/common (100%)
--> common (100%)
458
3 file pairs
details...
Bin Packing/src (7%)
--> Vehicle Routing Problem/src (4%)
64
2 file pairs
details...
| From Component --> To Component |
Duplicated Lines |
File Pairs | Details |
|---|---|---|---|
| News Vendor/common/sagemaker_rl (99%) --> Vehicle Routing Problem/common/sagemaker_rl (99%) |
1606 | 9 file pairs | details... |
| Bin Packing/common/sagemaker_rl (99%) --> common/sagemaker_rl (99%) |
1606 | 9 file pairs | details... |
| News Vendor/common/sagemaker_rl (99%) --> common/sagemaker_rl (99%) |
1606 | 9 file pairs | details... |
| Bin Packing/common/sagemaker_rl (99%) --> News Vendor/common/sagemaker_rl (99%) |
1606 | 9 file pairs | details... |
| Vehicle Routing Problem/common/sagemaker_rl (99%) --> common/sagemaker_rl (99%) |
1606 | 9 file pairs | details... |
| Bin Packing/common/sagemaker_rl (99%) --> Vehicle Routing Problem/common/sagemaker_rl (99%) |
1606 | 9 file pairs | details... |
| Bin Packing/common (100%) --> Vehicle Routing Problem/common (100%) |
458 | 3 file pairs | details... |
| News Vendor/common (100%) --> Vehicle Routing Problem/common (100%) |
458 | 3 file pairs | details... |
| Vehicle Routing Problem/common (100%) --> common (100%) |
458 | 3 file pairs | details... |
| Bin Packing/common (100%) --> common (100%) |
458 | 3 file pairs | details... |
| Bin Packing/common (100%) --> News Vendor/common (100%) |
458 | 3 file pairs | details... |
| News Vendor/common (100%) --> common (100%) |
458 | 3 file pairs | details... |
| Bin Packing/src (7%) --> Vehicle Routing Problem/src (4%) |
64 | 2 file pairs | details... |
Longest Duplicates
The list of 20 longest duplicates.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 181 | x 2 | News Vendor/common/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rl |  coach_launcher.pycoach_launcher.py |
23:316 (100%)23:316 (100%) | view |
| 181 | x 2 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rl | coach_launcher.pycoach_launcher.py |
23:316 (100%)23:316 (100%) | view |
| 181 | x 2 | News Vendor/common/sagemaker_rlcommon/sagemaker_rl | coach_launcher.pycoach_launcher.py |
23:316 (100%)23:316 (100%) | view |
| 181 | x 2 | Bin Packing/common/sagemaker_rlNews Vendor/common/sagemaker_rl | coach_launcher.pycoach_launcher.py |
23:316 (100%)23:316 (100%) | view |
| 181 | x 2 | Vehicle Routing&nbs...lem/common/sagemaker_rlcommon/sagemaker_rl | coach_launcher.pycoach_launcher.py |
23:316 (100%)23:316 (100%) | view |
| 181 | x 2 | Bin Packing/common/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rl | coach_launcher.pycoach_launcher.py |
23:316 (100%)23:316 (100%) | view |
| 145 | x 2 | Bin Packing/common/sagemaker_rlNews Vendor/common/sagemaker_rl | ray_launcher.pyray_launcher.py |
20:249 (100%)20:249 (100%) | view |
| 145 | x 2 | News Vendor/common/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rl | ray_launcher.pyray_launcher.py |
20:249 (100%)20:249 (100%) | view |
| 145 | x 2 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rl | ray_launcher.pyray_launcher.py |
20:249 (100%)20:249 (100%) | view |
| 145 | x 2 | Vehicle Routing&nbs...lem/common/sagemaker_rlcommon/sagemaker_rl | ray_launcher.pyray_launcher.py |
20:249 (100%)20:249 (100%) | view |
| 145 | x 2 | Bin Packing/common/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rl | ray_launcher.pyray_launcher.py |
20:249 (100%)20:249 (100%) | view |
| 145 | x 2 | News Vendor/common/sagemaker_rlcommon/sagemaker_rl | ray_launcher.pyray_launcher.py |
20:249 (100%)20:249 (100%) | view |
| 143 | x 2 | Bin Packing/common/sagemaker_rlNews Vendor/common/sagemaker_rl | mpi_launcher.pympi_launcher.py |
21:295 (100%)21:295 (100%) | view |
| 143 | x 2 | News Vendor/common/sagemaker_rlcommon/sagemaker_rl | mpi_launcher.pympi_launcher.py |
21:295 (100%)21:295 (100%) | view |
| 143 | x 2 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rl | mpi_launcher.pympi_launcher.py |
21:295 (100%)21:295 (100%) | view |
| 143 | x 2 | Bin Packing/common/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rl | mpi_launcher.pympi_launcher.py |
21:295 (100%)21:295 (100%) | view |
| 143 | x 2 | Vehicle Routing&nbs...lem/common/sagemaker_rlcommon/sagemaker_rl | mpi_launcher.pympi_launcher.py |
21:295 (100%)21:295 (100%) | view |
| 143 | x 2 | News Vendor/common/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rl | mpi_launcher.pympi_launcher.py |
21:295 (100%)21:295 (100%) | view |
| 106 | x 2 | News Vendor/common/sagemaker_rlcommon/sagemaker_rl | sage_cluster_communicator.pysage_cluster_communicator.py |
8:130 (100%)8:130 (100%) | view |
| 106 | x 2 | Bin Packing/common/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rl | sage_cluster_communicator.pysage_cluster_communicator.py |
8:130 (100%)8:130 (100%) | view |
Duplicated Units
The list of top 20 duplicated units.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 58 | x 4 | Bin Packing/commoncommonVehicle Routing Problem/commonNews Vendor/common | misc.pymisc.pymisc.pymisc.py |
0:0 0:0 0:0 0:0 | view |
| 35 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | mpi_launcher.pympi_launcher.pympi_launcher.pympi_launcher.py |
0:0 0:0 0:0 0:0 | view |
| 39 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | coach_launcher.pycoach_launcher.pycoach_launcher.pycoach_launcher.py |
0:0 0:0 0:0 0:0 | view |
| 36 | x 4 | Bin Packing/commoncommonVehicle Routing Problem/commonNews Vendor/common | misc.pymisc.pymisc.pymisc.py |
0:0 0:0 0:0 0:0 | view |
| 28 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | ray_launcher.pyray_launcher.pyray_launcher.pyray_launcher.py |
0:0 0:0 0:0 0:0 | view |
| 26 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | stable_baselines_launcher.pystable_baselines_launcher.pystable_baselines_launcher.pystable_baselines_launcher.py |
0:0 0:0 0:0 0:0 | view |
| 23 | x 2 | Bin Packing/srcVehicle Routing Problem/src | model.pymodel.py |
0:0 0:0 | view |
| 20 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | tf_serving_utils.pytf_serving_utils.pytf_serving_utils.pytf_serving_utils.py |
0:0 0:0 0:0 0:0 | view |
| 19 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | sage_cluster_communicator.pysage_cluster_communicator.pysage_cluster_communicator.pysage_cluster_communicator.py |
0:0 0:0 0:0 0:0 | view |
| 26 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | coach_launcher.pycoach_launcher.pycoach_launcher.pycoach_launcher.py |
0:0 0:0 0:0 0:0 | view |
| 24 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | ray_launcher.pyray_launcher.pyray_launcher.pyray_launcher.py |
0:0 0:0 0:0 0:0 | view |
| 24 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | coach_launcher.pycoach_launcher.pycoach_launcher.pycoach_launcher.py |
0:0 0:0 0:0 0:0 | view |
| 20 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | configuration_list.pyconfiguration_list.pyconfiguration_list.pyconfiguration_list.py |
0:0 0:0 0:0 0:0 | view |
| 17 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | docker_utils.pydocker_utils.pydocker_utils.pydocker_utils.py |
0:0 0:0 0:0 0:0 | view |
| 16 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | ray_launcher.pyray_launcher.pyray_launcher.pyray_launcher.py |
0:0 0:0 0:0 0:0 | view |
| 18 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | coach_launcher.pycoach_launcher.pycoach_launcher.pycoach_launcher.py |
0:0 0:0 0:0 0:0 | view |
| 18 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | coach_launcher.pycoach_launcher.pycoach_launcher.pycoach_launcher.py |
0:0 0:0 0:0 0:0 | view |
| 22 | x 4 | Bin Packing/commoncommonVehicle Routing Problem/commonNews Vendor/common | docker_utils.pydocker_utils.pydocker_utils.pydocker_utils.py |
0:0 0:0 0:0 0:0 | view |
| 13 | x 4 | Bin Packing/commoncommonVehicle Routing Problem/commonNews Vendor/common | docker_utils.pydocker_utils.pydocker_utils.pydocker_utils.py |
0:0 0:0 0:0 0:0 | view |
| 13 | x 4 | Bin Packing/common/sagemaker_rlcommon/sagemaker_rlVehicle Routing&nbs...lem/common/sagemaker_rlNews Vendor/common/sagemaker_rl | sage_cluster_communicator.pysage_cluster_communicator.pysage_cluster_communicator.pysage_cluster_communicator.py |
0:0 0:0 0:0 0:0 | view |