Places in code with 6 or more lines that are exactly the same.
Intro
- For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
- Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
- You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
- To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:
- Avoid Repetition, MartinFlower.com (IEEE Software article)
- Refactoring duplicated code, sourcemaking.com
- Beck Design Rules, MartinFowler.com
- DRY (Don't Repeat Yourself) Principle, Wikipedia
- The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
- Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:
- "Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"
- Reducing Coupling, MartinFlower.com (IEEE Software article):
- "There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."
Duplication Overall
- 72% duplication:
- 23,154 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
- 16,812 duplicated lines
- 1,837 duplicates
Duplication per Extension
Duplication per Component (primary)
Duplication Between Components (50+ lines)
Open 3D force graph...
Show more details on duplication between components...
From Component
--> To Component
Duplicated
Lines
File Pairs
Details
downstream/insseg/datasets (91%)
--> downstream/semseg/datasets (89%)
4410
44 file pairs
details...
downstream/votenet/models (52%)
--> pretrain/contrastive_scene_contexts/model (101%)
4335
26 file pairs
details...
downstream/insseg/models (99%)
--> downstream/semseg/models (99%)
2574
19 file pairs
details...
downstream/semseg/models (94%)
--> downstream/votenet/models (29%)
2429
15 file pairs
details...
downstream/insseg/models (93%)
--> downstream/votenet/models (29%)
2427
15 file pairs
details...
downstream/insseg/lib (70%)
--> downstream/semseg/lib (76%)
2117
9 file pairs
details...
downstream/insseg/datasets (39%)
--> pretrain/contrastive_scene_contexts/lib (54%)
1893
15 file pairs
details...
downstream/semseg/datasets (38%)
--> pretrain/contrastive_scene_contexts/lib (54%)
1890
15 file pairs
details...
downstream/semseg/models (52%)
--> pretrain/contrastive_scene_contexts/model (31%)
1347
9 file pairs
details...
downstream/insseg/models (51%)
--> pretrain/contrastive_scene_contexts/model (31%)
1345
9 file pairs
details...
downstream/semseg/datasets (10%)
--> downstream/votenet/datasets (14%)
493
8 file pairs
details...
downstream/insseg/datasets (10%)
--> downstream/votenet/datasets (14%)
493
8 file pairs
details...
downstream/votenet/datasets (12%)
--> pretrain/contrastive_scene_contexts/lib (12%)
418
5 file pairs
details...
downstream/insseg/lib (13%)
--> pretrain/contrastive_scene_contexts/lib (11%)
390
5 file pairs
details...
downstream/semseg/lib (14%)
--> pretrain/contrastive_scene_contexts/lib (11%)
390
5 file pairs
details...
downstream/votenet/datasets (11%)
--> downstream/votenet/lib (10%)
387
4 file pairs
details...
downstream/insseg/lib (12%)
--> downstream/votenet/lib (10%)
370
4 file pairs
details...
downstream/semseg/lib (13%)
--> downstream/votenet/lib (10%)
370
4 file pairs
details...
downstream/votenet/lib (8%)
--> pretrain/contrastive_scene_contexts/lib (9%)
318
4 file pairs
details...
downstream/semseg/datasets (4%)
--> downstream/votenet/models (2%)
242
1 file pair
details...
downstream/insseg/config (92%)
--> downstream/semseg/config (90%)
234
1 file pair
details...
downstream/insseg/datasets (4%)
--> downstream/votenet/models (2%)
206
1 file pair
details...
downstream/insseg/lib (2%)
--> downstream/votenet/datasets (2%)
84
1 file pair
details...
downstream/semseg/lib (3%)
--> downstream/votenet/datasets (2%)
84
1 file pair
details...
downstream/insseg/lib (2%)
--> downstream/votenet/models (<1%)
80
1 file pair
details...
downstream/semseg/lib (2%)
--> downstream/votenet/models (<1%)
80
1 file pair
details...
| From Component --> To Component |
Duplicated Lines |
File Pairs | Details |
|---|---|---|---|
| downstream/insseg/datasets (91%) --> downstream/semseg/datasets (89%) |
4410 | 44 file pairs | details... |
| downstream/votenet/models (52%) --> pretrain/contrastive_scene_contexts/model (101%) |
4335 | 26 file pairs | details... |
| downstream/insseg/models (99%) --> downstream/semseg/models (99%) |
2574 | 19 file pairs | details... |
| downstream/semseg/models (94%) --> downstream/votenet/models (29%) |
2429 | 15 file pairs | details... |
| downstream/insseg/models (93%) --> downstream/votenet/models (29%) |
2427 | 15 file pairs | details... |
| downstream/insseg/lib (70%) --> downstream/semseg/lib (76%) |
2117 | 9 file pairs | details... |
| downstream/insseg/datasets (39%) --> pretrain/contrastive_scene_contexts/lib (54%) |
1893 | 15 file pairs | details... |
| downstream/semseg/datasets (38%) --> pretrain/contrastive_scene_contexts/lib (54%) |
1890 | 15 file pairs | details... |
| downstream/semseg/models (52%) --> pretrain/contrastive_scene_contexts/model (31%) |
1347 | 9 file pairs | details... |
| downstream/insseg/models (51%) --> pretrain/contrastive_scene_contexts/model (31%) |
1345 | 9 file pairs | details... |
| downstream/semseg/datasets (10%) --> downstream/votenet/datasets (14%) |
493 | 8 file pairs | details... |
| downstream/insseg/datasets (10%) --> downstream/votenet/datasets (14%) |
493 | 8 file pairs | details... |
| downstream/votenet/datasets (12%) --> pretrain/contrastive_scene_contexts/lib (12%) |
418 | 5 file pairs | details... |
| downstream/insseg/lib (13%) --> pretrain/contrastive_scene_contexts/lib (11%) |
390 | 5 file pairs | details... |
| downstream/semseg/lib (14%) --> pretrain/contrastive_scene_contexts/lib (11%) |
390 | 5 file pairs | details... |
| downstream/votenet/datasets (11%) --> downstream/votenet/lib (10%) |
387 | 4 file pairs | details... |
| downstream/insseg/lib (12%) --> downstream/votenet/lib (10%) |
370 | 4 file pairs | details... |
| downstream/semseg/lib (13%) --> downstream/votenet/lib (10%) |
370 | 4 file pairs | details... |
| downstream/votenet/lib (8%) --> pretrain/contrastive_scene_contexts/lib (9%) |
318 | 4 file pairs | details... |
| downstream/semseg/datasets (4%) --> downstream/votenet/models (2%) |
242 | 1 file pair | details... |
| downstream/insseg/config (92%) --> downstream/semseg/config (90%) |
234 | 1 file pair | details... |
| downstream/insseg/datasets (4%) --> downstream/votenet/models (2%) |
206 | 1 file pair | details... |
| downstream/insseg/lib (2%) --> downstream/votenet/datasets (2%) |
84 | 1 file pair | details... |
| downstream/semseg/lib (3%) --> downstream/votenet/datasets (2%) |
84 | 1 file pair | details... |
| downstream/insseg/lib (2%) --> downstream/votenet/models (<1%) |
80 | 1 file pair | details... |
| downstream/semseg/lib (2%) --> downstream/votenet/models (<1%) |
80 | 1 file pair | details... |
Longest Duplicates
The list of 20 longest duplicates.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 411 | x 2 | downstream/semseg/modelsdownstream/votenet/model...econv/models_sparseconv |  resunet.pyresunet.py |
18:543 (100%)18:543 (100%) | view |
| 411 | x 2 | downstream/insseg/modelsdownstream/votenet/model...econv/models_sparseconv | resunet.pyresunet.py |
12:537 (100%)18:543 (100%) | view |
| 411 | x 2 | downstream/insseg/modelsdownstream/semseg/models | resunet.pyresunet.py |
12:537 (100%)18:543 (100%) | view |
| 316 | x 2 | downstream/votenet/models/backbone/pointnet2pretrain/contrastive_sce...ontexts/model/pointnet2 | pointnet2_modules.pypointnet2_modules.py |
6:518 (100%)6:518 (100%) | view |
| 301 | x 2 | downstream/insseg/datase...benchmark_utils/scriptsdownstream/semseg/datase...benchmark_utils/scripts | evaluate_semantic_instance.pyevaluate_semantic_instance.py |
43:443 (100%)43:443 (100%) | view |
| 301 | x 2 | downstream/insseg/datase...benchmark_utils/scriptspretrain/contrastive_scene_contexts/lib/evaluation | evaluate_semantic_instance.pyevaluate_semantic_instance.py |
43:443 (100%)43:443 (100%) | view |
| 301 | x 2 | downstream/semseg/datase...benchmark_utils/scriptspretrain/contrastive_scene_contexts/lib/evaluation | evaluate_semantic_instance.pyevaluate_semantic_instance.py |
43:443 (100%)43:443 (100%) | view |
| 243 | x 2 | downstream/insseg/datasets/evaluationdownstream/semseg/datasets/evaluation | evaluate_semantic_instance.pyevaluate_semantic_instance.py |
43:369 (79%)43:369 (78%) | view |
| 234 | x 2 | downstream/votenet/models/backbone/pointnet2pretrain/contrastive_sce...ontexts/model/pointnet2 | pytorch_utils.pypytorch_utils.py |
6:296 (100%)6:296 (100%) | view |
| 233 | x 2 | downstream/insseg/datasets/evaluationdownstream/insseg/datase...benchmark_utils/scripts | evaluate_semantic_instance.pyevaluate_semantic_instance.py |
61:369 (76%)61:369 (77%) | view |
| 233 | x 2 | downstream/insseg/datasets/evaluationpretrain/contrastive_scene_contexts/lib/evaluation | evaluate_semantic_instance.pyevaluate_semantic_instance.py |
61:369 (76%)61:369 (77%) | view |
| 233 | x 2 | downstream/insseg/datase...benchmark_utils/scriptsdownstream/semseg/datasets/evaluation | evaluate_semantic_instance.pyevaluate_semantic_instance.py |
61:369 (77%)61:369 (74%) | view |
| 233 | x 2 | downstream/insseg/datasets/evaluationdownstream/semseg/datase...benchmark_utils/scripts | evaluate_semantic_instance.pyevaluate_semantic_instance.py |
61:369 (76%)61:369 (77%) | view |
| 233 | x 2 | downstream/semseg/datasets/evaluationdownstream/semseg/datase...benchmark_utils/scripts | evaluate_semantic_instance.pyevaluate_semantic_instance.py |
61:369 (74%)61:369 (77%) | view |
| 233 | x 2 | downstream/semseg/datasets/evaluationpretrain/contrastive_scene_contexts/lib/evaluation | evaluate_semantic_instance.pyevaluate_semantic_instance.py |
61:369 (74%)61:369 (77%) | view |
| 232 | x 2 | downstream/insseg/libdownstream/semseg/lib | pc_utils.pypc_utils.py |
13:344 (100%)13:344 (100%) | view |
| 208 | x 2 | downstream/votenet/model.../pointnet2/_ext_src/srcpretrain/contrastive_sce.../pointnet2/_ext_src/src | cu sampling_gpu.cusampling_gpu.cu |
1:229 (100%)1:229 (100%) | view |
| 188 | x 2 | downstream/insseg/libdownstream/semseg/lib | utils.pyutils.py |
67:345 (84%)63:341 (85%) | view |
| 183 | x 2 | downstream/semseg/modelsdownstream/votenet/model...econv/models_sparseconv | res16unet.pyres16unet.py |
48:259 (67%)47:257 (67%) | view |
| 180 | x 2 | downstream/insseg/datasetsdownstream/semseg/datasets | dataset.pydataset.py |
62:306 (45%)60:304 (59%) | view |
Duplicated Units
The list of top 20 duplicated units.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 134 | x 3 | downstream/semseg/modelsdownstream/insseg/modelsdownstream/votenet/model...econv/models_sparseconv | resunet.pyresunet.pyresunet.py |
0:0 0:0 0:0 | view |
| 130 | x 3 | downstream/semseg/modelsdownstream/insseg/modelsdownstream/votenet/model...econv/models_sparseconv | resunet.pyresunet.pyresunet.py |
0:0 0:0 0:0 | view |
| 134 | x 5 | downstream/semseg/datasets/evaluationdownstream/semseg/datase...benchmark_utils/scriptsdownstream/insseg/datasets/evaluationdownstream/insseg/datase...benchmark_utils/scriptspretrain/contrastive_scene_contexts/lib/evaluation | evaluate_semantic_instance.pyevaluate_semantic_instance.pyevaluate_semantic_instance.pyevaluate_semantic_instance.pyevaluate_semantic_instance.py |
0:0 0:0 0:0 0:0 0:0 | view |
| 79 | x 2 | downstream/semseg/libdownstream/insseg/lib | pc_utils.pypc_utils.py |
0:0 0:0 | view |
| 62 | x 2 | downstream/semseg/datasetsdownstream/insseg/datasets | dataset.pydataset.py |
0:0 0:0 | view |
| 43 | x 4 | downstream/semseg/libdownstream/insseg/libdownstream/votenet/lib/utilspretrain/contrastive_scene_contexts/lib | io3d.pyio3d.pyio3d.pyio3d.py |
0:0 0:0 0:0 0:0 | view |
| 50 | x 5 | downstream/semseg/datasets/evaluationdownstream/semseg/datase...benchmark_utils/scriptsdownstream/insseg/datasets/evaluationdownstream/insseg/datase...benchmark_utils/scriptspretrain/contrastive_scene_contexts/lib/evaluation | evaluate_semantic_instance.pyevaluate_semantic_instance.pyevaluate_semantic_instance.pyevaluate_semantic_instance.pyevaluate_semantic_instance.py |
0:0 0:0 0:0 0:0 0:0 | view |
| 42 | x 3 | downstream/semseg/modelsdownstream/insseg/modelsdownstream/votenet/model...econv/models_sparseconv | resnet.pyresnet.pyresnet.py |
0:0 0:0 0:0 | view |
| 43 | x 2 | downstream/semseg/datasetsdownstream/insseg/datasets | dataset.pydataset.py |
0:0 0:0 | view |
| 40 | x 4 | downstream/semseg/modelsdownstream/insseg/modelsdownstream/votenet/model...econv/models_sparseconvpretrain/contrastive_scene_contexts/model | resnet.pyresnet.pyresnet.pyresnet.py |
0:0 0:0 0:0 0:0 | view |
| 48 | x 2 | downstream/semseg/libdownstream/insseg/lib | pc_utils.pypc_utils.py |
0:0 0:0 | view |
| 53 | x 2 | downstream/votenet/models/backbone/pointnet2pretrain/contrastive_sce...ontexts/model/pointnet2 | pointnet2_utils.pypointnet2_utils.py |
0:0 0:0 | view |
| 57 | x 2 | downstream/votenet/models/backbone/pointnet2pretrain/contrastive_sce...ontexts/model/pointnet2 | pointnet2_modules.pypointnet2_modules.py |
0:0 0:0 | view |
| 43 | x 2 | downstream/semseg/datasetsdownstream/insseg/datasets | stanford.pystanford.py |
0:0 0:0 | view |
| 46 | x 2 | downstream/semseg/datasetsdownstream/insseg/datasets | voxelizer.pyvoxelizer.py |
0:0 0:0 | view |
| 36 | x 2 | downstream/semseg/datasetsdownstream/insseg/datasets | stanford.pystanford.py |
0:0 0:0 | view |
| 42 | x 4 | downstream/semseg/models/modulesdownstream/insseg/models/modulesdownstream/votenet/model...dels_sparseconv/modulespretrain/contrastive_scene_contexts/model/modules | common.pycommon.pycommon.pycommon.py |
0:0 0:0 0:0 0:0 | view |
| 38 | x 2 | downstream/semseg/datasetsdownstream/insseg/datasets | stanford.pystanford.py |
0:0 0:0 | view |
| 47 | x 2 | downstream/semseg/libdownstream/insseg/lib | utils.pyutils.py |
0:0 0:0 | view |
| 34 | x 3 | downstream/semseg/modelsdownstream/insseg/modelsdownstream/votenet/model...econv/models_sparseconv | resunet.pyresunet.pyresunet.py |
0:0 0:0 0:0 | view |