Places in code with 6 or more lines that are exactly the same.
Intro
- For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
- Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
- You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
- To learn more about duplications and techniques for eliminating duplication, Sokrates recommends the following resources:
- Avoid Repetition, MartinFlower.com (IEEE Software article)
- Refactoring duplicated code, sourcemaking.com
- Beck Design Rules, MartinFowler.com
- DRY (Don't Repeat Yourself) Principle, Wikipedia
- The Cut-and-Paste Programming Software Development Anti-Pattern, sourcemaking.com
- Code Smells / Duplicated Code, Jeff Atwood, codinghorror.com:
- "Duplicated code is the bane of software development. Stamp out duplication whenever possible. You should always be on the lookout for more subtle cases of near-duplication, too. Don't Repeat Yourself!"
- Reducing Coupling, MartinFlower.com (IEEE Software article):
- "There are several ways to describe coupling, but it boils down to this: If changing one module in a program requires changing another module, then coupling exists. ... Duplication always implies coupling, because changing one piece of duplicate code implies changing the other."
Duplication Overall
- 42% duplication:
- 13,189 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
- 5,567 duplicated lines
- 792 duplicates
Duplication per Extension
Duplication per Component (primary)
Duplication Between Components (50+ lines)
Open 3D force graph...
Show more details on duplication between components...
From Component
--> To Component
Duplicated
Lines
File Pairs
Details
mask2former/modeling (14%)
--> mask2former_video/modeling (96%)
1137
8 file pairs
details...
configs/ade20k (74%)
--> configs/cityscapes (68%)
738
45 file pairs
details...
configs/cityscapes (60%)
--> configs/coco (88%)
649
48 file pairs
details...
configs/ade20k (57%)
--> configs/coco (78%)
572
32 file pairs
details...
configs/cityscapes (39%)
--> configs/youtubevis_2019 (119%)
426
21 file pairs
details...
configs/cityscapes (39%)
--> configs/youtubevis_2021 (121%)
426
21 file pairs
details...
configs/ade20k (39%)
--> configs/mapillary-vistas (84%)
394
18 file pairs
details...
configs/cityscapes (35%)
--> configs/mapillary-vistas (83%)
386
18 file pairs
details...
configs/coco (50%)
--> configs/youtubevis_2021 (104%)
367
16 file pairs
details...
configs/coco (50%)
--> configs/youtubevis_2019 (103%)
367
16 file pairs
details...
configs/ade20k (35%)
--> configs/youtubevis_2021 (101%)
356
14 file pairs
details...
configs/ade20k (35%)
--> configs/youtubevis_2019 (100%)
356
14 file pairs
details...
configs/youtubevis_2019 (94%)
--> configs/youtubevis_2021 (96%)
338
9 file pairs
details...
configs/coco (39%)
--> configs/mapillary-vistas (62%)
290
12 file pairs
details...
configs/mapillary-vistas (42%)
--> configs/youtubevis_2021 (56%)
198
6 file pairs
details...
configs/mapillary-vistas (42%)
--> configs/youtubevis_2019 (55%)
198
6 file pairs
details...
mask2former (26%)
--> mask2former_video (44%)
160
1 file pair
details...
| From Component --> To Component |
Duplicated Lines |
File Pairs | Details |
|---|---|---|---|
| mask2former/modeling (14%) --> mask2former_video/modeling (96%) |
1137 | 8 file pairs | details... |
| configs/ade20k (74%) --> configs/cityscapes (68%) |
738 | 45 file pairs | details... |
| configs/cityscapes (60%) --> configs/coco (88%) |
649 | 48 file pairs | details... |
| configs/ade20k (57%) --> configs/coco (78%) |
572 | 32 file pairs | details... |
| configs/cityscapes (39%) --> configs/youtubevis_2019 (119%) |
426 | 21 file pairs | details... |
| configs/cityscapes (39%) --> configs/youtubevis_2021 (121%) |
426 | 21 file pairs | details... |
| configs/ade20k (39%) --> configs/mapillary-vistas (84%) |
394 | 18 file pairs | details... |
| configs/cityscapes (35%) --> configs/mapillary-vistas (83%) |
386 | 18 file pairs | details... |
| configs/coco (50%) --> configs/youtubevis_2021 (104%) |
367 | 16 file pairs | details... |
| configs/coco (50%) --> configs/youtubevis_2019 (103%) |
367 | 16 file pairs | details... |
| configs/ade20k (35%) --> configs/youtubevis_2021 (101%) |
356 | 14 file pairs | details... |
| configs/ade20k (35%) --> configs/youtubevis_2019 (100%) |
356 | 14 file pairs | details... |
| configs/youtubevis_2019 (94%) --> configs/youtubevis_2021 (96%) |
338 | 9 file pairs | details... |
| configs/coco (39%) --> configs/mapillary-vistas (62%) |
290 | 12 file pairs | details... |
| configs/mapillary-vistas (42%) --> configs/youtubevis_2021 (56%) |
198 | 6 file pairs | details... |
| configs/mapillary-vistas (42%) --> configs/youtubevis_2019 (55%) |
198 | 6 file pairs | details... |
| mask2former (26%) --> mask2former_video (44%) |
160 | 1 file pair | details... |
Longest Duplicates
The list of 20 longest duplicates.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 145 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder |  mask2former_transformer_decoder.pyvideo_mask2former_transformer_decoder.py |
17:207 (45%)18:208 (44%) | view |
| 82 | x 2 | mask2former/modeling/pixel_decoder/ops/src/cudamask2former/modeling/pixel_decoder/ops/src/cuda | cuh ms_deform_im2col_cuda.cuhms_deform_im2col_cuda.cuh |
625:713 (6%)738:826 (6%) | view |
| 76 | x 2 | mask2former/modelingmask2former_video/modeling | criterion.pycriterion.py |
161:263 (52%)157:259 (53%) | view |
| 73 | x 2 | ROOTROOT | train_net.pytrain_net_video.py |
175:264 (30%)95:184 (38%) | view |
| 69 | x 2 | mask2former/modeling/pixel_decoder/ops/src/cudamask2former/modeling/pixel_decoder/ops/src/cuda | cuh ms_deform_im2col_cuda.cuhms_deform_im2col_cuda.cuh |
520:594 (5%)625:699 (5%) | view |
| 69 | x 2 | mask2former/modeling/pixel_decoder/ops/src/cudamask2former/modeling/pixel_decoder/ops/src/cuda | cuh ms_deform_im2col_cuda.cuhms_deform_im2col_cuda.cuh |
520:594 (5%)738:812 (5%) | view |
| 68 | x 2 | mask2former/modeling/pixel_decoder/ops/src/cudamask2former/modeling/pixel_decoder/ops/src/cuda | cuh ms_deform_im2col_cuda.cuhms_deform_im2col_cuda.cuh |
308:381 (5%)413:486 (5%) | view |
| 62 | x 2 | mask2former/modeling/pixel_decoder/ops/src/cudamask2former/modeling/pixel_decoder/ops/src/cuda | cuh ms_deform_im2col_cuda.cuhms_deform_im2col_cuda.cuh |
94:160 (5%)169:235 (5%) | view |
| 61 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder | mask2former_transformer_decoder.pyvideo_mask2former_transformer_decoder.py |
278:359 (19%)283:364 (18%) | view |
| 51 | x 2 | mask2former/modeling/pixel_decoder/ops/src/cudamask2former/modeling/pixel_decoder/ops/src/cuda | cuh ms_deform_im2col_cuda.cuhms_deform_im2col_cuda.cuh |
329:385 (4%)542:598 (4%) | view |
| 47 | x 2 | mask2former/modeling/pixel_decoder/ops/src/cudamask2former/modeling/pixel_decoder/ops/src/cuda | cuh ms_deform_im2col_cuda.cuhms_deform_im2col_cuda.cuh |
329:381 (3%)760:812 (3%) | view |
| 47 | x 2 | mask2former/modeling/pixel_decoder/ops/src/cudamask2former/modeling/pixel_decoder/ops/src/cuda | cuh ms_deform_im2col_cuda.cuhms_deform_im2col_cuda.cuh |
329:381 (3%)647:699 (3%) | view |
| 47 | x 2 | mask2former/modeling/pixel_decoder/ops/src/cudamask2former/modeling/pixel_decoder/ops/src/cuda | cuh ms_deform_im2col_cuda.cuhms_deform_im2col_cuda.cuh |
434:486 (3%)760:812 (3%) | view |
| 47 | x 2 | mask2former/modeling/pixel_decoder/ops/src/cudamask2former/modeling/pixel_decoder/ops/src/cuda | cuh ms_deform_im2col_cuda.cuhms_deform_im2col_cuda.cuh |
434:486 (3%)542:594 (3%) | view |
| 47 | x 2 | mask2former/modeling/pixel_decoder/ops/src/cudamask2former/modeling/pixel_decoder/ops/src/cuda | cuh ms_deform_im2col_cuda.cuhms_deform_im2col_cuda.cuh |
434:486 (3%)647:699 (3%) | view |
| 44 | x 2 | configs/youtubevis_2019configs/youtubevis_2021 |  video_maskformer2_R50_bs16_8ep.yamlvideo_maskformer2_R50_bs16_8ep.yaml |
1:45 (100%)1:45 (100%) | view |
| 41 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder | mask2former_transformer_decoder.pyvideo_mask2former_transformer_decoder.py |
385:437 (12%)396:448 (12%) | view |
| 39 | x 2 | configs/mapillary-vistas/panoptic-segmentationconfigs/mapillary-vistas/semantic-segmentation | maskformer_R50_bs16_300k.yamlmaskformer2_R50_bs16_300k.yaml |
2:41 (90%)2:41 (90%) | view |
| 38 | x 2 | configs/cityscapes/panoptic-segmentationconfigs/cityscapes/semantic-segmentation | maskformer2_R50_bs16_90k.yamlmaskformer2_R50_bs16_90k.yaml |
2:40 (88%)2:40 (88%) | view |
| 38 | x 2 | configs/ade20k/panoptic-segmentationconfigs/ade20k/semantic-segmentation | maskformer2_R50_bs16_160k.yamlmaskformer2_R50_bs16_160k.yaml |
2:40 (88%)2:40 (88%) | view |
Duplicated Units
The list of top 20 duplicated units.
| Size | # | Folders | Files | Lines | Code |
|---|---|---|---|---|---|
| 70 | x 2 | ROOTROOT | train_net_video.pytrain_net.py |
0:0 0:0 | view |
| 48 | x 2 | mask2former/data/datasetsmask2former/data/datasets | register_mapillary_vistas_panoptic.pyregister_ade20k_panoptic.py |
0:0 0:0 | view |
| 30 | x 2 | mask2former/modelingmask2former_video/modeling | criterion.pycriterion.py |
0:0 0:0 | view |
| 25 | x 2 | mask2former/data/dataset_mappersmask2former/data/dataset_mappers | coco_panoptic_new_baseline_dataset_ma...coco_instance_new_baseline_dataset_ma... |
0:0 0:0 | view |
| 14 | x 2 | mask2former/modelingmask2former_video/modeling | criterion.pycriterion.py |
0:0 0:0 | view |
| 22 | x 2 | mask2former/modelingmask2former_video/modeling | criterion.pycriterion.py |
0:0 0:0 | view |
| 21 | x 2 | mask2former/modelingmask2former_video/modeling | matcher.pymatcher.py |
0:0 0:0 | view |
| 11 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder | mask2former_transformer_decoder.pyvideo_mask2former_transformer_decoder.py |
0:0 0:0 | view |
| 11 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder | mask2former_transformer_decoder.pyvideo_mask2former_transformer_decoder.py |
0:0 0:0 | view |
| 14 | x 2 | mask2former/modelingmask2former_video/modeling | criterion.pycriterion.py |
0:0 0:0 | view |
| 19 | x 2 | mask2former/modelingmask2former_video/modeling | criterion.pycriterion.py |
0:0 0:0 | view |
| 9 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder | mask2former_transformer_decoder.pyvideo_mask2former_transformer_decoder.py |
0:0 0:0 | view |
| 9 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder | mask2former_transformer_decoder.pyvideo_mask2former_transformer_decoder.py |
0:0 0:0 | view |
| 9 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder | mask2former_transformer_decoder.pyvideo_mask2former_transformer_decoder.py |
0:0 0:0 | view |
| 10 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder | mask2former_transformer_decoder.pyvideo_mask2former_transformer_decoder.py |
0:0 0:0 | view |
| 9 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder | position_encoding.pyposition_encoding.py |
0:0 0:0 | view |
| 9 | x 2 | mask2former/modeling/transformer_decodermask2former/modeling/transformer_decoder | transformer.pytransformer.py |
0:0 0:0 | view |
| 8 | x 2 | mask2former/modelingmask2former_video/modeling | matcher.pymatcher.py |
0:0 0:0 | view |
| 8 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder | mask2former_transformer_decoder.pyvideo_mask2former_transformer_decoder.py |
0:0 0:0 | view |
| 8 | x 2 | mask2former/modeling/transformer_decodermask2former_video/modeling/transformer_decoder | mask2former_transformer_decoder.pyvideo_mask2former_transformer_decoder.py |
0:0 0:0 | view |