amazon-research / gluonmm
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 55% duplication:
    • 6,328 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 3,526 duplicated lines
  • 1,218 duplicates
system55% (3,526 lines)
Duplication per Extension
yaml83% (2,163 lines)
py36% (1,363 lines)
Duplication per Component (primary)
scripts/image_classification/config83% (1,852 lines)
src/transformers/models37% (819 lines)
scripts/action_recognition/config83% (311 lines)
src/transformers/utils36% (227 lines)
src/transformers/pipelines66% (152 lines)
src/transformers/data18% (96 lines)
scripts/image_classification37% (39 lines)
scripts/action_recognition34% (30 lines)
src0% (0 lines)
src/transformers0% (0 lines)

Duplication Between Components (50+ lines)

G scripts/action_recognition/config scripts/action_recognition/config scripts/image_classification/config scripts/image_classification/config scripts/action_recognition/config--scripts/image_classification/config 222

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 20 longest duplicates.
See data for all 1,218 duplicates...
Size#FoldersFilesLinesCode
57 x 2 scripts/image_classification/config
scripts/image_classification/config
vit_base_patch32_384_imagenet1k.yaml
vit_large_patch16_384_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
cait_s24_patch16_384_imagenet1k.yaml
cait_xxs36_patch16_384_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
deit_base_distilled_patch16_384_image...
deit_base_patch16_384_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
swin_base_patch4_window7_224.yaml
swin_small_patch4_window7_224.yaml
3:64 (81%)
3:64 (81%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
cait_s36_patch16_384_imagenet1k.yaml
cait_xxs36_patch16_384_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
deit_base_patch16_224_imagenet1k.yaml
deit_tiny_patch16_224_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
cait_s24_patch16_384_imagenet1k.yaml
cait_xs24_patch16_384_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
cait_m36_patch16_384_imagenet1k.yaml
cait_xxs24_patch16_384_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
deit_base_distilled_patch16_224_image...
deit_small_distilled_patch16_224_imag...
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
vit_base_patch16_224_imagenet1k.yaml
vit_large_patch16_224_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
cait_xs24_patch16_384_imagenet1k.yaml
cait_xxs24_patch16_384_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
deit_small_distilled_patch16_224_imag...
deit_tiny_patch16_224_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
swin_base_patch4_window7_224.yaml
swin_large_patch4_window7_224_22kto1k...
3:64 (81%)
3:64 (81%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
vit_base_patch16_384_imagenet1k.yaml
vit_large_patch32_384_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
swin_base_patch4_window7_224.yaml
swin_base_patch4_window7_224_22kto1k....
3:64 (81%)
3:64 (81%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
deit_small_patch16_224_imagenet1k.yaml
deit_tiny_distilled_patch16_224_image...
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
deit_base_patch16_224_imagenet1k.yaml
deit_small_distilled_patch16_224_imag...
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
cait_m36_patch16_384_imagenet1k.yaml
cait_xs24_patch16_384_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
cait_s36_patch16_384_imagenet1k.yaml
cait_xs24_patch16_384_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
57 x 2 scripts/image_classification/config
scripts/image_classification/config
deit_base_distilled_patch16_224_image...
deit_base_patch16_224_imagenet1k.yaml
3:64 (82%)
3:64 (82%)
view
Duplicated Units
The list of top 7 duplicated units.
See data for all 7 unit duplicates...
Size#FoldersFilesLinesCode
13 x 2 src/transformers/models/vidtr
src/transformers/models/vidtr
multihead_attention.py
multihead_attention.py
0:0 
0:0 
view
11 x 2 src/transformers/models/vidtr
src/transformers/models/vidtr
vidtr_split.py
vidtr_compact.py
0:0 
0:0 
view
10 x 2 src/transformers/models/vidtr
src/transformers/models/vidtr
multihead_attention.py
multihead_attention.py
0:0 
0:0 
view
7 x 2 src/transformers/models/swin
src/transformers/models/vit
swin_transformer.py
vision_transformer.py
0:0 
0:0 
view
7 x 2 src/transformers/models/swin
src/transformers/models/cait
swin_transformer.py
cait.py
0:0 
0:0 
view
6 x 2 src/transformers/models/swin
src/transformers/models/vit
swin_transformer.py
vision_transformer.py
0:0 
0:0 
view
6 x 2 src/transformers/models/vidtr
src/transformers/models/vidtr
vidtr_split.py
vidtr_compact.py
0:0 
0:0 
view