tensorflow / tensor2tensor
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 11% duplication:
    • 70,163 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 7,892 duplicated lines
  • 1,036 duplicates
system11% (7,892 lines)
Duplication per Extension
py11% (7,638 lines)
js11% (156 lines)
html14% (98 lines)
Duplication per Component (primary)
tensor2tensor/models14% (3,560 lines)
tensor2tensor/data_generators13% (2,302 lines)
tensor2tensor/layers9% (1,033 lines)
tensor2tensor/utils5% (516 lines)
tensor2tensor/insights12% (254 lines)
tensor2tensor/rl5% (227 lines)
ROOT0% (0 lines)
tensor2tensor/visualization0% (0 lines)
tensor2tensor/envs0% (0 lines)
tensor2tensor/metrics0% (0 lines)
tensor2tensor0% (0 lines)
tensor2tensor/serving0% (0 lines)

Duplication Between Components (50+ lines)

G tensor2tensor/layers tensor2tensor/layers tensor2tensor/models tensor2tensor/models tensor2tensor/layers--tensor2tensor/models 369 tensor2tensor/utils tensor2tensor/utils tensor2tensor/models--tensor2tensor/utils 312

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 20 longest duplicates.
See data for all 1,036 duplicates...
Size#FoldersFilesLinesCode
65 x 2 tensor2tensor/rl
tensor2tensor/rl
dopamine_connector.py
dopamine_connector.py
 111:197 (12%)
304:390 (12%)
 view
37 x 2 tensor2tensor/models/research
tensor2tensor/utils
transformer_vae_flow_prior.py
t2t_model.py
 117:168 (4%)
631:682 (2%)
 view
29 x 2 tensor2tensor/models/research
tensor2tensor/models/research
universal_transformer_util.py
universal_transformer_util.py
 637:671 (3%)
729:763 (3%)
 view
27 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
translate_encs_cubbitt.py
translate_enfr.py
 67:98 (65%)
164:195 (15%)
 view
27 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
lambada.py
lambada.py
 133:176 (16%)
224:267 (16%)
 view
25 x 2 tensor2tensor/models
tensor2tensor/models
transformer.py
transformer.py
 1084:1115 (1%)
1236:1267 (1%)
 view
24 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
subject_verb_agreement.py
subject_verb_agreement.py
 118:156 (17%)
223:261 (17%)
 view
24 x 2 tensor2tensor/insights/polymer
tensor2tensor/insights/polymer
index.html
tensor2tensor.html
 43:70 (54%)
43:70 (54%)
 view
23 x 2 tensor2tensor/models
tensor2tensor/models
image_transformer_2d.py
image_transformer_2d.py
 75:98 (3%)
111:134 (3%)
 view
23 x 2 tensor2tensor/models/research
tensor2tensor/models/research
vqa_self_attention.py
vqa_self_attention.py
 145:170 (3%)
210:235 (3%)
 view
22 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
bair_robot_pushing.py
moving_mnist.py
 91:116 (19%)
83:108 (25%)
 view
22 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
transduction_problems.py
transduction_problems.py
 169:195 (16%)
209:235 (16%)
 view
22 x 2 tensor2tensor/models
tensor2tensor/models/research
image_transformer_2d.py
transformer_parallel.py
 337:366 (3%)
202:231 (9%)
 view
21 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
multinli.py
stanford_nli.py
 86:111 (17%)
43:68 (25%)
 view
20 x 2 tensor2tensor/models
tensor2tensor/models
evolved_transformer.py
evolved_transformer.py
 376:395 (3%)
585:604 (3%)
 view
20 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
cola.py
scitail.py
 44:67 (32%)
43:66 (28%)
 view
20 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
cola.py
imdb.py
 44:67 (32%)
37:60 (35%)
 view
20 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
scitail.py
yelp_polarity.py
 43:66 (28%)
37:60 (35%)
 view
20 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
imdb.py
scitail.py
 37:60 (35%)
43:66 (28%)
 view
20 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
cola.py
yelp_polarity.py
 44:67 (32%)
37:60 (35%)
 view
Duplicated Units
The list of top 20 duplicated units.
See data for all 31 unit duplicates...
Size#FoldersFilesLinesCode
17 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
common_voice.py
librispeech.py
 0:0 
0:0 
 view
20 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
translate_encs_cubbitt.py
translate_enfr.py
 0:0 
0:0 
 view
25 x 2 tensor2tensor/models/research
tensor2tensor/models/research
vqa_self_attention.py
vqa_recurrent_self_attention.py
 0:0 
0:0 
 view
16 x 2 tensor2tensor/rl
tensor2tensor/rl
dopamine_connector.py
dopamine_connector.py
 0:0 
0:0 
 view
14 x 2 tensor2tensor/models/research
tensor2tensor/models/research
transformer_vae.py
transformer_nat.py
 0:0 
0:0 
 view
13 x 2 tensor2tensor/data_generators/wikisum
tensor2tensor/data_generators/wikisum
get_references_web_single_group.py
utils.py
 0:0 
0:0 
 view
12 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
video_utils.py
image_utils.py
 0:0 
0:0 
 view
11 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
qnli.py
rte.py
 0:0 
0:0 
 view
11 x 2 tensor2tensor/models
tensor2tensor/models
mtf_transformer.py
mtf_transformer2.py
 0:0 
0:0 
 view
11 x 2 tensor2tensor/models
tensor2tensor/models
mtf_resnet.py
mtf_image_transformer.py
 0:0 
0:0 
 view
15 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
subject_verb_agreement.py
subject_verb_agreement.py
 0:0 
0:0 
 view
10 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
mrpc.py
wikitext103.py
 0:0 
0:0 
 view
14 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
lambada.py
lambada.py
 0:0 
0:0 
 view
10 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
yelp_polarity.py
yelp_full.py
 0:0 
0:0 
 view
11 x 2 tensor2tensor/rl
tensor2tensor/rl
dopamine_connector.py
dopamine_connector.py
 0:0 
0:0 
 view
9 x 3 tensor2tensor/data_generators
tensor2tensor/data_generators
tensor2tensor/data_generators
moving_mnist.py
bair_robot_pushing.py
video_generated.py
 0:0 
0:0 
0:0 
 view
8 x 3 tensor2tensor/data_generators
tensor2tensor/data_generators
tensor2tensor/data_generators
imagenet.py
celeba.py
cifar.py
 0:0 
0:0 
0:0 
 view
8 x 2 tensor2tensor/data_generators
tensor2tensor/data_generators
cifar.py
cifar.py
 0:0 
0:0 
 view
12 x 2 tensor2tensor/rl
tensor2tensor/rl
trainer_model_based.py
rl_utils.py
 0:0 
0:0 
 view
7 x 5 tensor2tensor/data_generators
tensor2tensor/data_generators
tensor2tensor/data_generators
tensor2tensor/data_generators
tensor2tensor/data_generators
quora_qpairs.py
qnli.py
squad.py
stanford_nli.py
multinli.py
 0:0 
0:0 
0:0 
0:0 
0:0 
 view