facebookresearch / TaBERT
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
  • For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
  • Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
  • You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.
Learn more...
Duplication Overall
  • 5% duplication:
    • 5,378 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
    • 294 duplicated lines
  • 13 duplicates
system5% (294 lines)
Duplication per Extension
py5% (294 lines)
Duplication per Component (primary)
utils22% (148 lines)
table_bert5% (75 lines)
table_bert/vertical5% (41 lines)
preprocess1% (30 lines)
contrib/wiki_extractor/src/main/java0% (0 lines)
ROOT0% (0 lines)
scripts0% (0 lines)

Duplication Between Components (50+ lines)

G table_bert table_bert table_bert/vertical table_bert/vertical table_bert--table_bert/vertical 82

Download: SVG DOT (open online Graphviz editor)

Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 13 longest duplicates.
See data for all 13 duplicates...
Size#FoldersFilesLinesCode
33 x 2 utils
utils
generate_vanilla_tabert_training_data.py
generate_vertical_tabert_training_dat...
145:191 (29%)
214:260 (20%)
view
21 x 2 table_bert
table_bert/vertical
vanilla_table_bert.py
vertical_attention_table_bert.py
279:305 (10%)
474:500 (6%)
view
17 x 2 utils
utils
generate_vanilla_tabert_training_data.py
generate_vertical_tabert_training_dat...
104:126 (15%)
173:195 (10%)
view
11 x 2 table_bert
table_bert
table_bert.py
table_bert.py
130:141 (6%)
224:235 (6%)
view
8 x 2 preprocess
preprocess
WikiExtractor.py
extract_wiki_data.py
3207:3216 (<1%)
233:242 (4%)
view
8 x 2 utils
utils
generate_vanilla_tabert_training_data.py
generate_vertical_tabert_training_dat...
45:52 (7%)
101:108 (4%)
view
8 x 2 table_bert
table_bert/vertical
input_formatter.py
input_formatter.py
172:180 (3%)
70:78 (4%)
view
8 x 2 utils
utils
generate_vanilla_tabert_training_data.py
generate_vertical_tabert_training_dat...
82:91 (7%)
132:141 (4%)
view
8 x 2 utils
utils
generate_vanilla_tabert_training_data.py
generate_vertical_tabert_training_dat...
130:139 (7%)
199:208 (4%)
view
7 x 2 preprocess
preprocess
WikiExtractor.py
WikiExtractor.py
1153:1161 (<1%)
1169:1177 (<1%)
view
6 x 2 table_bert
table_bert
table_bert.py
vanilla_table_bert.py
33:39 (3%)
28:34 (2%)
view
6 x 2 table_bert
table_bert/vertical
vanilla_table_bert.py
vertical_attention_table_bert.py
248:253 (2%)
510:515 (1%)
view
6 x 2 table_bert
table_bert/vertical
vanilla_table_bert.py
vertical_attention_table_bert.py
168:173 (2%)
433:438 (1%)
view